Sep 15 07:01:00.104982 ip-10-0-129-10 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 07:01:00.519920 ip-10-0-129-10 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 07:01:00.519920 ip-10-0-129-10 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 07:01:00.519920 ip-10-0-129-10 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 07:01:00.519920 ip-10-0-129-10 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 07:01:00.519920 ip-10-0-129-10 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 07:01:00.521942 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.521870    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 07:01:00.526794 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526765    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 07:01:00.526891 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526881    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 07:01:00.526891 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526891    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 07:01:00.526952 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526895    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 07:01:00.526952 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526900    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 07:01:00.526952 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526903    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 07:01:00.526952 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526906    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 07:01:00.526952 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526909    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 07:01:00.526952 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526912    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 07:01:00.526952 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526915    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 07:01:00.526952 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526917    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 07:01:00.526952 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526920    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 07:01:00.526952 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526923    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 07:01:00.526952 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526926    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 07:01:00.526952 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526928    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 07:01:00.526952 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526931    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 07:01:00.526952 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526934    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 07:01:00.526952 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526936    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 07:01:00.526952 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526939    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 07:01:00.526952 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526941    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 07:01:00.526952 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526944    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 07:01:00.526952 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526946    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 07:01:00.526952 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526949    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 07:01:00.527436 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526952    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 07:01:00.527436 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526954    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 07:01:00.527436 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526959    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 07:01:00.527436 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526964    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 07:01:00.527436 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526972    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 07:01:00.527436 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526975    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 07:01:00.527436 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526978    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 07:01:00.527436 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526981    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 07:01:00.527436 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526984    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 07:01:00.527436 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526986    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 07:01:00.527436 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526991    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 07:01:00.527436 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526993    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 07:01:00.527436 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526996    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 07:01:00.527436 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.526998    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 07:01:00.527436 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527001    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 07:01:00.527436 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527003    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 07:01:00.527436 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527006    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 07:01:00.527436 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527008    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 07:01:00.527436 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527011    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 07:01:00.527932 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527013    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 07:01:00.527932 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527016    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 07:01:00.527932 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527018    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 07:01:00.527932 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527021    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 07:01:00.527932 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527023    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 07:01:00.527932 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527026    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 07:01:00.527932 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527029    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 07:01:00.527932 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527031    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 07:01:00.527932 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527035    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 07:01:00.527932 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527038    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 07:01:00.527932 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527040    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 07:01:00.527932 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527043    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 07:01:00.527932 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527046    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 07:01:00.527932 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527048    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 07:01:00.527932 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527052    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 07:01:00.527932 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527055    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 07:01:00.527932 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527058    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 07:01:00.527932 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527060    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 07:01:00.527932 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527063    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 07:01:00.527932 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527066    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 07:01:00.528425 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527068    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 07:01:00.528425 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527071    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 07:01:00.528425 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527073    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 07:01:00.528425 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527076    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 07:01:00.528425 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527079    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 07:01:00.528425 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527081    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 07:01:00.528425 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527084    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 07:01:00.528425 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527087    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 07:01:00.528425 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527089    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 07:01:00.528425 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527092    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 07:01:00.528425 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527094    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 07:01:00.528425 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527097    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 07:01:00.528425 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527101    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 07:01:00.528425 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527103    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 07:01:00.528425 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527106    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 07:01:00.528425 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527109    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 07:01:00.528425 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527112    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 07:01:00.528425 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527115    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 07:01:00.528425 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527117    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 07:01:00.528903 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527120    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 07:01:00.528903 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527122    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 07:01:00.528903 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527125    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 07:01:00.528903 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527128    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 07:01:00.528903 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527130    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 07:01:00.528903 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527133    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 07:01:00.528903 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527135    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 07:01:00.528903 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527138    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 07:01:00.528903 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527140    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 07:01:00.528903 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527143    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 07:01:00.528903 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527146    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 07:01:00.528903 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527148    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 07:01:00.528903 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527152    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 07:01:00.528903 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527155    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 07:01:00.528903 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527159    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 07:01:00.528903 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527161    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 07:01:00.528903 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527164    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 07:01:00.528903 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527166    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 07:01:00.528903 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527885    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 07:01:00.529359 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527893    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 07:01:00.529359 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527897    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 07:01:00.529359 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527900    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 07:01:00.529359 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527902    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 07:01:00.529359 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527907    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 07:01:00.529359 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527910    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 07:01:00.529359 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527914    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 07:01:00.529359 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527917    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 07:01:00.529359 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527920    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 07:01:00.529359 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527923    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 07:01:00.529359 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527926    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 07:01:00.529359 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527929    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 07:01:00.529359 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527931    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 07:01:00.529359 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527934    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 07:01:00.529359 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527937    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 07:01:00.529359 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527940    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 07:01:00.529359 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527943    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 07:01:00.529359 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527946    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 07:01:00.529359 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527949    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 07:01:00.529846 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527952    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 07:01:00.529846 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527954    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 07:01:00.529846 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527957    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 07:01:00.529846 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527960    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 07:01:00.529846 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527962    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 07:01:00.529846 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527965    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 07:01:00.529846 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527967    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 07:01:00.529846 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527970    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 07:01:00.529846 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527972    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 07:01:00.529846 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527975    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 07:01:00.529846 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527977    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 07:01:00.529846 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527980    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 07:01:00.529846 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527983    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 07:01:00.529846 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527986    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 07:01:00.529846 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527988    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 07:01:00.529846 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527991    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 07:01:00.529846 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527993    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 07:01:00.529846 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527996    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 07:01:00.529846 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.527999    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 07:01:00.529846 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528002    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 07:01:00.530339 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528005    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 07:01:00.530339 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528007    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 07:01:00.530339 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528010    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 07:01:00.530339 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528013    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 07:01:00.530339 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528016    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 07:01:00.530339 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528019    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 07:01:00.530339 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528022    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 07:01:00.530339 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528024    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 07:01:00.530339 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528027    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 07:01:00.530339 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528030    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 07:01:00.530339 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528034    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 07:01:00.530339 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528036    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 07:01:00.530339 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528039    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 07:01:00.530339 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528042    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 07:01:00.530339 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528044    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 07:01:00.530339 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528047    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 07:01:00.530339 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528049    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 07:01:00.530339 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528052    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 07:01:00.530339 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528054    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 07:01:00.530339 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528057    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 07:01:00.530843 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528060    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 07:01:00.530843 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528064    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 07:01:00.530843 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528067    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 07:01:00.530843 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528069    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 07:01:00.530843 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528074    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 07:01:00.530843 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528077    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 07:01:00.530843 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528080    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 07:01:00.530843 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528083    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 07:01:00.530843 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528086    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 07:01:00.530843 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528088    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 07:01:00.530843 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528091    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 07:01:00.530843 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528094    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 07:01:00.530843 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528097    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 07:01:00.530843 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528100    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 07:01:00.530843 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528104    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 07:01:00.530843 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528107    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 07:01:00.530843 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528109    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 07:01:00.530843 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528112    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 07:01:00.530843 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528115    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 07:01:00.531333 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528117    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 07:01:00.531333 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528120    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 07:01:00.531333 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528123    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 07:01:00.531333 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528125    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 07:01:00.531333 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528129    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 07:01:00.531333 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528131    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 07:01:00.531333 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528134    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 07:01:00.531333 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528136    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 07:01:00.531333 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528139    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 07:01:00.531333 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528142    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 07:01:00.531333 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528144    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 07:01:00.531333 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528147    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 07:01:00.531333 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528149    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 07:01:00.531333 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528152    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 07:01:00.531333 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528154    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 07:01:00.531333 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528157    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 07:01:00.531333 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528159    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 07:01:00.531333 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528162    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 07:01:00.531333 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528165    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 07:01:00.531814 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528167    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 07:01:00.531814 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528557    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 07:01:00.531814 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528562    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 07:01:00.531814 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528565    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 07:01:00.531814 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528569    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 07:01:00.531814 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528572    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 07:01:00.531814 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528574    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 07:01:00.531814 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528578    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 07:01:00.531814 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528582    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 07:01:00.531814 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528585    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 07:01:00.531814 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528587    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 07:01:00.531814 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528590    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 07:01:00.531814 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528593    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 07:01:00.531814 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528595    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 07:01:00.531814 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528598    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 07:01:00.531814 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528601    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 07:01:00.531814 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528603    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 07:01:00.531814 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528606    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 07:01:00.531814 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528609    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 07:01:00.531814 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528612    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 07:01:00.532302 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528614    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 07:01:00.532302 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528617    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 07:01:00.532302 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528620    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 07:01:00.532302 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528622    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 07:01:00.532302 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528625    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 07:01:00.532302 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528627    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 07:01:00.532302 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528630    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 07:01:00.532302 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528633    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 07:01:00.532302 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528635    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 07:01:00.532302 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528638    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 07:01:00.532302 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528642    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 07:01:00.532302 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528645    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 07:01:00.532302 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528647    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 07:01:00.532302 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528650    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 07:01:00.532302 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528653    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 07:01:00.532302 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528656    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 07:01:00.532302 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528661    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 07:01:00.532302 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528664    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 07:01:00.532302 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528667    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 07:01:00.532302 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528670    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 07:01:00.532833 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528673    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 07:01:00.532833 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528675    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 07:01:00.532833 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528678    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 07:01:00.532833 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528681    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 07:01:00.532833 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528683    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 07:01:00.532833 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528686    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 07:01:00.532833 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528689    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 07:01:00.532833 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528691    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 07:01:00.532833 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528694    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 07:01:00.532833 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528697    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 07:01:00.532833 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528700    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 07:01:00.532833 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528702    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 07:01:00.532833 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528705    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 07:01:00.532833 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528721    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 07:01:00.532833 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528724    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 07:01:00.532833 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528727    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 07:01:00.532833 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528729    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 07:01:00.532833 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528732    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 07:01:00.532833 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528735    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 07:01:00.533290 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528737    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 07:01:00.533290 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528740    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 07:01:00.533290 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528743    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 07:01:00.533290 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528745    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 07:01:00.533290 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528748    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 07:01:00.533290 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528751    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 07:01:00.533290 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528754    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 07:01:00.533290 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528758    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 07:01:00.533290 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528761    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 07:01:00.533290 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528765    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 07:01:00.533290 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528767    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 07:01:00.533290 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528770    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 07:01:00.533290 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528773    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 07:01:00.533290 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528775    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 07:01:00.533290 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528778    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 07:01:00.533290 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528781    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 07:01:00.533290 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528784    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 07:01:00.533290 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528787    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 07:01:00.533290 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528789    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 07:01:00.533784 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528792    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 07:01:00.533784 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528795    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 07:01:00.533784 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528797    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 07:01:00.533784 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528800    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 07:01:00.533784 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528802    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 07:01:00.533784 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528808    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 07:01:00.533784 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528811    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 07:01:00.533784 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528814    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 07:01:00.533784 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528817    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 07:01:00.533784 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528820    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 07:01:00.533784 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528823    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 07:01:00.533784 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528825    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 07:01:00.533784 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528828    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 07:01:00.533784 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528831    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 07:01:00.533784 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528833    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 07:01:00.533784 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528836    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 07:01:00.533784 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528839    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 07:01:00.533784 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528841    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 07:01:00.533784 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528844    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528847    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528849    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.528852    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.528918    2568 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.528958    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.528966    2568 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.528970    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.528974    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.528977    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.528981    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.528985    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.528988    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.528992    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.528995    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.528998    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529001    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529004    2568 flags.go:64] FLAG: --cgroup-root=""
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529007    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529010    2568 flags.go:64] FLAG: --client-ca-file=""
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529013    2568 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529017    2568 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529022    2568 flags.go:64] FLAG: --cluster-domain=""
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529025    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 07:01:00.534287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529028    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529031    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529034    2568 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529038    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529041    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529044    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529048    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529051    2568 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529054    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529056    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529060    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529063    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529068    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529071    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529074    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529077    2568 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529080    2568 flags.go:64] FLAG: --enable-server="true"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529083    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529087    2568 flags.go:64] FLAG: --event-burst="100"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529090    2568 flags.go:64] FLAG: --event-qps="50"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529093    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529096    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529099    2568 flags.go:64] FLAG: --eviction-hard=""
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529103    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 07:01:00.534930 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529106    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529109    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529112    2568 flags.go:64] FLAG: --eviction-soft=""
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529115    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529118    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529122    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529127    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529130    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529132    2568 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529135    2568 flags.go:64] FLAG: --feature-gates=""
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529139    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529142    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529145    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529148    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529151    2568 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529155    2568 flags.go:64] FLAG: --help="false"
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529157    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-129-10.ec2.internal"
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529161    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529163    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529166    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529171    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529174    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529177    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 07:01:00.535518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529180    2568 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529182    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529185    2568 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529189    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529192    2568 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529195    2568 flags.go:64] FLAG: --kube-reserved=""
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529198    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529200    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529204    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529206    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529209    2568 flags.go:64] FLAG: --lock-file=""
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529212    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529215    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529218    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529223    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529227    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529230    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529233    2568 flags.go:64] FLAG: --logging-format="text"
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529236    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529239    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529242    2568 flags.go:64] FLAG: --manifest-url=""
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529245    2568 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529249    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529252    2568 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529256    2568 flags.go:64] FLAG: --max-pods="110"
Sep 15 07:01:00.536199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529259    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529262    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529265    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529268    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529272    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529275    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529278    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529284    2568 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529288    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529291    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529294    2568 flags.go:64] FLAG: --pod-cidr=""
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529297    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529303    2568 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529306    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529309    2568 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529312    2568 flags.go:64] FLAG: --port="10250"
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529315    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529318    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a3cdd74454e731f4"
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529321    2568 flags.go:64] FLAG: --qos-reserved=""
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529324    2568 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529327    2568 flags.go:64] FLAG: --register-node="true"
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529330    2568 flags.go:64] FLAG: --register-with-taints=""
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529334    2568 flags.go:64] FLAG: --registry-burst="10"
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529338    2568 flags.go:64] FLAG: --registry-qps="5"
Sep 15 07:01:00.536864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529341    2568 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529343    2568 flags.go:64] FLAG: --reserved-memory=""
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529352    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529355    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529358    2568 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529361    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529364    2568 flags.go:64] FLAG: --runonce="false"
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529367    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529371    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529374    2568 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529377    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529380    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529383    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529387    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529390    2568 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529393    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529396    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529399    2568 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529401    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529405    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529407    2568 flags.go:64] FLAG: --system-cgroups=""
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529410    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529415    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529418    2568 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529421    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 07:01:00.537458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529425    2568 flags.go:64] FLAG: --tls-min-version=""
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529428    2568 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529430    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529433    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529436    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529439    2568 flags.go:64] FLAG: --v="2"
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529443    2568 flags.go:64] FLAG: --version="false"
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529448    2568 flags.go:64] FLAG: --vmodule=""
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529451    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.529454    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529560    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529564    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529568    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529570    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529573    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529576    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529579    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529582    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529585    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529587    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529590    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529593    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 07:01:00.538114 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529596    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 07:01:00.538660 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529599    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 07:01:00.538660 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529602    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 07:01:00.538660 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529605    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 07:01:00.538660 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529607    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 07:01:00.538660 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529610    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 07:01:00.538660 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529613    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 07:01:00.538660 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529615    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 07:01:00.538660 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529618    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 07:01:00.538660 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529621    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 07:01:00.538660 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529624    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 07:01:00.538660 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529626    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 07:01:00.538660 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529630    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 07:01:00.538660 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529633    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 07:01:00.538660 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529637    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 07:01:00.538660 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529640    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 07:01:00.538660 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529644    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 07:01:00.538660 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529648    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 07:01:00.538660 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529652    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 07:01:00.538660 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529654    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 07:01:00.538660 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529657    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 07:01:00.539201 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529660    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 07:01:00.539201 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529663    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 07:01:00.539201 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529665    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 07:01:00.539201 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529668    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 07:01:00.539201 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529671    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 07:01:00.539201 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529674    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 07:01:00.539201 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529677    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 07:01:00.539201 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529679    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 07:01:00.539201 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529682    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 07:01:00.539201 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529685    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 07:01:00.539201 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529688    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 07:01:00.539201 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529690    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 07:01:00.539201 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529693    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 07:01:00.539201 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529695    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 07:01:00.539201 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529698    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 07:01:00.539201 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529701    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 07:01:00.539201 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529703    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 07:01:00.539201 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529706    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 07:01:00.539201 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529722    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 07:01:00.539201 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529725    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 07:01:00.539704 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529728    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 07:01:00.539704 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529730    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 07:01:00.539704 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529733    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 07:01:00.539704 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529736    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 07:01:00.539704 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529739    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 07:01:00.539704 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529741    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 07:01:00.539704 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529744    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 07:01:00.539704 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529747    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 07:01:00.539704 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529750    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 07:01:00.539704 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529752    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 07:01:00.539704 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529755    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 07:01:00.539704 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529759    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 07:01:00.539704 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529763    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 07:01:00.539704 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529766    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 07:01:00.539704 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529769    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 07:01:00.539704 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529771    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 07:01:00.539704 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529774    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 07:01:00.539704 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529777    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 07:01:00.539704 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529779    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 07:01:00.540183 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529782    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 07:01:00.540183 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529784    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 07:01:00.540183 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529787    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 07:01:00.540183 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529790    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 07:01:00.540183 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529792    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 07:01:00.540183 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529795    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 07:01:00.540183 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529798    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 07:01:00.540183 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529800    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 07:01:00.540183 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529803    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 07:01:00.540183 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529806    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 07:01:00.540183 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529808    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 07:01:00.540183 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529811    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 07:01:00.540183 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529814    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 07:01:00.540183 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529817    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 07:01:00.540183 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529819    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 07:01:00.540183 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529822    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 07:01:00.540183 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529824    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 07:01:00.540183 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529827    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 07:01:00.540183 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529829    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 07:01:00.540642 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529832    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 07:01:00.540642 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529835    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 07:01:00.540642 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529838    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 07:01:00.540642 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529840    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 07:01:00.540642 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529843    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 07:01:00.540642 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529848    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 07:01:00.540642 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529851    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 07:01:00.540642 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.529854    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 07:01:00.540642 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.530567    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 07:01:00.540642 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.537905    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 07:01:00.540642 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.537921    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 07:01:00.540642 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.538811    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 07:01:00.540642 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.538820    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 07:01:00.540642 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538876    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 07:01:00.540642 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538881    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 07:01:00.541035 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538884    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 07:01:00.541035 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538887    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 07:01:00.541035 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538891    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 07:01:00.541035 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538893    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 07:01:00.541035 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538896    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 07:01:00.541035 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538899    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 07:01:00.541035 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538903    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 07:01:00.541035 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538906    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 07:01:00.541035 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538908    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 07:01:00.541035 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538911    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 07:01:00.541035 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538914    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 07:01:00.541035 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538916    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 07:01:00.541035 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538919    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 07:01:00.541035 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538922    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 07:01:00.541035 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538925    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 07:01:00.541035 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538927    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 07:01:00.541035 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538930    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 07:01:00.541035 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538933    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 07:01:00.541035 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538935    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 07:01:00.541035 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538938    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 07:01:00.541527 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538940    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 07:01:00.541527 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538943    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 07:01:00.541527 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538945    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 07:01:00.541527 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538948    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 07:01:00.541527 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538950    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 07:01:00.541527 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538953    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 07:01:00.541527 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538956    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 07:01:00.541527 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538959    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 07:01:00.541527 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538962    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 07:01:00.541527 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538965    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 07:01:00.541527 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538967    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 07:01:00.541527 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538970    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 07:01:00.541527 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538973    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 07:01:00.541527 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538976    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 07:01:00.541527 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538978    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 07:01:00.541527 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538981    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 07:01:00.541527 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538983    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 07:01:00.541527 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538986    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 07:01:00.541527 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538989    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 07:01:00.541527 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538992    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 07:01:00.542040 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538994    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 07:01:00.542040 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.538997    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 07:01:00.542040 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539000    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 07:01:00.542040 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539002    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 07:01:00.542040 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539005    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 07:01:00.542040 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539007    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 07:01:00.542040 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539011    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 07:01:00.542040 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539015    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 07:01:00.542040 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539018    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 07:01:00.542040 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539021    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 07:01:00.542040 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539024    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 07:01:00.542040 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539027    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 07:01:00.542040 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539029    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 07:01:00.542040 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539032    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 07:01:00.542040 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539035    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 07:01:00.542040 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539037    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 07:01:00.542040 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539040    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 07:01:00.542040 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539042    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 07:01:00.542040 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539045    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 07:01:00.542515 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539048    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 07:01:00.542515 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539052    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 07:01:00.542515 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539055    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 07:01:00.542515 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539058    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 07:01:00.542515 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539060    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 07:01:00.542515 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539063    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 07:01:00.542515 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539066    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 07:01:00.542515 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539069    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 07:01:00.542515 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539072    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 07:01:00.542515 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539074    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 07:01:00.542515 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539077    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 07:01:00.542515 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539079    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 07:01:00.542515 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539082    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 07:01:00.542515 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539085    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 07:01:00.542515 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539087    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 07:01:00.542515 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539090    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 07:01:00.542515 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539094    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 07:01:00.542515 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539097    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 07:01:00.542515 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539100    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 07:01:00.542515 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539103    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 07:01:00.543072 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539105    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 07:01:00.543072 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539108    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 07:01:00.543072 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539111    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 07:01:00.543072 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539113    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 07:01:00.543072 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539116    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 07:01:00.543072 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539119    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 07:01:00.543072 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539121    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 07:01:00.543072 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539124    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 07:01:00.543072 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539126    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 07:01:00.543072 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539129    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 07:01:00.543072 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539132    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 07:01:00.543072 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539134    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 07:01:00.543072 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539137    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 07:01:00.543072 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539142    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 07:01:00.543072 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539146    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 07:01:00.543072 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539149    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 07:01:00.543072 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539152    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 07:01:00.543072 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539155    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 07:01:00.543529 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.539160    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 07:01:00.543529 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539266    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 07:01:00.543529 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539271    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 07:01:00.543529 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539274    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 07:01:00.543529 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539278    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 07:01:00.543529 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539281    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 07:01:00.543529 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539283    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 07:01:00.543529 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539286    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 07:01:00.543529 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539289    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 07:01:00.543529 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539292    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 07:01:00.543529 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539294    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 07:01:00.543529 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539297    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 07:01:00.543529 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539300    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 07:01:00.543529 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539302    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 07:01:00.543529 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539305    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 07:01:00.543922 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539307    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 07:01:00.543922 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539310    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 07:01:00.543922 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539312    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 07:01:00.543922 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539315    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 07:01:00.543922 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539318    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 07:01:00.543922 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539320    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 07:01:00.543922 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539323    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 07:01:00.543922 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539326    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 07:01:00.543922 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539328    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 07:01:00.543922 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539331    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 07:01:00.543922 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539333    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 07:01:00.543922 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539336    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 07:01:00.543922 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539339    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 07:01:00.543922 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539342    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 07:01:00.543922 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539345    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 07:01:00.543922 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539348    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 07:01:00.543922 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539351    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 07:01:00.543922 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539353    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 07:01:00.543922 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539356    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 07:01:00.543922 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539358    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 07:01:00.544392 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539361    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 07:01:00.544392 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539364    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 07:01:00.544392 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539366    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 07:01:00.544392 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539369    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 07:01:00.544392 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539373    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 07:01:00.544392 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539376    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 07:01:00.544392 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539379    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 07:01:00.544392 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539381    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 07:01:00.544392 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539384    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 07:01:00.544392 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539387    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 07:01:00.544392 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539389    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 07:01:00.544392 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539392    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 07:01:00.544392 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539395    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 07:01:00.544392 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539397    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 07:01:00.544392 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539400    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 07:01:00.544392 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539403    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 07:01:00.544392 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539405    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 07:01:00.544392 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539408    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 07:01:00.544392 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539410    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 07:01:00.544854 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539413    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 07:01:00.544854 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539416    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 07:01:00.544854 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539418    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 07:01:00.544854 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539421    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 07:01:00.544854 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539424    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 07:01:00.544854 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539427    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 07:01:00.544854 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539429    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 07:01:00.544854 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539432    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 07:01:00.544854 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539435    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 07:01:00.544854 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539438    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 07:01:00.544854 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539440    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 07:01:00.544854 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539450    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 07:01:00.544854 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539453    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 07:01:00.544854 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539456    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 07:01:00.544854 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539458    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 07:01:00.544854 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539461    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 07:01:00.544854 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539464    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 07:01:00.544854 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539468    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 07:01:00.544854 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539471    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 07:01:00.544854 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539473    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 07:01:00.545342 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539476    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 07:01:00.545342 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539478    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 07:01:00.545342 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539481    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 07:01:00.545342 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539483    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 07:01:00.545342 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539486    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 07:01:00.545342 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539489    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 07:01:00.545342 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539493    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 07:01:00.545342 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539495    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 07:01:00.545342 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539499    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 07:01:00.545342 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539501    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 07:01:00.545342 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539504    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 07:01:00.545342 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539507    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 07:01:00.545342 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539510    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 07:01:00.545342 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539513    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 07:01:00.545342 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539516    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 07:01:00.545342 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539519    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 07:01:00.545342 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539522    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 07:01:00.545342 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539525    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 07:01:00.545342 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539528    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 07:01:00.545342 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539531    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 07:01:00.545836 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539533    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 07:01:00.545836 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539537    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 07:01:00.545836 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539540    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 07:01:00.545836 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539543    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 07:01:00.545836 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539546    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 07:01:00.545836 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:00.539549    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 07:01:00.545836 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.539553    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 07:01:00.545836 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.539646    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 07:01:00.545836 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.542025    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 07:01:00.545836 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.543150    2568 server.go:1019] "Starting client certificate rotation"
Sep 15 07:01:00.545836 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.543247    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 07:01:00.545836 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.544054    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 07:01:00.546145 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.545985    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 07:01:00.547100 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.547084    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 07:01:00.554061 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.554043    2568 log.go:25] "Validated CRI v1 runtime API"
Sep 15 07:01:00.557443 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.557427    2568 log.go:25] "Validated CRI v1 image API"
Sep 15 07:01:00.558917 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.558860    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 07:01:00.562942 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.562919    2568 fs.go:135] Filesystem UUIDs: map[2bcf100b-292e-4efd-a4cb-ff5ed9a30b43:/dev/nvme0n1p4 3dc283cf-0a98-472f-927c-17b01b3118b1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 15 07:01:00.563016 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.562942    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 07:01:00.567920 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.567817    2568 manager.go:216] Machine: {Timestamp:2026-09-15 07:01:00.566486913 +0000 UTC m=+0.357404725 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092377 MemoryCapacity:33164468224 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2edc6f3b230d4a06cd7b0a380a7d55 SystemUUID:ec2edc6f-3b23-0d4a-06cd-7b0a380a7d55 BootID:051b0762-87bc-4b6b-97ce-6b137c069982 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582234112 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:cf:e3:28:99 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:cf:e3:28:99 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:d7:fa:4c:50:e2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164468224 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 07:01:00.567920 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.567914    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 07:01:00.568027 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.567984    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 07:01:00.571544 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.571518    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 07:01:00.571672 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.571549    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-10.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 07:01:00.572415 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.572406    2568 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 07:01:00.572448 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.572416    2568 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 07:01:00.572448 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.572424    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 07:01:00.573374 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.573363    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 07:01:00.574667 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.574657    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 07:01:00.576000 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.575985    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 07:01:00.579439 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.579428    2568 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 07:01:00.579565 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.579555    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 07:01:00.579602 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.579582    2568 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 07:01:00.579602 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.579593    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 07:01:00.579726 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.579603    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 07:01:00.579726 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.579612    2568 kubelet.go:398] "Adding apiserver pod source"
Sep 15 07:01:00.579726 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.579620    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 07:01:00.579991 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.579979    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 07:01:00.580032 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.579999    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 07:01:00.582276 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.582252    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 07:01:00.584507 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.584493    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 07:01:00.584579 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.584523    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 07:01:00.586414 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.586397    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 07:01:00.586414 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.586415    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 07:01:00.586521 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.586421    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 07:01:00.586521 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.586426    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 07:01:00.586521 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.586435    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 07:01:00.586521 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.586440    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 07:01:00.586521 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.586454    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 07:01:00.586521 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.586464    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 07:01:00.586521 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.586470    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 07:01:00.586521 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.586475    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 07:01:00.586521 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.586488    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 07:01:00.586521 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.586493    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 07:01:00.587378 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.587368    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 07:01:00.587378 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.587377    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 07:01:00.589851 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:00.589612    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 07:01:00.589961 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.589937    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-10.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 07:01:00.590108 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:00.590057    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-10.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 07:01:00.591624 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.591603    2568 server.go:1268] "Started kubelet"
Sep 15 07:01:00.591742 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.591690    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 07:01:00.591811 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.591689    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 07:01:00.591811 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.591786    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 07:01:00.592424 ip-10-0-129-10 systemd[1]: Started Kubernetes Kubelet.
Sep 15 07:01:00.593199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.593175    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 07:01:00.593531 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.593514    2568 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 07:01:00.598123 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:00.598107    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 07:01:00.600143 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.600125    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 07:01:00.600939 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.600923    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 07:01:00.601028 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:00.600994    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-10.ec2.internal\" not found"
Sep 15 07:01:00.601651 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.601634    2568 factory.go:55] Registering systemd factory
Sep 15 07:01:00.601727 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.601667    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 07:01:00.601727 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.601675    2568 factory.go:223] Registration of the systemd container factory successfully
Sep 15 07:01:00.601727 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.601680    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 07:01:00.601727 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.601667    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 07:01:00.601896 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.601772    2568 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 07:01:00.601896 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.601782    2568 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 07:01:00.601896 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.601894    2568 factory.go:153] Registering CRI-O factory
Sep 15 07:01:00.602041 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.601904    2568 factory.go:223] Registration of the crio container factory successfully
Sep 15 07:01:00.602041 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.601944    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 07:01:00.602041 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.601958    2568 factory.go:103] Registering Raw factory
Sep 15 07:01:00.602041 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.601968    2568 manager.go:1196] Started watching for new ooms in manager
Sep 15 07:01:00.602353 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.602341    2568 manager.go:349] Starting recovery of all containers
Sep 15 07:01:00.607907 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:00.607868    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 15 07:01:00.608101 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:00.608067    2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-10.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 15 07:01:00.609176 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.609119    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 07:01:00.609289 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:00.607993    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-10.ec2.internal.18d56c713edf4bf7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-10.ec2.internal,UID:ip-10-0-129-10.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-10.ec2.internal,},FirstTimestamp:2026-09-15 07:01:00.591565815 +0000 UTC m=+0.382483627,LastTimestamp:2026-09-15 07:01:00.591565815 +0000 UTC m=+0.382483627,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-10.ec2.internal,}"
Sep 15 07:01:00.613877 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.613731    2568 manager.go:354] Recovery completed
Sep 15 07:01:00.620515 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.620499    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 07:01:00.623994 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.623976    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 07:01:00.624061 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.624008    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 07:01:00.624061 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.624020    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientPID"
Sep 15 07:01:00.624530 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.624517    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 07:01:00.624530 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.624529    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 07:01:00.624673 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.624530    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 07:01:00.624673 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.624543    2568 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 07:01:00.625276 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.625258    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 07:01:00.625342 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.625288    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 07:01:00.625342 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.625302    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientPID"
Sep 15 07:01:00.625785 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:00.625697    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-10.ec2.internal.18d56c7140ce1762  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-10.ec2.internal,UID:ip-10-0-129-10.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-10.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-10.ec2.internal,},FirstTimestamp:2026-09-15 07:01:00.623992674 +0000 UTC m=+0.414910486,LastTimestamp:2026-09-15 07:01:00.623992674 +0000 UTC m=+0.414910486,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-10.ec2.internal,}"
Sep 15 07:01:00.626447 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.626433    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tqfj4"
Sep 15 07:01:00.626876 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.626865    2568 policy_none.go:49] "None policy: Start"
Sep 15 07:01:00.626927 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.626880    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 07:01:00.626927 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.626890    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 07:01:00.628852 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.628843    2568 policy_none.go:47] "Start"
Sep 15 07:01:00.632763 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.632730    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tqfj4"
Sep 15 07:01:00.635465 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:00.635401    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-10.ec2.internal.18d56c7140ce6970  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-10.ec2.internal,UID:ip-10-0-129-10.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-10.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-10.ec2.internal,},FirstTimestamp:2026-09-15 07:01:00.62401368 +0000 UTC m=+0.414931492,LastTimestamp:2026-09-15 07:01:00.62401368 +0000 UTC m=+0.414931492,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-10.ec2.internal,}"
Sep 15 07:01:00.659430 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.659416    2568 manager.go:337] "Starting Device Plugin manager"
Sep 15 07:01:00.684260 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:00.659474    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 07:01:00.684260 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.659487    2568 server.go:87] "Starting device plugin registration server"
Sep 15 07:01:00.684260 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.659837    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 07:01:00.684260 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.659852    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 07:01:00.684260 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.659941    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 07:01:00.684260 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.660014    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 07:01:00.684260 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.660022    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 07:01:00.684260 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:00.660620    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 07:01:00.684260 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:00.660661    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-10.ec2.internal\" not found"
Sep 15 07:01:00.735873 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.735843    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 07:01:00.735991 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.735905    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 07:01:00.735991 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.735932    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 07:01:00.735991 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:00.735980    2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 15 07:01:00.737876 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.737859    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 07:01:00.760525 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.760496    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 07:01:00.761366 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.761345    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 07:01:00.761444 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.761379    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 07:01:00.761444 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.761391    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientPID"
Sep 15 07:01:00.761444 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.761413    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-10.ec2.internal"
Sep 15 07:01:00.768631 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.768619    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-10.ec2.internal"
Sep 15 07:01:00.768689 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:00.768638    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-10.ec2.internal\": node \"ip-10-0-129-10.ec2.internal\" not found"
Sep 15 07:01:00.793328 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:00.793268    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-10.ec2.internal\" not found"
Sep 15 07:01:00.836398 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.836377    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal"]
Sep 15 07:01:00.836483 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.836436    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 07:01:00.837249 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.837234    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 07:01:00.837304 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.837264    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 07:01:00.837304 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.837273    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientPID"
Sep 15 07:01:00.839634 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.839622    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 07:01:00.839793 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.839780    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal"
Sep 15 07:01:00.839873 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.839824    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 07:01:00.840285 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.840268    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 07:01:00.840285 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.840269    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 07:01:00.840398 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.840295    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 07:01:00.840398 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.840305    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 07:01:00.840398 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.840321    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientPID"
Sep 15 07:01:00.840398 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.840307    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientPID"
Sep 15 07:01:00.842685 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.842669    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal"
Sep 15 07:01:00.842776 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.842696    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 07:01:00.843360 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.843345    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 07:01:00.843432 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.843373    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 07:01:00.843432 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:00.843387    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientPID"
Sep 15 07:01:00.879298 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:00.879282    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-10.ec2.internal\" not found" node="ip-10-0-129-10.ec2.internal"
Sep 15 07:01:00.883676 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:00.883661    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-10.ec2.internal\" not found" node="ip-10-0-129-10.ec2.internal"
Sep 15 07:01:00.893316 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:00.893303    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-10.ec2.internal\" not found"
Sep 15 07:01:00.994004 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:00.993971    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-10.ec2.internal\" not found"
Sep 15 07:01:01.003281 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.003261    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4bdf2c16da359bb8e08f885d8cfc1446-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal\" (UID: \"4bdf2c16da359bb8e08f885d8cfc1446\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal"
Sep 15 07:01:01.003335 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.003288    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bdf2c16da359bb8e08f885d8cfc1446-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal\" (UID: \"4bdf2c16da359bb8e08f885d8cfc1446\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal"
Sep 15 07:01:01.003335 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.003308    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1f1ba8a42accaebaa2593b3b48d06684-config\") pod \"kube-apiserver-proxy-ip-10-0-129-10.ec2.internal\" (UID: \"1f1ba8a42accaebaa2593b3b48d06684\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal"
Sep 15 07:01:01.094688 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:01.094612    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-10.ec2.internal\" not found"
Sep 15 07:01:01.103919 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.103898    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4bdf2c16da359bb8e08f885d8cfc1446-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal\" (UID: \"4bdf2c16da359bb8e08f885d8cfc1446\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal"
Sep 15 07:01:01.103996 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.103922    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bdf2c16da359bb8e08f885d8cfc1446-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal\" (UID: \"4bdf2c16da359bb8e08f885d8cfc1446\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal"
Sep 15 07:01:01.103996 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.103938    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1f1ba8a42accaebaa2593b3b48d06684-config\") pod \"kube-apiserver-proxy-ip-10-0-129-10.ec2.internal\" (UID: \"1f1ba8a42accaebaa2593b3b48d06684\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal"
Sep 15 07:01:01.103996 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.103963    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1f1ba8a42accaebaa2593b3b48d06684-config\") pod \"kube-apiserver-proxy-ip-10-0-129-10.ec2.internal\" (UID: \"1f1ba8a42accaebaa2593b3b48d06684\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal"
Sep 15 07:01:01.103996 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.103978    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bdf2c16da359bb8e08f885d8cfc1446-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal\" (UID: \"4bdf2c16da359bb8e08f885d8cfc1446\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal"
Sep 15 07:01:01.104139 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.104001    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4bdf2c16da359bb8e08f885d8cfc1446-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal\" (UID: \"4bdf2c16da359bb8e08f885d8cfc1446\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal"
Sep 15 07:01:01.181029 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.180999    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal"
Sep 15 07:01:01.186317 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.186238    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal"
Sep 15 07:01:01.194902 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:01.194884    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-10.ec2.internal\" not found"
Sep 15 07:01:01.299475 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:01.299436    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-10.ec2.internal\" not found"
Sep 15 07:01:01.401717 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:01.401647    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-10.ec2.internal\" not found"
Sep 15 07:01:01.502163 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:01.502141    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-10.ec2.internal\" not found"
Sep 15 07:01:01.503619 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.503600    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 07:01:01.542555 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.542535    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 07:01:01.542964 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.542648    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 07:01:01.542964 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.542695    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 07:01:01.602973 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:01.602952    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-10.ec2.internal\" not found"
Sep 15 07:01:01.639312 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.639267    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 06:56:01 +0000 UTC" deadline="2028-05-24 21:10:01.056062844 +0000 UTC"
Sep 15 07:01:01.639419 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.639311    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14822h8m59.416755762s"
Sep 15 07:01:01.677403 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.677351    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 07:01:01.678513 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.678497    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 07:01:01.678594 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.678526    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 07:01:01.678594 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.678537    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientPID"
Sep 15 07:01:01.699982 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.699960    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 07:01:01.701599 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.701578    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal"
Sep 15 07:01:01.711127 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.711108    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 07:01:01.711925 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.711909    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal"
Sep 15 07:01:01.723013 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.722997    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 07:01:01.761099 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:01.761073    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1ba8a42accaebaa2593b3b48d06684.slice/crio-c5d8e6595eade0c4a755e51c020dcbda22b767a9f672f129e86d5d97fcd84b3d WatchSource:0}: Error finding container c5d8e6595eade0c4a755e51c020dcbda22b767a9f672f129e86d5d97fcd84b3d: Status 404 returned error can't find the container with id c5d8e6595eade0c4a755e51c020dcbda22b767a9f672f129e86d5d97fcd84b3d
Sep 15 07:01:01.763196 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:01.763169    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bdf2c16da359bb8e08f885d8cfc1446.slice/crio-af84bf21f657f41d87d44c99e71ab2ceb21c74f8f01c78d5ff9d4603edac4352 WatchSource:0}: Error finding container af84bf21f657f41d87d44c99e71ab2ceb21c74f8f01c78d5ff9d4603edac4352: Status 404 returned error can't find the container with id af84bf21f657f41d87d44c99e71ab2ceb21c74f8f01c78d5ff9d4603edac4352
Sep 15 07:01:01.766858 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.766837    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 07:01:01.988647 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:01.988576    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 07:01:02.581126 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.581082    2568 apiserver.go:52] "Watching apiserver"
Sep 15 07:01:02.590509 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.590480    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 07:01:02.592285 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.592248    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-n92hd","kube-system/global-pull-secret-syncer-dzpwd","kube-system/konnectivity-agent-h5zdl","kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr","openshift-cluster-node-tuning-operator/tuned-cjf92","openshift-dns/node-resolver-7p7gl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal","openshift-multus/multus-wqdxh","openshift-image-registry/node-ca-8k4fj","openshift-multus/multus-additional-cni-plugins-tkzx6","openshift-multus/network-metrics-daemon-9r6zz","openshift-network-diagnostics/network-check-target-tcldw","openshift-network-operator/iptables-alerter-l5chg"]
Sep 15 07:01:02.594902 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.594878    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8k4fj"
Sep 15 07:01:02.597120 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.597092    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9fscd\""
Sep 15 07:01:02.597223 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.597139    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 07:01:02.597358 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.597335    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:02.597437 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:02.597413    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcldw" podUID="69bff7ef-8a76-40f8-9e5f-1ad219bf15b8"
Sep 15 07:01:02.597491 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.597476    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 07:01:02.597553 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.597520    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 07:01:02.599628 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.599613    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h5zdl"
Sep 15 07:01:02.600879 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.600857    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 07:01:02.602234 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.601911    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 07:01:02.602234 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.601952    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7zq7c\""
Sep 15 07:01:02.602234 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.602045    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 07:01:02.602234 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.602149    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l5chg"
Sep 15 07:01:02.604488 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.604466    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 07:01:02.604488 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.604484    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4xb5q\""
Sep 15 07:01:02.604638 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.604486    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.605100 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.604795    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 07:01:02.605100 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.605042    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 07:01:02.606916 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.606736    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 07:01:02.607015 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.606947    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.607293 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.607114    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 07:01:02.607293 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.607175    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-862zg\""
Sep 15 07:01:02.607293 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.607191    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 07:01:02.608873 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.608852    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 07:01:02.609114 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.609096    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 07:01:02.609254 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.609150    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2bhq9\""
Sep 15 07:01:02.609439 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.609424    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.610315 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.610295    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 07:01:02.610653 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.610624    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67a0be6f-84c1-4b98-b6d1-0dad5516fe99-host\") pod \"node-ca-8k4fj\" (UID: \"67a0be6f-84c1-4b98-b6d1-0dad5516fe99\") " pod="openshift-image-registry/node-ca-8k4fj"
Sep 15 07:01:02.610779 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.610669    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fbc008a1-b0d8-45d4-aa3a-adf819a127af-konnectivity-ca\") pod \"konnectivity-agent-h5zdl\" (UID: \"fbc008a1-b0d8-45d4-aa3a-adf819a127af\") " pod="kube-system/konnectivity-agent-h5zdl"
Sep 15 07:01:02.610779 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.610703    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4aee77e0-4ad8-4134-8a4e-3c07793a6574-iptables-alerter-script\") pod \"iptables-alerter-l5chg\" (UID: \"4aee77e0-4ad8-4134-8a4e-3c07793a6574\") " pod="openshift-network-operator/iptables-alerter-l5chg"
Sep 15 07:01:02.610779 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.610726    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnldv\" (UniqueName: \"kubernetes.io/projected/4aee77e0-4ad8-4134-8a4e-3c07793a6574-kube-api-access-qnldv\") pod \"iptables-alerter-l5chg\" (UID: \"4aee77e0-4ad8-4134-8a4e-3c07793a6574\") " pod="openshift-network-operator/iptables-alerter-l5chg"
Sep 15 07:01:02.610779 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.610750    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/67a0be6f-84c1-4b98-b6d1-0dad5516fe99-serviceca\") pod \"node-ca-8k4fj\" (UID: \"67a0be6f-84c1-4b98-b6d1-0dad5516fe99\") " pod="openshift-image-registry/node-ca-8k4fj"
Sep 15 07:01:02.611111 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.610780    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrwmv\" (UniqueName: \"kubernetes.io/projected/67a0be6f-84c1-4b98-b6d1-0dad5516fe99-kube-api-access-vrwmv\") pod \"node-ca-8k4fj\" (UID: \"67a0be6f-84c1-4b98-b6d1-0dad5516fe99\") " pod="openshift-image-registry/node-ca-8k4fj"
Sep 15 07:01:02.611111 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.610821    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb2dw\" (UniqueName: \"kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw\") pod \"network-check-target-tcldw\" (UID: \"69bff7ef-8a76-40f8-9e5f-1ad219bf15b8\") " pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:02.611111 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.610836    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fbc008a1-b0d8-45d4-aa3a-adf819a127af-agent-certs\") pod \"konnectivity-agent-h5zdl\" (UID: \"fbc008a1-b0d8-45d4-aa3a-adf819a127af\") " pod="kube-system/konnectivity-agent-h5zdl"
Sep 15 07:01:02.611111 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.610857    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aee77e0-4ad8-4134-8a4e-3c07793a6574-host-slash\") pod \"iptables-alerter-l5chg\" (UID: \"4aee77e0-4ad8-4134-8a4e-3c07793a6574\") " pod="openshift-network-operator/iptables-alerter-l5chg"
Sep 15 07:01:02.612005 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.611984    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s824n\""
Sep 15 07:01:02.612259 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.612244    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7p7gl"
Sep 15 07:01:02.612358 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.612322    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 07:01:02.612422 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.612383    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 07:01:02.612422 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.612327    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 07:01:02.612937 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.612907    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 07:01:02.614662 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.614642    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:02.614758 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:02.614712    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dzpwd" podUID="7eaabe27-7956-4d37-abaa-d28ac2e47447"
Sep 15 07:01:02.615129 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.615109    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hwwks\""
Sep 15 07:01:02.615215 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.615169    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 07:01:02.615215 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.615201    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 07:01:02.618124 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.618105    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.620154 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.620136    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 07:01:02.620371 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.620357    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 07:01:02.620788 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.620763    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.620954 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.620936    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 07:01:02.621028 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.620979    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9cxkb\""
Sep 15 07:01:02.621309 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.621291    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 07:01:02.621972 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.621955    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 07:01:02.622064 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.621957    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 07:01:02.622802 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.622785    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 07:01:02.623228 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.623208    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 07:01:02.623322 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.623299    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bf5ct\""
Sep 15 07:01:02.623648 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.623632    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:02.623732 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:02.623705    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9r6zz" podUID="8e7d8199-6790-4b03-bd95-5eeb637d2f99"
Sep 15 07:01:02.637905 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.637884    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dxwrx"
Sep 15 07:01:02.643641 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.643615    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dxwrx"
Sep 15 07:01:02.702845 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.702817    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 07:01:02.711482 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.711460    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/67a0be6f-84c1-4b98-b6d1-0dad5516fe99-serviceca\") pod \"node-ca-8k4fj\" (UID: \"67a0be6f-84c1-4b98-b6d1-0dad5516fe99\") " pod="openshift-image-registry/node-ca-8k4fj"
Sep 15 07:01:02.711589 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.711490    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrwmv\" (UniqueName: \"kubernetes.io/projected/67a0be6f-84c1-4b98-b6d1-0dad5516fe99-kube-api-access-vrwmv\") pod \"node-ca-8k4fj\" (UID: \"67a0be6f-84c1-4b98-b6d1-0dad5516fe99\") " pod="openshift-image-registry/node-ca-8k4fj"
Sep 15 07:01:02.711589 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.711510    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-multus-socket-dir-parent\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.711589 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.711526    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-etc-modprobe-d\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.711752 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.711664    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-etc-openvswitch\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.711752 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.711704    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-run-ovn\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.711860 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.711758    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a977870-0600-4a83-a169-6ed663e485ae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tkzx6\" (UID: \"6a977870-0600-4a83-a169-6ed663e485ae\") " pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.711860 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.711789    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67a0be6f-84c1-4b98-b6d1-0dad5516fe99-host\") pod \"node-ca-8k4fj\" (UID: \"67a0be6f-84c1-4b98-b6d1-0dad5516fe99\") " pod="openshift-image-registry/node-ca-8k4fj"
Sep 15 07:01:02.711860 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.711807    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-btwkr\" (UID: \"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.711860 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.711824    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-sys\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.711860 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.711840    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-etc-tuned\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.711860 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.711843    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67a0be6f-84c1-4b98-b6d1-0dad5516fe99-host\") pod \"node-ca-8k4fj\" (UID: \"67a0be6f-84c1-4b98-b6d1-0dad5516fe99\") " pod="openshift-image-registry/node-ca-8k4fj"
Sep 15 07:01:02.711860 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.711856    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-log-socket\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.712096 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.711892    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6a977870-0600-4a83-a169-6ed663e485ae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tkzx6\" (UID: \"6a977870-0600-4a83-a169-6ed663e485ae\") " pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.712096 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.711934    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnldv\" (UniqueName: \"kubernetes.io/projected/4aee77e0-4ad8-4134-8a4e-3c07793a6574-kube-api-access-qnldv\") pod \"iptables-alerter-l5chg\" (UID: \"4aee77e0-4ad8-4134-8a4e-3c07793a6574\") " pod="openshift-network-operator/iptables-alerter-l5chg"
Sep 15 07:01:02.712096 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.711944    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/67a0be6f-84c1-4b98-b6d1-0dad5516fe99-serviceca\") pod \"node-ca-8k4fj\" (UID: \"67a0be6f-84c1-4b98-b6d1-0dad5516fe99\") " pod="openshift-image-registry/node-ca-8k4fj"
Sep 15 07:01:02.712096 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.711968    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-host-var-lib-cni-bin\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.712096 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712048    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6v98\" (UniqueName: \"kubernetes.io/projected/e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50-kube-api-access-t6v98\") pod \"aws-ebs-csi-driver-node-btwkr\" (UID: \"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.712096 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712080    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-964ss\" (UniqueName: \"kubernetes.io/projected/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-kube-api-access-964ss\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.712410 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712105    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-host-cni-netd\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.712410 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712134    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fbc008a1-b0d8-45d4-aa3a-adf819a127af-agent-certs\") pod \"konnectivity-agent-h5zdl\" (UID: \"fbc008a1-b0d8-45d4-aa3a-adf819a127af\") " pod="kube-system/konnectivity-agent-h5zdl"
Sep 15 07:01:02.712410 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712159    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-multus-cni-dir\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.712410 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712178    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/33d4f8d4-2be4-453c-8f99-a19ce58c1e36-hosts-file\") pod \"node-resolver-7p7gl\" (UID: \"33d4f8d4-2be4-453c-8f99-a19ce58c1e36\") " pod="openshift-dns/node-resolver-7p7gl"
Sep 15 07:01:02.712410 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712193    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50-etc-selinux\") pod \"aws-ebs-csi-driver-node-btwkr\" (UID: \"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.712410 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712229    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-etc-kubernetes\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.712410 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712257    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-run-openvswitch\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.712410 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712277    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-host-run-k8s-cni-cncf-io\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.712410 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712296    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50-registration-dir\") pod \"aws-ebs-csi-driver-node-btwkr\" (UID: \"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.712410 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712311    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-host-var-lib-cni-multus\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.712410 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712326    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-hostroot\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.712410 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712350    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-etc-systemd\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.712410 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712373    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-host\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.712410 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712391    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-host-kubelet\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.712410 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712408    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.713074 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712427    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a977870-0600-4a83-a169-6ed663e485ae-cnibin\") pod \"multus-additional-cni-plugins-tkzx6\" (UID: \"6a977870-0600-4a83-a169-6ed663e485ae\") " pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.713074 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712451    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb2dw\" (UniqueName: \"kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw\") pod \"network-check-target-tcldw\" (UID: \"69bff7ef-8a76-40f8-9e5f-1ad219bf15b8\") " pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:02.713074 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712468    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-etc-kubernetes\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.713074 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712486    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mllm\" (UniqueName: \"kubernetes.io/projected/33d4f8d4-2be4-453c-8f99-a19ce58c1e36-kube-api-access-5mllm\") pod \"node-resolver-7p7gl\" (UID: \"33d4f8d4-2be4-453c-8f99-a19ce58c1e36\") " pod="openshift-dns/node-resolver-7p7gl"
Sep 15 07:01:02.713074 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712502    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7eaabe27-7956-4d37-abaa-d28ac2e47447-dbus\") pod \"global-pull-secret-syncer-dzpwd\" (UID: \"7eaabe27-7956-4d37-abaa-d28ac2e47447\") " pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:02.713074 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712517    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50-sys-fs\") pod \"aws-ebs-csi-driver-node-btwkr\" (UID: \"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.713074 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712553    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-etc-sysctl-d\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.713074 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712579    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-run\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.713074 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712602    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-ovnkube-config\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.713074 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712626    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-multus-daemon-config\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.713074 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712649    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-host-var-lib-kubelet\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.713074 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712673    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7eaabe27-7956-4d37-abaa-d28ac2e47447-kubelet-config\") pod \"global-pull-secret-syncer-dzpwd\" (UID: \"7eaabe27-7956-4d37-abaa-d28ac2e47447\") " pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:02.713074 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712687    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-etc-sysctl-conf\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.713074 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712728    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-lib-modules\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.713074 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712758    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a977870-0600-4a83-a169-6ed663e485ae-system-cni-dir\") pod \"multus-additional-cni-plugins-tkzx6\" (UID: \"6a977870-0600-4a83-a169-6ed663e485ae\") " pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.713074 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712777    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs\") pod \"network-metrics-daemon-9r6zz\" (UID: \"8e7d8199-6790-4b03-bd95-5eeb637d2f99\") " pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:02.713702 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712794    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bvqb\" (UniqueName: \"kubernetes.io/projected/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-kube-api-access-6bvqb\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.713702 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712811    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-var-lib-openvswitch\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.713702 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712833    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-host-run-ovn-kubernetes\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.713702 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712850    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-ovn-node-metrics-cert\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.713702 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712865    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7v8c\" (UniqueName: \"kubernetes.io/projected/6a977870-0600-4a83-a169-6ed663e485ae-kube-api-access-p7v8c\") pod \"multus-additional-cni-plugins-tkzx6\" (UID: \"6a977870-0600-4a83-a169-6ed663e485ae\") " pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.713702 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712894    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-system-cni-dir\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.713702 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712920    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fbc008a1-b0d8-45d4-aa3a-adf819a127af-konnectivity-ca\") pod \"konnectivity-agent-h5zdl\" (UID: \"fbc008a1-b0d8-45d4-aa3a-adf819a127af\") " pod="kube-system/konnectivity-agent-h5zdl"
Sep 15 07:01:02.713702 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712955    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-multus-conf-dir\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.713702 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712974    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret\") pod \"global-pull-secret-syncer-dzpwd\" (UID: \"7eaabe27-7956-4d37-abaa-d28ac2e47447\") " pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:02.713702 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713002    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-var-lib-kubelet\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.713702 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.712984    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 07:01:02.713702 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713020    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-env-overrides\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.713702 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713037    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aee77e0-4ad8-4134-8a4e-3c07793a6574-host-slash\") pod \"iptables-alerter-l5chg\" (UID: \"4aee77e0-4ad8-4134-8a4e-3c07793a6574\") " pod="openshift-network-operator/iptables-alerter-l5chg"
Sep 15 07:01:02.713702 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713064    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-systemd-units\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.713702 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713079    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsznm\" (UniqueName: \"kubernetes.io/projected/8e7d8199-6790-4b03-bd95-5eeb637d2f99-kube-api-access-qsznm\") pod \"network-metrics-daemon-9r6zz\" (UID: \"8e7d8199-6790-4b03-bd95-5eeb637d2f99\") " pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:02.713702 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713094    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-host-run-multus-certs\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.713702 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713130    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-tmp\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.714243 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713131    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aee77e0-4ad8-4134-8a4e-3c07793a6574-host-slash\") pod \"iptables-alerter-l5chg\" (UID: \"4aee77e0-4ad8-4134-8a4e-3c07793a6574\") " pod="openshift-network-operator/iptables-alerter-l5chg"
Sep 15 07:01:02.714243 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713159    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-host-cni-bin\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.714243 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713179    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6a977870-0600-4a83-a169-6ed663e485ae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tkzx6\" (UID: \"6a977870-0600-4a83-a169-6ed663e485ae\") " pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.714243 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713194    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-cni-binary-copy\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.714243 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713208    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33d4f8d4-2be4-453c-8f99-a19ce58c1e36-tmp-dir\") pod \"node-resolver-7p7gl\" (UID: \"33d4f8d4-2be4-453c-8f99-a19ce58c1e36\") " pod="openshift-dns/node-resolver-7p7gl"
Sep 15 07:01:02.714243 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713222    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50-device-dir\") pod \"aws-ebs-csi-driver-node-btwkr\" (UID: \"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.714243 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713237    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-run-systemd\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.714243 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713252    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a977870-0600-4a83-a169-6ed663e485ae-cni-binary-copy\") pod \"multus-additional-cni-plugins-tkzx6\" (UID: \"6a977870-0600-4a83-a169-6ed663e485ae\") " pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.714243 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713275    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4aee77e0-4ad8-4134-8a4e-3c07793a6574-iptables-alerter-script\") pod \"iptables-alerter-l5chg\" (UID: \"4aee77e0-4ad8-4134-8a4e-3c07793a6574\") " pod="openshift-network-operator/iptables-alerter-l5chg"
Sep 15 07:01:02.714243 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713302    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-cnibin\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.714243 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713320    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-host-run-netns\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.714243 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713336    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50-socket-dir\") pod \"aws-ebs-csi-driver-node-btwkr\" (UID: \"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.714243 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713351    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-ovnkube-script-lib\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.714243 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713375    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw8rs\" (UniqueName: \"kubernetes.io/projected/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-kube-api-access-gw8rs\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.714243 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713393    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-etc-sysconfig\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.714243 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713443    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-host-slash\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.714714 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713463    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-host-run-netns\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.714714 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713496    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-node-log\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.714714 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.713729    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4aee77e0-4ad8-4134-8a4e-3c07793a6574-iptables-alerter-script\") pod \"iptables-alerter-l5chg\" (UID: \"4aee77e0-4ad8-4134-8a4e-3c07793a6574\") " pod="openshift-network-operator/iptables-alerter-l5chg"
Sep 15 07:01:02.714714 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.714015    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fbc008a1-b0d8-45d4-aa3a-adf819a127af-konnectivity-ca\") pod \"konnectivity-agent-h5zdl\" (UID: \"fbc008a1-b0d8-45d4-aa3a-adf819a127af\") " pod="kube-system/konnectivity-agent-h5zdl"
Sep 15 07:01:02.717342 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.717322    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fbc008a1-b0d8-45d4-aa3a-adf819a127af-agent-certs\") pod \"konnectivity-agent-h5zdl\" (UID: \"fbc008a1-b0d8-45d4-aa3a-adf819a127af\") " pod="kube-system/konnectivity-agent-h5zdl"
Sep 15 07:01:02.718220 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:02.718200    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 07:01:02.718220 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:02.718222    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 07:01:02.718363 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:02.718232    2568 projected.go:196] Error preparing data for projected volume kube-api-access-qb2dw for pod openshift-network-diagnostics/network-check-target-tcldw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:01:02.718363 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:02.718294    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw podName:69bff7ef-8a76-40f8-9e5f-1ad219bf15b8 nodeName:}" failed. No retries permitted until 2026-09-15 07:01:03.218273207 +0000 UTC m=+3.009191022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qb2dw" (UniqueName: "kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw") pod "network-check-target-tcldw" (UID: "69bff7ef-8a76-40f8-9e5f-1ad219bf15b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:01:02.720546 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.720528    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrwmv\" (UniqueName: \"kubernetes.io/projected/67a0be6f-84c1-4b98-b6d1-0dad5516fe99-kube-api-access-vrwmv\") pod \"node-ca-8k4fj\" (UID: \"67a0be6f-84c1-4b98-b6d1-0dad5516fe99\") " pod="openshift-image-registry/node-ca-8k4fj"
Sep 15 07:01:02.720649 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.720623    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnldv\" (UniqueName: \"kubernetes.io/projected/4aee77e0-4ad8-4134-8a4e-3c07793a6574-kube-api-access-qnldv\") pod \"iptables-alerter-l5chg\" (UID: \"4aee77e0-4ad8-4134-8a4e-3c07793a6574\") " pod="openshift-network-operator/iptables-alerter-l5chg"
Sep 15 07:01:02.739866 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.739827    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal" event={"ID":"4bdf2c16da359bb8e08f885d8cfc1446","Type":"ContainerStarted","Data":"af84bf21f657f41d87d44c99e71ab2ceb21c74f8f01c78d5ff9d4603edac4352"}
Sep 15 07:01:02.740869 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.740849    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal" event={"ID":"1f1ba8a42accaebaa2593b3b48d06684","Type":"ContainerStarted","Data":"c5d8e6595eade0c4a755e51c020dcbda22b767a9f672f129e86d5d97fcd84b3d"}
Sep 15 07:01:02.814643 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.814593    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-host-run-multus-certs\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.814827 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.814651    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-tmp\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.814827 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.814680    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-host-cni-bin\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.814827 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.814697    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-host-run-multus-certs\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.814827 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.814709    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6a977870-0600-4a83-a169-6ed663e485ae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tkzx6\" (UID: \"6a977870-0600-4a83-a169-6ed663e485ae\") " pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.814827 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.814760    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-cni-binary-copy\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.814827 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.814767    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-host-cni-bin\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.814827 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.814784    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33d4f8d4-2be4-453c-8f99-a19ce58c1e36-tmp-dir\") pod \"node-resolver-7p7gl\" (UID: \"33d4f8d4-2be4-453c-8f99-a19ce58c1e36\") " pod="openshift-dns/node-resolver-7p7gl"
Sep 15 07:01:02.815102 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815021    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50-device-dir\") pod \"aws-ebs-csi-driver-node-btwkr\" (UID: \"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.815102 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815063    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-run-systemd\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.815102 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815092    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a977870-0600-4a83-a169-6ed663e485ae-cni-binary-copy\") pod \"multus-additional-cni-plugins-tkzx6\" (UID: \"6a977870-0600-4a83-a169-6ed663e485ae\") " pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.815259 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815120    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-cnibin\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.815259 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815145    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33d4f8d4-2be4-453c-8f99-a19ce58c1e36-tmp-dir\") pod \"node-resolver-7p7gl\" (UID: \"33d4f8d4-2be4-453c-8f99-a19ce58c1e36\") " pod="openshift-dns/node-resolver-7p7gl"
Sep 15 07:01:02.815259 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815161    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-host-run-netns\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.815259 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815189    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50-socket-dir\") pod \"aws-ebs-csi-driver-node-btwkr\" (UID: \"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.815259 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815214    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-ovnkube-script-lib\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.815259 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815240    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw8rs\" (UniqueName: \"kubernetes.io/projected/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-kube-api-access-gw8rs\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.815563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815265    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-etc-sysconfig\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.815563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815289    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-host-slash\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.815563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815314    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-host-run-netns\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.815563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815339    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-node-log\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.815563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815382    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-multus-socket-dir-parent\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.815563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815388    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-cni-binary-copy\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.815563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815412    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-etc-modprobe-d\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.815563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815443    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-etc-openvswitch\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.815563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815457    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-cnibin\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.815563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815473    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-run-ovn\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.815563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815499    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-host-run-netns\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.815563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815500    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a977870-0600-4a83-a169-6ed663e485ae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tkzx6\" (UID: \"6a977870-0600-4a83-a169-6ed663e485ae\") " pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.815563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815542    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-btwkr\" (UID: \"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.816224 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815571    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-sys\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.816224 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815596    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-etc-tuned\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.816224 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815388    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6a977870-0600-4a83-a169-6ed663e485ae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tkzx6\" (UID: \"6a977870-0600-4a83-a169-6ed663e485ae\") " pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.816224 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815633    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-log-socket\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.816224 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815659    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a977870-0600-4a83-a169-6ed663e485ae-cni-binary-copy\") pod \"multus-additional-cni-plugins-tkzx6\" (UID: \"6a977870-0600-4a83-a169-6ed663e485ae\") " pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.816224 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815668    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a977870-0600-4a83-a169-6ed663e485ae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tkzx6\" (UID: \"6a977870-0600-4a83-a169-6ed663e485ae\") " pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.816224 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815675    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50-device-dir\") pod \"aws-ebs-csi-driver-node-btwkr\" (UID: \"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.816224 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815660    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6a977870-0600-4a83-a169-6ed663e485ae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tkzx6\" (UID: \"6a977870-0600-4a83-a169-6ed663e485ae\") " pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.816224 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815722    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-host-var-lib-cni-bin\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.816224 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815737    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-host-slash\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.816224 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815745    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-etc-openvswitch\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.816224 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815751    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6v98\" (UniqueName: \"kubernetes.io/projected/e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50-kube-api-access-t6v98\") pod \"aws-ebs-csi-driver-node-btwkr\" (UID: \"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.816224 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815775    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-964ss\" (UniqueName: \"kubernetes.io/projected/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-kube-api-access-964ss\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.816224 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815813    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-host-cni-netd\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.816224 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815837    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-multus-cni-dir\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.816224 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815847    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-host-var-lib-cni-bin\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.816224 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815863    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/33d4f8d4-2be4-453c-8f99-a19ce58c1e36-hosts-file\") pod \"node-resolver-7p7gl\" (UID: \"33d4f8d4-2be4-453c-8f99-a19ce58c1e36\") " pod="openshift-dns/node-resolver-7p7gl"
Sep 15 07:01:02.817117 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815866    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-etc-modprobe-d\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.817117 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815888    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50-etc-selinux\") pod \"aws-ebs-csi-driver-node-btwkr\" (UID: \"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.817117 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815913    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-etc-kubernetes\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.817117 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815924    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-multus-socket-dir-parent\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.817117 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815927    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-etc-sysconfig\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.817117 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815937    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-run-openvswitch\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.817117 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815967    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-host-run-k8s-cni-cncf-io\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.817117 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815976    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-node-log\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.817117 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815992    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50-registration-dir\") pod \"aws-ebs-csi-driver-node-btwkr\" (UID: \"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.817117 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815813    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-run-ovn\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.817117 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815889    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-run-systemd\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.817117 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.815967    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-host-run-netns\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.817117 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816088    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/33d4f8d4-2be4-453c-8f99-a19ce58c1e36-hosts-file\") pod \"node-resolver-7p7gl\" (UID: \"33d4f8d4-2be4-453c-8f99-a19ce58c1e36\") " pod="openshift-dns/node-resolver-7p7gl"
Sep 15 07:01:02.817117 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816168    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6a977870-0600-4a83-a169-6ed663e485ae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tkzx6\" (UID: \"6a977870-0600-4a83-a169-6ed663e485ae\") " pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.817117 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816222    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-log-socket\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.817117 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816323    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-host-run-k8s-cni-cncf-io\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.817117 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816332    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50-etc-selinux\") pod \"aws-ebs-csi-driver-node-btwkr\" (UID: \"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.817995 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816373    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-run-openvswitch\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.817995 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816386    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-multus-cni-dir\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.817995 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816408    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-host-var-lib-cni-multus\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.817995 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816412    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-etc-kubernetes\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.817995 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816438    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-btwkr\" (UID: \"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.817995 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816444    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-hostroot\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.817995 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816510    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-etc-systemd\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.817995 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816510    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-host-cni-netd\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.817995 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816533    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50-socket-dir\") pod \"aws-ebs-csi-driver-node-btwkr\" (UID: \"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.817995 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816540    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-host\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.817995 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816572    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-host-var-lib-cni-multus\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.817995 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816571    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-host-kubelet\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.817995 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816594    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-ovnkube-script-lib\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.817995 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816617    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-host-kubelet\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.817995 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816678    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.817995 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816714    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a977870-0600-4a83-a169-6ed663e485ae-cnibin\") pod \"multus-additional-cni-plugins-tkzx6\" (UID: \"6a977870-0600-4a83-a169-6ed663e485ae\") " pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.817995 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816755    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-hostroot\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.818758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816759    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.818758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816770    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50-registration-dir\") pod \"aws-ebs-csi-driver-node-btwkr\" (UID: \"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.818758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816777    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-etc-systemd\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.818758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816815    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-host\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.818758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816821    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a977870-0600-4a83-a169-6ed663e485ae-cnibin\") pod \"multus-additional-cni-plugins-tkzx6\" (UID: \"6a977870-0600-4a83-a169-6ed663e485ae\") " pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.818758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816838    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-etc-kubernetes\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.818758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816859    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-sys\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.818758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816879    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mllm\" (UniqueName: \"kubernetes.io/projected/33d4f8d4-2be4-453c-8f99-a19ce58c1e36-kube-api-access-5mllm\") pod \"node-resolver-7p7gl\" (UID: \"33d4f8d4-2be4-453c-8f99-a19ce58c1e36\") " pod="openshift-dns/node-resolver-7p7gl"
Sep 15 07:01:02.818758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816930    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-etc-kubernetes\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.818758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816936    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7eaabe27-7956-4d37-abaa-d28ac2e47447-dbus\") pod \"global-pull-secret-syncer-dzpwd\" (UID: \"7eaabe27-7956-4d37-abaa-d28ac2e47447\") " pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:02.818758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.816969    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50-sys-fs\") pod \"aws-ebs-csi-driver-node-btwkr\" (UID: \"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.818758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817009    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-etc-sysctl-d\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.818758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817024    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7eaabe27-7956-4d37-abaa-d28ac2e47447-dbus\") pod \"global-pull-secret-syncer-dzpwd\" (UID: \"7eaabe27-7956-4d37-abaa-d28ac2e47447\") " pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:02.818758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817035    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50-sys-fs\") pod \"aws-ebs-csi-driver-node-btwkr\" (UID: \"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.818758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817079    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-run\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.818758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817102    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-ovnkube-config\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.818758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817144    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-multus-daemon-config\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.818758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817204    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-etc-sysctl-d\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.819374 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817246    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-host-var-lib-kubelet\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.819374 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817279    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7eaabe27-7956-4d37-abaa-d28ac2e47447-kubelet-config\") pod \"global-pull-secret-syncer-dzpwd\" (UID: \"7eaabe27-7956-4d37-abaa-d28ac2e47447\") " pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:02.819374 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817292    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-run\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.819374 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817318    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-etc-sysctl-conf\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.819374 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817340    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7eaabe27-7956-4d37-abaa-d28ac2e47447-kubelet-config\") pod \"global-pull-secret-syncer-dzpwd\" (UID: \"7eaabe27-7956-4d37-abaa-d28ac2e47447\") " pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:02.819374 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817353    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-host-var-lib-kubelet\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.819374 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817411    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-lib-modules\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.819374 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817451    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a977870-0600-4a83-a169-6ed663e485ae-system-cni-dir\") pod \"multus-additional-cni-plugins-tkzx6\" (UID: \"6a977870-0600-4a83-a169-6ed663e485ae\") " pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.819374 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817479    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs\") pod \"network-metrics-daemon-9r6zz\" (UID: \"8e7d8199-6790-4b03-bd95-5eeb637d2f99\") " pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:02.819374 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817505    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-etc-sysctl-conf\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.819374 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817522    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bvqb\" (UniqueName: \"kubernetes.io/projected/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-kube-api-access-6bvqb\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.819374 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817549    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-var-lib-openvswitch\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.819374 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817577    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-host-run-ovn-kubernetes\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.819374 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817597    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-lib-modules\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.819374 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817607    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-ovnkube-config\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.819374 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817635    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-ovn-node-metrics-cert\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.819374 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817664    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a977870-0600-4a83-a169-6ed663e485ae-system-cni-dir\") pod \"multus-additional-cni-plugins-tkzx6\" (UID: \"6a977870-0600-4a83-a169-6ed663e485ae\") " pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.820017 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817666    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7v8c\" (UniqueName: \"kubernetes.io/projected/6a977870-0600-4a83-a169-6ed663e485ae-kube-api-access-p7v8c\") pod \"multus-additional-cni-plugins-tkzx6\" (UID: \"6a977870-0600-4a83-a169-6ed663e485ae\") " pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.820017 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:02.817672    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:01:02.820017 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817707    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-system-cni-dir\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.820017 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817739    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-multus-conf-dir\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.820017 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817731    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-host-run-ovn-kubernetes\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.820017 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817791    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret\") pod \"global-pull-secret-syncer-dzpwd\" (UID: \"7eaabe27-7956-4d37-abaa-d28ac2e47447\") " pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:02.820017 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817798    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-var-lib-openvswitch\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.820017 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817829    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-multus-daemon-config\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.820017 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817841    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-multus-conf-dir\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.820017 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817895    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-system-cni-dir\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.820017 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:02.817914    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 07:01:02.820017 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.817933    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-var-lib-kubelet\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.820017 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:02.817988    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret podName:7eaabe27-7956-4d37-abaa-d28ac2e47447 nodeName:}" failed. No retries permitted until 2026-09-15 07:01:03.31797004 +0000 UTC m=+3.108887857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret") pod "global-pull-secret-syncer-dzpwd" (UID: "7eaabe27-7956-4d37-abaa-d28ac2e47447") : object "kube-system"/"original-pull-secret" not registered
Sep 15 07:01:02.820017 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.818036    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-env-overrides\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.820017 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.818068    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-systemd-units\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.820017 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.818113    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsznm\" (UniqueName: \"kubernetes.io/projected/8e7d8199-6790-4b03-bd95-5eeb637d2f99-kube-api-access-qsznm\") pod \"network-metrics-daemon-9r6zz\" (UID: \"8e7d8199-6790-4b03-bd95-5eeb637d2f99\") " pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:02.820017 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.818160    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-tmp\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.820017 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.818202    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-var-lib-kubelet\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.820815 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.818217    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-systemd-units\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.820815 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:02.818377    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs podName:8e7d8199-6790-4b03-bd95-5eeb637d2f99 nodeName:}" failed. No retries permitted until 2026-09-15 07:01:03.318354853 +0000 UTC m=+3.109272668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs") pod "network-metrics-daemon-9r6zz" (UID: "8e7d8199-6790-4b03-bd95-5eeb637d2f99") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:01:02.820815 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.818674    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-env-overrides\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.820815 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.818859    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-etc-tuned\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.820815 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.819892    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-ovn-node-metrics-cert\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.824180 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.823834    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw8rs\" (UniqueName: \"kubernetes.io/projected/c97f88a6-f9a0-49bd-82a9-41ed2f617e8f-kube-api-access-gw8rs\") pod \"ovnkube-node-n92hd\" (UID: \"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.824180 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.824139    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-964ss\" (UniqueName: \"kubernetes.io/projected/7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c-kube-api-access-964ss\") pod \"tuned-cjf92\" (UID: \"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c\") " pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.824905 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.824725    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mllm\" (UniqueName: \"kubernetes.io/projected/33d4f8d4-2be4-453c-8f99-a19ce58c1e36-kube-api-access-5mllm\") pod \"node-resolver-7p7gl\" (UID: \"33d4f8d4-2be4-453c-8f99-a19ce58c1e36\") " pod="openshift-dns/node-resolver-7p7gl"
Sep 15 07:01:02.824905 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.824839    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6v98\" (UniqueName: \"kubernetes.io/projected/e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50-kube-api-access-t6v98\") pod \"aws-ebs-csi-driver-node-btwkr\" (UID: \"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.826546 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.826521    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7v8c\" (UniqueName: \"kubernetes.io/projected/6a977870-0600-4a83-a169-6ed663e485ae-kube-api-access-p7v8c\") pod \"multus-additional-cni-plugins-tkzx6\" (UID: \"6a977870-0600-4a83-a169-6ed663e485ae\") " pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:02.826708 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.826690    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsznm\" (UniqueName: \"kubernetes.io/projected/8e7d8199-6790-4b03-bd95-5eeb637d2f99-kube-api-access-qsznm\") pod \"network-metrics-daemon-9r6zz\" (UID: \"8e7d8199-6790-4b03-bd95-5eeb637d2f99\") " pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:02.827049 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.827031    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bvqb\" (UniqueName: \"kubernetes.io/projected/bd613c9f-dcfb-47a1-9c8b-ef63401cf342-kube-api-access-6bvqb\") pod \"multus-wqdxh\" (UID: \"bd613c9f-dcfb-47a1-9c8b-ef63401cf342\") " pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.907269 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.907192    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8k4fj"
Sep 15 07:01:02.914959 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.914932    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h5zdl"
Sep 15 07:01:02.925871 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.925849    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l5chg"
Sep 15 07:01:02.932724 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.932694    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr"
Sep 15 07:01:02.940604 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.940581    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cjf92"
Sep 15 07:01:02.947487 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.947466    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wqdxh"
Sep 15 07:01:02.954233 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.954206    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7p7gl"
Sep 15 07:01:02.962117 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.962097    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:02.967953 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:02.967934    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tkzx6"
Sep 15 07:01:03.001972 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:03.001949    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 07:01:03.160380 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:03.160215    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33d4f8d4_2be4_453c_8f99_a19ce58c1e36.slice/crio-d0cb2fccd71bab8bb5a82ce69fa0bbc690507e007d7b8e844be846d7f37cbcfa WatchSource:0}: Error finding container d0cb2fccd71bab8bb5a82ce69fa0bbc690507e007d7b8e844be846d7f37cbcfa: Status 404 returned error can't find the container with id d0cb2fccd71bab8bb5a82ce69fa0bbc690507e007d7b8e844be846d7f37cbcfa
Sep 15 07:01:03.161847 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:03.161792    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode09c58ca_e3a9_4abf_ba56_a89fa6aa1c50.slice/crio-dfc395fccec37539b50de156abbc58ecf84630c1b1c5f1444c8704a96871c662 WatchSource:0}: Error finding container dfc395fccec37539b50de156abbc58ecf84630c1b1c5f1444c8704a96871c662: Status 404 returned error can't find the container with id dfc395fccec37539b50de156abbc58ecf84630c1b1c5f1444c8704a96871c662
Sep 15 07:01:03.165131 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:03.165107    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a8a2fd0_fa70_4f65_b3c7_214eb5f8a83c.slice/crio-dcf4848b732651a3674e7a68d5fb374131181fd644e732469f178b8a06fb1312 WatchSource:0}: Error finding container dcf4848b732651a3674e7a68d5fb374131181fd644e732469f178b8a06fb1312: Status 404 returned error can't find the container with id dcf4848b732651a3674e7a68d5fb374131181fd644e732469f178b8a06fb1312
Sep 15 07:01:03.167873 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:03.167843    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a977870_0600_4a83_a169_6ed663e485ae.slice/crio-854b36f65954313ffe20a698e85b0791af4b0ff81652449cb197b59ddc9927ab WatchSource:0}: Error finding container 854b36f65954313ffe20a698e85b0791af4b0ff81652449cb197b59ddc9927ab: Status 404 returned error can't find the container with id 854b36f65954313ffe20a698e85b0791af4b0ff81652449cb197b59ddc9927ab
Sep 15 07:01:03.168821 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:03.168719    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67a0be6f_84c1_4b98_b6d1_0dad5516fe99.slice/crio-05210ee2adaec3d349e6746dea4ba34a7a7a851c3fbb2c0f1cedb384513ef127 WatchSource:0}: Error finding container 05210ee2adaec3d349e6746dea4ba34a7a7a851c3fbb2c0f1cedb384513ef127: Status 404 returned error can't find the container with id 05210ee2adaec3d349e6746dea4ba34a7a7a851c3fbb2c0f1cedb384513ef127
Sep 15 07:01:03.169479 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:03.169452    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd613c9f_dcfb_47a1_9c8b_ef63401cf342.slice/crio-fe97f1a68e0ae2c02bfb2e51989f1d801574d9f9e82ee082288d99771817125d WatchSource:0}: Error finding container fe97f1a68e0ae2c02bfb2e51989f1d801574d9f9e82ee082288d99771817125d: Status 404 returned error can't find the container with id fe97f1a68e0ae2c02bfb2e51989f1d801574d9f9e82ee082288d99771817125d
Sep 15 07:01:03.171669 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:03.171644    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbc008a1_b0d8_45d4_aa3a_adf819a127af.slice/crio-ec5cd1e196c4f81ca81cd98b51623e64fc123e9716ad2623779819f9baa402f1 WatchSource:0}: Error finding container ec5cd1e196c4f81ca81cd98b51623e64fc123e9716ad2623779819f9baa402f1: Status 404 returned error can't find the container with id ec5cd1e196c4f81ca81cd98b51623e64fc123e9716ad2623779819f9baa402f1
Sep 15 07:01:03.173483 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:03.173323    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc97f88a6_f9a0_49bd_82a9_41ed2f617e8f.slice/crio-4011bff335d505f35394f7f329142454c250575c4d8a3feab7a1cda9b9ccec6d WatchSource:0}: Error finding container 4011bff335d505f35394f7f329142454c250575c4d8a3feab7a1cda9b9ccec6d: Status 404 returned error can't find the container with id 4011bff335d505f35394f7f329142454c250575c4d8a3feab7a1cda9b9ccec6d
Sep 15 07:01:03.173905 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:03.173885    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aee77e0_4ad8_4134_8a4e_3c07793a6574.slice/crio-b12f7804f87b3fb3d1a5bac8dd07d2b0df09c2970ace52a647f492b2fb655d80 WatchSource:0}: Error finding container b12f7804f87b3fb3d1a5bac8dd07d2b0df09c2970ace52a647f492b2fb655d80: Status 404 returned error can't find the container with id b12f7804f87b3fb3d1a5bac8dd07d2b0df09c2970ace52a647f492b2fb655d80
Sep 15 07:01:03.221382 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:03.221352    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb2dw\" (UniqueName: \"kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw\") pod \"network-check-target-tcldw\" (UID: \"69bff7ef-8a76-40f8-9e5f-1ad219bf15b8\") " pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:03.221499 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:03.221484    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 07:01:03.221565 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:03.221507    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 07:01:03.221565 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:03.221519    2568 projected.go:196] Error preparing data for projected volume kube-api-access-qb2dw for pod openshift-network-diagnostics/network-check-target-tcldw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:01:03.221675 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:03.221578    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw podName:69bff7ef-8a76-40f8-9e5f-1ad219bf15b8 nodeName:}" failed. No retries permitted until 2026-09-15 07:01:04.221559117 +0000 UTC m=+4.012476920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qb2dw" (UniqueName: "kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw") pod "network-check-target-tcldw" (UID: "69bff7ef-8a76-40f8-9e5f-1ad219bf15b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:01:03.322475 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:03.322448    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs\") pod \"network-metrics-daemon-9r6zz\" (UID: \"8e7d8199-6790-4b03-bd95-5eeb637d2f99\") " pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:03.322615 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:03.322484    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret\") pod \"global-pull-secret-syncer-dzpwd\" (UID: \"7eaabe27-7956-4d37-abaa-d28ac2e47447\") " pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:03.322615 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:03.322580    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 07:01:03.322749 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:03.322616    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:01:03.322749 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:03.322626    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret podName:7eaabe27-7956-4d37-abaa-d28ac2e47447 nodeName:}" failed. No retries permitted until 2026-09-15 07:01:04.32261297 +0000 UTC m=+4.113530785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret") pod "global-pull-secret-syncer-dzpwd" (UID: "7eaabe27-7956-4d37-abaa-d28ac2e47447") : object "kube-system"/"original-pull-secret" not registered
Sep 15 07:01:03.322749 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:03.322686    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs podName:8e7d8199-6790-4b03-bd95-5eeb637d2f99 nodeName:}" failed. No retries permitted until 2026-09-15 07:01:04.322668362 +0000 UTC m=+4.113586163 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs") pod "network-metrics-daemon-9r6zz" (UID: "8e7d8199-6790-4b03-bd95-5eeb637d2f99") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:01:03.646571 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:03.646520    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 06:56:03 +0000 UTC" deadline="2028-03-30 05:18:11.535370946 +0000 UTC"
Sep 15 07:01:03.646571 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:03.646563    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13486h17m7.888811845s"
Sep 15 07:01:03.736486 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:03.736406    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:03.736679 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:03.736652    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9r6zz" podUID="8e7d8199-6790-4b03-bd95-5eeb637d2f99"
Sep 15 07:01:03.746541 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:03.746508    2568 generic.go:356] "Generic (PLEG): container finished" podID="4bdf2c16da359bb8e08f885d8cfc1446" containerID="f876913b75bb836f965f7a382699d826b88ce8f68f1b6b41f73cb0e5560bab9c" exitCode=0
Sep 15 07:01:03.746684 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:03.746609    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal" event={"ID":"4bdf2c16da359bb8e08f885d8cfc1446","Type":"ContainerDied","Data":"f876913b75bb836f965f7a382699d826b88ce8f68f1b6b41f73cb0e5560bab9c"}
Sep 15 07:01:03.749003 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:03.748977    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wqdxh" event={"ID":"bd613c9f-dcfb-47a1-9c8b-ef63401cf342","Type":"ContainerStarted","Data":"fe97f1a68e0ae2c02bfb2e51989f1d801574d9f9e82ee082288d99771817125d"}
Sep 15 07:01:03.750907 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:03.750880    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkzx6" event={"ID":"6a977870-0600-4a83-a169-6ed663e485ae","Type":"ContainerStarted","Data":"854b36f65954313ffe20a698e85b0791af4b0ff81652449cb197b59ddc9927ab"}
Sep 15 07:01:03.752808 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:03.752781    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cjf92" event={"ID":"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c","Type":"ContainerStarted","Data":"dcf4848b732651a3674e7a68d5fb374131181fd644e732469f178b8a06fb1312"}
Sep 15 07:01:03.755230 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:03.755186    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7p7gl" event={"ID":"33d4f8d4-2be4-453c-8f99-a19ce58c1e36","Type":"ContainerStarted","Data":"d0cb2fccd71bab8bb5a82ce69fa0bbc690507e007d7b8e844be846d7f37cbcfa"}
Sep 15 07:01:03.756777 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:03.756751    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l5chg" event={"ID":"4aee77e0-4ad8-4134-8a4e-3c07793a6574","Type":"ContainerStarted","Data":"b12f7804f87b3fb3d1a5bac8dd07d2b0df09c2970ace52a647f492b2fb655d80"}
Sep 15 07:01:03.759079 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:03.759053    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n92hd" event={"ID":"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f","Type":"ContainerStarted","Data":"4011bff335d505f35394f7f329142454c250575c4d8a3feab7a1cda9b9ccec6d"}
Sep 15 07:01:03.762402 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:03.762374    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h5zdl" event={"ID":"fbc008a1-b0d8-45d4-aa3a-adf819a127af","Type":"ContainerStarted","Data":"ec5cd1e196c4f81ca81cd98b51623e64fc123e9716ad2623779819f9baa402f1"}
Sep 15 07:01:03.768289 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:03.768264    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8k4fj" event={"ID":"67a0be6f-84c1-4b98-b6d1-0dad5516fe99","Type":"ContainerStarted","Data":"05210ee2adaec3d349e6746dea4ba34a7a7a851c3fbb2c0f1cedb384513ef127"}
Sep 15 07:01:03.776960 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:03.776889    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr" event={"ID":"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50","Type":"ContainerStarted","Data":"dfc395fccec37539b50de156abbc58ecf84630c1b1c5f1444c8704a96871c662"}
Sep 15 07:01:03.931000 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:03.928400    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 07:01:04.231567 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:04.230886    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb2dw\" (UniqueName: \"kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw\") pod \"network-check-target-tcldw\" (UID: \"69bff7ef-8a76-40f8-9e5f-1ad219bf15b8\") " pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:04.231567 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:04.231101    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 07:01:04.231567 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:04.231127    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 07:01:04.231567 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:04.231141    2568 projected.go:196] Error preparing data for projected volume kube-api-access-qb2dw for pod openshift-network-diagnostics/network-check-target-tcldw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:01:04.231567 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:04.231205    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw podName:69bff7ef-8a76-40f8-9e5f-1ad219bf15b8 nodeName:}" failed. No retries permitted until 2026-09-15 07:01:06.231184898 +0000 UTC m=+6.022102705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qb2dw" (UniqueName: "kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw") pod "network-check-target-tcldw" (UID: "69bff7ef-8a76-40f8-9e5f-1ad219bf15b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:01:04.331959 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:04.331920    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs\") pod \"network-metrics-daemon-9r6zz\" (UID: \"8e7d8199-6790-4b03-bd95-5eeb637d2f99\") " pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:04.332155 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:04.331974    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret\") pod \"global-pull-secret-syncer-dzpwd\" (UID: \"7eaabe27-7956-4d37-abaa-d28ac2e47447\") " pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:04.332155 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:04.332111    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 07:01:04.332274 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:04.332170    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret podName:7eaabe27-7956-4d37-abaa-d28ac2e47447 nodeName:}" failed. No retries permitted until 2026-09-15 07:01:06.332151251 +0000 UTC m=+6.123069055 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret") pod "global-pull-secret-syncer-dzpwd" (UID: "7eaabe27-7956-4d37-abaa-d28ac2e47447") : object "kube-system"/"original-pull-secret" not registered
Sep 15 07:01:04.332582 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:04.332560    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:01:04.332689 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:04.332626    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs podName:8e7d8199-6790-4b03-bd95-5eeb637d2f99 nodeName:}" failed. No retries permitted until 2026-09-15 07:01:06.332607856 +0000 UTC m=+6.123525677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs") pod "network-metrics-daemon-9r6zz" (UID: "8e7d8199-6790-4b03-bd95-5eeb637d2f99") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:01:04.647072 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:04.646949    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 06:56:03 +0000 UTC" deadline="2028-05-31 18:03:12.143690048 +0000 UTC"
Sep 15 07:01:04.647072 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:04.647019    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14987h2m7.49667542s"
Sep 15 07:01:04.737015 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:04.736979    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:04.737192 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:04.737108    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dzpwd" podUID="7eaabe27-7956-4d37-abaa-d28ac2e47447"
Sep 15 07:01:04.737565 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:04.737525    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:04.737676 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:04.737620    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcldw" podUID="69bff7ef-8a76-40f8-9e5f-1ad219bf15b8"
Sep 15 07:01:04.798075 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:04.798043    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal" event={"ID":"4bdf2c16da359bb8e08f885d8cfc1446","Type":"ContainerStarted","Data":"04059e3f7b6b29a4b459916e3abe1afaccec435a8011c130f74b4863c7fd506f"}
Sep 15 07:01:05.736363 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:05.736278    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:05.737094 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:05.736434    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9r6zz" podUID="8e7d8199-6790-4b03-bd95-5eeb637d2f99"
Sep 15 07:01:06.248980 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:06.248919    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb2dw\" (UniqueName: \"kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw\") pod \"network-check-target-tcldw\" (UID: \"69bff7ef-8a76-40f8-9e5f-1ad219bf15b8\") " pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:06.249210 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:06.249193    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 07:01:06.249327 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:06.249221    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 07:01:06.249327 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:06.249235    2568 projected.go:196] Error preparing data for projected volume kube-api-access-qb2dw for pod openshift-network-diagnostics/network-check-target-tcldw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:01:06.249327 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:06.249298    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw podName:69bff7ef-8a76-40f8-9e5f-1ad219bf15b8 nodeName:}" failed. No retries permitted until 2026-09-15 07:01:10.249278417 +0000 UTC m=+10.040196220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qb2dw" (UniqueName: "kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw") pod "network-check-target-tcldw" (UID: "69bff7ef-8a76-40f8-9e5f-1ad219bf15b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:01:06.350105 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:06.350034    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs\") pod \"network-metrics-daemon-9r6zz\" (UID: \"8e7d8199-6790-4b03-bd95-5eeb637d2f99\") " pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:06.350295 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:06.350129    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret\") pod \"global-pull-secret-syncer-dzpwd\" (UID: \"7eaabe27-7956-4d37-abaa-d28ac2e47447\") " pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:06.350295 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:06.350282    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 07:01:06.350413 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:06.350343    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret podName:7eaabe27-7956-4d37-abaa-d28ac2e47447 nodeName:}" failed. No retries permitted until 2026-09-15 07:01:10.350324798 +0000 UTC m=+10.141242601 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret") pod "global-pull-secret-syncer-dzpwd" (UID: "7eaabe27-7956-4d37-abaa-d28ac2e47447") : object "kube-system"/"original-pull-secret" not registered
Sep 15 07:01:06.350478 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:06.350411    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:01:06.350478 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:06.350446    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs podName:8e7d8199-6790-4b03-bd95-5eeb637d2f99 nodeName:}" failed. No retries permitted until 2026-09-15 07:01:10.350434075 +0000 UTC m=+10.141351881 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs") pod "network-metrics-daemon-9r6zz" (UID: "8e7d8199-6790-4b03-bd95-5eeb637d2f99") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:01:06.737885 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:06.737396    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:06.737885 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:06.737546    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcldw" podUID="69bff7ef-8a76-40f8-9e5f-1ad219bf15b8"
Sep 15 07:01:06.737885 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:06.737591    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:06.737885 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:06.737680    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dzpwd" podUID="7eaabe27-7956-4d37-abaa-d28ac2e47447"
Sep 15 07:01:07.736896 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:07.736860    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:07.737141 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:07.737116    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9r6zz" podUID="8e7d8199-6790-4b03-bd95-5eeb637d2f99"
Sep 15 07:01:08.736594 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:08.736558    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:08.737064 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:08.736724    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dzpwd" podUID="7eaabe27-7956-4d37-abaa-d28ac2e47447"
Sep 15 07:01:08.737064 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:08.737030    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:08.737137 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:08.737122    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcldw" podUID="69bff7ef-8a76-40f8-9e5f-1ad219bf15b8"
Sep 15 07:01:09.736604 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:09.736572    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:09.737078 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:09.736686    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9r6zz" podUID="8e7d8199-6790-4b03-bd95-5eeb637d2f99"
Sep 15 07:01:10.283301 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:10.283273    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb2dw\" (UniqueName: \"kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw\") pod \"network-check-target-tcldw\" (UID: \"69bff7ef-8a76-40f8-9e5f-1ad219bf15b8\") " pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:10.283477 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:10.283419    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 07:01:10.283477 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:10.283441    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 07:01:10.283477 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:10.283453    2568 projected.go:196] Error preparing data for projected volume kube-api-access-qb2dw for pod openshift-network-diagnostics/network-check-target-tcldw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:01:10.283648 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:10.283505    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw podName:69bff7ef-8a76-40f8-9e5f-1ad219bf15b8 nodeName:}" failed. No retries permitted until 2026-09-15 07:01:18.283486821 +0000 UTC m=+18.074404625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qb2dw" (UniqueName: "kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw") pod "network-check-target-tcldw" (UID: "69bff7ef-8a76-40f8-9e5f-1ad219bf15b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:01:10.384459 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:10.384284    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs\") pod \"network-metrics-daemon-9r6zz\" (UID: \"8e7d8199-6790-4b03-bd95-5eeb637d2f99\") " pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:10.384459 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:10.384322    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret\") pod \"global-pull-secret-syncer-dzpwd\" (UID: \"7eaabe27-7956-4d37-abaa-d28ac2e47447\") " pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:10.384459 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:10.384440    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:01:10.384747 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:10.384501    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs podName:8e7d8199-6790-4b03-bd95-5eeb637d2f99 nodeName:}" failed. No retries permitted until 2026-09-15 07:01:18.384483817 +0000 UTC m=+18.175401620 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs") pod "network-metrics-daemon-9r6zz" (UID: "8e7d8199-6790-4b03-bd95-5eeb637d2f99") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:01:10.384823 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:10.384440    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 07:01:10.384890 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:10.384865    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret podName:7eaabe27-7956-4d37-abaa-d28ac2e47447 nodeName:}" failed. No retries permitted until 2026-09-15 07:01:18.384848393 +0000 UTC m=+18.175766208 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret") pod "global-pull-secret-syncer-dzpwd" (UID: "7eaabe27-7956-4d37-abaa-d28ac2e47447") : object "kube-system"/"original-pull-secret" not registered
Sep 15 07:01:10.738459 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:10.737806    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:10.738459 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:10.737917    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dzpwd" podUID="7eaabe27-7956-4d37-abaa-d28ac2e47447"
Sep 15 07:01:10.738459 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:10.738278    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:10.738459 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:10.738372    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcldw" podUID="69bff7ef-8a76-40f8-9e5f-1ad219bf15b8"
Sep 15 07:01:11.736943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:11.736909    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:11.737137 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:11.737056    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9r6zz" podUID="8e7d8199-6790-4b03-bd95-5eeb637d2f99"
Sep 15 07:01:12.736970 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:12.736936    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:12.737389 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:12.737047    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcldw" podUID="69bff7ef-8a76-40f8-9e5f-1ad219bf15b8"
Sep 15 07:01:12.737389 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:12.736936    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:12.737389 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:12.737188    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dzpwd" podUID="7eaabe27-7956-4d37-abaa-d28ac2e47447"
Sep 15 07:01:13.736379 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:13.736348    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:13.736537 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:13.736456    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9r6zz" podUID="8e7d8199-6790-4b03-bd95-5eeb637d2f99"
Sep 15 07:01:14.736637 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:14.736556    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:14.737093 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:14.736560    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:14.737093 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:14.736692    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcldw" podUID="69bff7ef-8a76-40f8-9e5f-1ad219bf15b8"
Sep 15 07:01:14.737093 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:14.736753    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dzpwd" podUID="7eaabe27-7956-4d37-abaa-d28ac2e47447"
Sep 15 07:01:15.736971 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:15.736934    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:15.737424 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:15.737076    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9r6zz" podUID="8e7d8199-6790-4b03-bd95-5eeb637d2f99"
Sep 15 07:01:16.736480 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:16.736447    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:16.736649 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:16.736574    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcldw" podUID="69bff7ef-8a76-40f8-9e5f-1ad219bf15b8"
Sep 15 07:01:16.736649 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:16.736622    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:16.736811 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:16.736755    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dzpwd" podUID="7eaabe27-7956-4d37-abaa-d28ac2e47447"
Sep 15 07:01:17.736316 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:17.736288    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:17.736704 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:17.736400    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9r6zz" podUID="8e7d8199-6790-4b03-bd95-5eeb637d2f99"
Sep 15 07:01:18.340843 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:18.340804    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb2dw\" (UniqueName: \"kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw\") pod \"network-check-target-tcldw\" (UID: \"69bff7ef-8a76-40f8-9e5f-1ad219bf15b8\") " pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:18.340998 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:18.340978    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 07:01:18.341052 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:18.341003    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 07:01:18.341052 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:18.341014    2568 projected.go:196] Error preparing data for projected volume kube-api-access-qb2dw for pod openshift-network-diagnostics/network-check-target-tcldw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:01:18.341114 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:18.341078    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw podName:69bff7ef-8a76-40f8-9e5f-1ad219bf15b8 nodeName:}" failed. No retries permitted until 2026-09-15 07:01:34.3410595 +0000 UTC m=+34.131977298 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qb2dw" (UniqueName: "kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw") pod "network-check-target-tcldw" (UID: "69bff7ef-8a76-40f8-9e5f-1ad219bf15b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:01:18.441464 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:18.441423    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs\") pod \"network-metrics-daemon-9r6zz\" (UID: \"8e7d8199-6790-4b03-bd95-5eeb637d2f99\") " pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:18.441632 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:18.441493    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret\") pod \"global-pull-secret-syncer-dzpwd\" (UID: \"7eaabe27-7956-4d37-abaa-d28ac2e47447\") " pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:18.441632 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:18.441580    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 07:01:18.441783 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:18.441644    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret podName:7eaabe27-7956-4d37-abaa-d28ac2e47447 nodeName:}" failed. No retries permitted until 2026-09-15 07:01:34.441631083 +0000 UTC m=+34.232548882 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret") pod "global-pull-secret-syncer-dzpwd" (UID: "7eaabe27-7956-4d37-abaa-d28ac2e47447") : object "kube-system"/"original-pull-secret" not registered
Sep 15 07:01:18.441783 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:18.441581    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:01:18.441783 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:18.441749    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs podName:8e7d8199-6790-4b03-bd95-5eeb637d2f99 nodeName:}" failed. No retries permitted until 2026-09-15 07:01:34.441730389 +0000 UTC m=+34.232648199 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs") pod "network-metrics-daemon-9r6zz" (UID: "8e7d8199-6790-4b03-bd95-5eeb637d2f99") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:01:18.737460 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:18.737187    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:18.737900 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:18.737250    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:18.737900 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:18.737529    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dzpwd" podUID="7eaabe27-7956-4d37-abaa-d28ac2e47447"
Sep 15 07:01:18.737900 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:18.737581    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcldw" podUID="69bff7ef-8a76-40f8-9e5f-1ad219bf15b8"
Sep 15 07:01:19.736213 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:19.736186    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:19.736393 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:19.736313    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9r6zz" podUID="8e7d8199-6790-4b03-bd95-5eeb637d2f99"
Sep 15 07:01:20.737117 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:20.737084    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:20.737560 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:20.737184    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dzpwd" podUID="7eaabe27-7956-4d37-abaa-d28ac2e47447"
Sep 15 07:01:20.737560 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:20.737276    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:20.737560 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:20.737366    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcldw" podUID="69bff7ef-8a76-40f8-9e5f-1ad219bf15b8"
Sep 15 07:01:21.736152 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:21.736087    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:21.736253 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:21.736195    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9r6zz" podUID="8e7d8199-6790-4b03-bd95-5eeb637d2f99"
Sep 15 07:01:22.736525 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.736313    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:22.737114 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.736313    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:22.737114 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:22.736566    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dzpwd" podUID="7eaabe27-7956-4d37-abaa-d28ac2e47447"
Sep 15 07:01:22.737114 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:22.736627    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcldw" podUID="69bff7ef-8a76-40f8-9e5f-1ad219bf15b8"
Sep 15 07:01:22.836748 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.836701    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h5zdl" event={"ID":"fbc008a1-b0d8-45d4-aa3a-adf819a127af","Type":"ContainerStarted","Data":"7b04013bda29e08df432bbfb344f9fe7fd1396f2a7434842667347fd418723ce"}
Sep 15 07:01:22.838267 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.838243    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8k4fj" event={"ID":"67a0be6f-84c1-4b98-b6d1-0dad5516fe99","Type":"ContainerStarted","Data":"06758679ccbdfe475ad591ed0e892f81a0ca89160c6ff95312418780b6e70e80"}
Sep 15 07:01:22.839639 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.839619    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr" event={"ID":"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50","Type":"ContainerStarted","Data":"6df6f3717f9680c98b7ddbe5ad704d1ffaf8e0cbaeb0cd2fe323baeaebb01b53"}
Sep 15 07:01:22.841045 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.841027    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wqdxh" event={"ID":"bd613c9f-dcfb-47a1-9c8b-ef63401cf342","Type":"ContainerStarted","Data":"7358ca588019c5b5f10091c1d4c91d11f59a7f693e7b94bc9ca3996a2a699902"}
Sep 15 07:01:22.842440 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.842418    2568 generic.go:356] "Generic (PLEG): container finished" podID="6a977870-0600-4a83-a169-6ed663e485ae" containerID="4cc61c7ad1bbbae0b3a55a071bf73c27cb05b22af144a119ba0a6d7dc9342ba4" exitCode=0
Sep 15 07:01:22.842516 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.842495    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkzx6" event={"ID":"6a977870-0600-4a83-a169-6ed663e485ae","Type":"ContainerDied","Data":"4cc61c7ad1bbbae0b3a55a071bf73c27cb05b22af144a119ba0a6d7dc9342ba4"}
Sep 15 07:01:22.844024 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.844002    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cjf92" event={"ID":"7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c","Type":"ContainerStarted","Data":"c951c4d746e52a806fed027b7dd0a3b4b363eee96a214280ebe84e47c1c9dc8d"}
Sep 15 07:01:22.845568 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.845544    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7p7gl" event={"ID":"33d4f8d4-2be4-453c-8f99-a19ce58c1e36","Type":"ContainerStarted","Data":"d150d7c3e71d4c5dff52fdd89ba9227ff7396ed62df1639cd64b78d2e8b3b2bf"}
Sep 15 07:01:22.846911 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.846892    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal" event={"ID":"1f1ba8a42accaebaa2593b3b48d06684","Type":"ContainerStarted","Data":"191c7013e1cf5bd3f23e72ac95519bc3d984f64ea080bb5804603ed405e427a2"}
Sep 15 07:01:22.849866 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.849838    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n92hd" event={"ID":"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f","Type":"ContainerStarted","Data":"c81e99ee55e60e3e2e7a8ceafbf951d49bc5347ac3a0206a2f68f923f41fc345"}
Sep 15 07:01:22.849951 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.849902    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n92hd" event={"ID":"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f","Type":"ContainerStarted","Data":"ac0585d0117233538d24f1fb43eb45e4de908dd1b4538a28548a0cca7c39508d"}
Sep 15 07:01:22.849951 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.849931    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n92hd" event={"ID":"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f","Type":"ContainerStarted","Data":"494029f54aab984ed56ba8df77409232bb8533ae46ed6226efe5869a0e0944b7"}
Sep 15 07:01:22.850016 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.849962    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n92hd" event={"ID":"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f","Type":"ContainerStarted","Data":"680491b638d922528ca688fc0e3811a300d0a38a5726651632b4980a85d934c5"}
Sep 15 07:01:22.850016 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.849988    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n92hd" event={"ID":"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f","Type":"ContainerStarted","Data":"cd395fcd24a2a604d7f604ae50877443394175a00ac73fa544052e9649422296"}
Sep 15 07:01:22.850016 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.850015    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n92hd" event={"ID":"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f","Type":"ContainerStarted","Data":"fc4d39acaf6843ddfb5b3ca9c35938de9a60362a357adefd938b364ff76b7b10"}
Sep 15 07:01:22.850782 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.850748    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h5zdl" podStartSLOduration=3.428672064 podStartE2EDuration="21.850737788s" totalImagesPullingTime="18.422065724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:01:22.850449804 +0000 UTC m=+22.641367625" watchObservedRunningTime="2026-09-15 07:01:22.850737788 +0000 UTC m=+22.641655605"
Sep 15 07:01:22.850994 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.850975    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal" podStartSLOduration=20.850967805 podStartE2EDuration="20.850967805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:01:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:01:04.812978971 +0000 UTC m=+4.603896798" watchObservedRunningTime="2026-09-15 07:01:22.850967805 +0000 UTC m=+22.641885626"
Sep 15 07:01:22.878548 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.878510    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wqdxh" podStartSLOduration=3.18115138 podStartE2EDuration="21.878499956s" totalImagesPullingTime="18.697348576s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:01:22.865425821 +0000 UTC m=+22.656343641" watchObservedRunningTime="2026-09-15 07:01:22.878499956 +0000 UTC m=+22.669417777"
Sep 15 07:01:22.879027 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.879005    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7p7gl" podStartSLOduration=3.421584121 podStartE2EDuration="21.878998766s" totalImagesPullingTime="18.457414645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:01:22.878695143 +0000 UTC m=+22.669612966" watchObservedRunningTime="2026-09-15 07:01:22.878998766 +0000 UTC m=+22.669916587"
Sep 15 07:01:22.923354 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.923321    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8k4fj" podStartSLOduration=3.475939225 podStartE2EDuration="21.923310762s" totalImagesPullingTime="18.447371537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:01:22.923148434 +0000 UTC m=+22.714066254" watchObservedRunningTime="2026-09-15 07:01:22.923310762 +0000 UTC m=+22.714228583"
Sep 15 07:01:22.923673 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.923652    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal" podStartSLOduration=20.923645967 podStartE2EDuration="20.923645967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:01:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:01:22.90821013 +0000 UTC m=+22.699127951" watchObservedRunningTime="2026-09-15 07:01:22.923645967 +0000 UTC m=+22.714563826"
Sep 15 07:01:22.944335 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:22.944303    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cjf92" podStartSLOduration=3.322996391 podStartE2EDuration="21.944292372s" totalImagesPullingTime="18.621295981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:01:22.944165855 +0000 UTC m=+22.735083689" watchObservedRunningTime="2026-09-15 07:01:22.944292372 +0000 UTC m=+22.735210210"
Sep 15 07:01:23.736334 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:23.736308    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:23.736527 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:23.736403    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9r6zz" podUID="8e7d8199-6790-4b03-bd95-5eeb637d2f99"
Sep 15 07:01:23.854201 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:23.854159    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l5chg" event={"ID":"4aee77e0-4ad8-4134-8a4e-3c07793a6574","Type":"ContainerStarted","Data":"af6f295b3eff43c73479876be4aad3176a883a58dffc2c548bdaca162c116e37"}
Sep 15 07:01:23.867902 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:23.867858    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l5chg" podStartSLOduration=4.272524827 podStartE2EDuration="22.867843726s" totalImagesPullingTime="18.595318899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:01:23.867827065 +0000 UTC m=+23.658744885" watchObservedRunningTime="2026-09-15 07:01:23.867843726 +0000 UTC m=+23.658761547"
Sep 15 07:01:24.736195 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:24.736115    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:24.736361 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:24.736267    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:24.736361 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:24.736269    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcldw" podUID="69bff7ef-8a76-40f8-9e5f-1ad219bf15b8"
Sep 15 07:01:24.736467 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:24.736371    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dzpwd" podUID="7eaabe27-7956-4d37-abaa-d28ac2e47447"
Sep 15 07:01:24.860482 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:24.860262    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n92hd" event={"ID":"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f","Type":"ContainerStarted","Data":"ff2c726e98f03053255885ffbceea897f87a9cda1d5c5fee7e77fa0a4f9ebc86"}
Sep 15 07:01:25.736987 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:25.736956    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:25.737204 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:25.737066    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9r6zz" podUID="8e7d8199-6790-4b03-bd95-5eeb637d2f99"
Sep 15 07:01:25.848911 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:25.848884    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 07:01:25.865404 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:25.865368    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr" event={"ID":"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50","Type":"ContainerStarted","Data":"c6b99fdee07074238203584de9c24fbe9b34ea63f7d6dcfa61426c34a9bfe55b"}
Sep 15 07:01:26.673139 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:26.673052    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T07:01:25.848909612Z","UUID":"caf53407-5dbe-4ecd-87df-115ed77ea244","Handler":null,"Name":"","Endpoint":""}
Sep 15 07:01:26.674625 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:26.674602    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 07:01:26.674625 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:26.674632    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 07:01:26.736526 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:26.736490    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:26.736640 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:26.736598    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dzpwd" podUID="7eaabe27-7956-4d37-abaa-d28ac2e47447"
Sep 15 07:01:26.736702 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:26.736649    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:26.736792 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:26.736747    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcldw" podUID="69bff7ef-8a76-40f8-9e5f-1ad219bf15b8"
Sep 15 07:01:26.871075 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:26.870911    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr" event={"ID":"e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50","Type":"ContainerStarted","Data":"7096b1154700d039f11caed4516b35c5c0aedb68894a563984c6bbcb8c868e07"}
Sep 15 07:01:26.876695 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:26.876666    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n92hd" event={"ID":"c97f88a6-f9a0-49bd-82a9-41ed2f617e8f","Type":"ContainerStarted","Data":"01f32e6c6f84e51f244d193e7260cc13916712fca59d613290ef50c4d591bdb7"}
Sep 15 07:01:26.877511 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:26.877323    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:26.877511 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:26.877399    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:26.877511 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:26.877449    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:26.894206 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:26.894007    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:26.895102 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:26.895076    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:01:26.913730 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:26.913302    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n92hd" podStartSLOduration=7.322803964 podStartE2EDuration="25.91327994s" totalImagesPullingTime="18.590475976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:01:26.91194863 +0000 UTC m=+26.702866476" watchObservedRunningTime="2026-09-15 07:01:26.91327994 +0000 UTC m=+26.704197766"
Sep 15 07:01:26.913730 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:26.913618    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btwkr" podStartSLOduration=6.791593602 podStartE2EDuration="25.913611507s" totalImagesPullingTime="19.122017905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:01:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:01:26.887735419 +0000 UTC m=+26.678653237" watchObservedRunningTime="2026-09-15 07:01:26.913611507 +0000 UTC m=+26.704529329"
Sep 15 07:01:27.214759 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:27.214674    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h5zdl"
Sep 15 07:01:27.215666 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:27.215638    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h5zdl"
Sep 15 07:01:27.736184 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:27.736142    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:27.736360 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:27.736265    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9r6zz" podUID="8e7d8199-6790-4b03-bd95-5eeb637d2f99"
Sep 15 07:01:27.879858 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:27.879758    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h5zdl"
Sep 15 07:01:27.880492 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:27.880471    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h5zdl"
Sep 15 07:01:28.736478 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:28.736440    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:28.736681 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:28.736452    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:28.736681 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:28.736553    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dzpwd" podUID="7eaabe27-7956-4d37-abaa-d28ac2e47447"
Sep 15 07:01:28.736681 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:28.736603    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcldw" podUID="69bff7ef-8a76-40f8-9e5f-1ad219bf15b8"
Sep 15 07:01:29.003816 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:29.003734    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tcldw"]
Sep 15 07:01:29.004316 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:29.003837    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:29.004316 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:29.003934    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcldw" podUID="69bff7ef-8a76-40f8-9e5f-1ad219bf15b8"
Sep 15 07:01:29.006639 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:29.006614    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9r6zz"]
Sep 15 07:01:29.006790 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:29.006725    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:29.006857 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:29.006807    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9r6zz" podUID="8e7d8199-6790-4b03-bd95-5eeb637d2f99"
Sep 15 07:01:29.007309 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:29.007287    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dzpwd"]
Sep 15 07:01:29.007413 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:29.007367    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:29.007472 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:29.007456    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dzpwd" podUID="7eaabe27-7956-4d37-abaa-d28ac2e47447"
Sep 15 07:01:29.884600 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:29.884565    2568 generic.go:356] "Generic (PLEG): container finished" podID="6a977870-0600-4a83-a169-6ed663e485ae" containerID="51c69c5f41cdf375786f51103d6ccbdf1e0c027d981f75118e506fc97fb23ad6" exitCode=0
Sep 15 07:01:29.884845 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:29.884642    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkzx6" event={"ID":"6a977870-0600-4a83-a169-6ed663e485ae","Type":"ContainerDied","Data":"51c69c5f41cdf375786f51103d6ccbdf1e0c027d981f75118e506fc97fb23ad6"}
Sep 15 07:01:30.737006 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:30.736973    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:30.737637 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:30.737060    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:30.737637 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:30.737082    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dzpwd" podUID="7eaabe27-7956-4d37-abaa-d28ac2e47447"
Sep 15 07:01:30.737637 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:30.737170    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9r6zz" podUID="8e7d8199-6790-4b03-bd95-5eeb637d2f99"
Sep 15 07:01:30.737637 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:30.737203    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:30.737637 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:30.737275    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcldw" podUID="69bff7ef-8a76-40f8-9e5f-1ad219bf15b8"
Sep 15 07:01:31.891683 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:31.891436    2568 generic.go:356] "Generic (PLEG): container finished" podID="6a977870-0600-4a83-a169-6ed663e485ae" containerID="b30365885ef13c4b1eed2feda66fd76bd79ad8028c14bd2a942961c32d0295d1" exitCode=0
Sep 15 07:01:31.891683 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:31.891513    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkzx6" event={"ID":"6a977870-0600-4a83-a169-6ed663e485ae","Type":"ContainerDied","Data":"b30365885ef13c4b1eed2feda66fd76bd79ad8028c14bd2a942961c32d0295d1"}
Sep 15 07:01:32.736304 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:32.736223    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:32.736447 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:32.736340    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dzpwd" podUID="7eaabe27-7956-4d37-abaa-d28ac2e47447"
Sep 15 07:01:32.736447 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:32.736393    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:32.736532 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:32.736468    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcldw" podUID="69bff7ef-8a76-40f8-9e5f-1ad219bf15b8"
Sep 15 07:01:32.736532 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:32.736222    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:32.736630 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:32.736603    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9r6zz" podUID="8e7d8199-6790-4b03-bd95-5eeb637d2f99"
Sep 15 07:01:33.899563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:33.899525    2568 generic.go:356] "Generic (PLEG): container finished" podID="6a977870-0600-4a83-a169-6ed663e485ae" containerID="f0f0716f05836cd7cc7f897197f69b6cbe126a0977dff1acb47f77e8aeb66d2c" exitCode=0
Sep 15 07:01:33.899964 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:33.899575    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkzx6" event={"ID":"6a977870-0600-4a83-a169-6ed663e485ae","Type":"ContainerDied","Data":"f0f0716f05836cd7cc7f897197f69b6cbe126a0977dff1acb47f77e8aeb66d2c"}
Sep 15 07:01:34.358399 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.358368    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb2dw\" (UniqueName: \"kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw\") pod \"network-check-target-tcldw\" (UID: \"69bff7ef-8a76-40f8-9e5f-1ad219bf15b8\") " pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:34.358535 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:34.358518    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 07:01:34.358577 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:34.358539    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 07:01:34.358577 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:34.358549    2568 projected.go:196] Error preparing data for projected volume kube-api-access-qb2dw for pod openshift-network-diagnostics/network-check-target-tcldw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:01:34.358651 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:34.358597    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw podName:69bff7ef-8a76-40f8-9e5f-1ad219bf15b8 nodeName:}" failed. No retries permitted until 2026-09-15 07:02:06.358582718 +0000 UTC m=+66.149500518 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qb2dw" (UniqueName: "kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw") pod "network-check-target-tcldw" (UID: "69bff7ef-8a76-40f8-9e5f-1ad219bf15b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:01:34.458773 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.458732    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs\") pod \"network-metrics-daemon-9r6zz\" (UID: \"8e7d8199-6790-4b03-bd95-5eeb637d2f99\") " pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:34.458949 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.458788    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret\") pod \"global-pull-secret-syncer-dzpwd\" (UID: \"7eaabe27-7956-4d37-abaa-d28ac2e47447\") " pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:34.458949 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:34.458898    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 07:01:34.459046 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:34.458969    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret podName:7eaabe27-7956-4d37-abaa-d28ac2e47447 nodeName:}" failed. No retries permitted until 2026-09-15 07:02:06.458948979 +0000 UTC m=+66.249866781 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret") pod "global-pull-secret-syncer-dzpwd" (UID: "7eaabe27-7956-4d37-abaa-d28ac2e47447") : object "kube-system"/"original-pull-secret" not registered
Sep 15 07:01:34.459046 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:34.458899    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:01:34.459133 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:34.459049    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs podName:8e7d8199-6790-4b03-bd95-5eeb637d2f99 nodeName:}" failed. No retries permitted until 2026-09-15 07:02:06.459032286 +0000 UTC m=+66.249950090 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs") pod "network-metrics-daemon-9r6zz" (UID: "8e7d8199-6790-4b03-bd95-5eeb637d2f99") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:01:34.563694 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.563662    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeReady"
Sep 15 07:01:34.563997 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.563811    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 07:01:34.599150 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.599098    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"]
Sep 15 07:01:34.601747 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.601706    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5df6c7b697-6fm58"]
Sep 15 07:01:34.601880 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.601863    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"
Sep 15 07:01:34.604741 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.604700    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 15 07:01:34.604861 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.604762    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.605058 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.605039    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-l7nqg\""
Sep 15 07:01:34.605145 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.605081    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 15 07:01:34.607028 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.607007    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-987jx\""
Sep 15 07:01:34.607250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.607225    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 15 07:01:34.607362 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.607260    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 15 07:01:34.607603 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.607586    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 15 07:01:34.613466 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.613448    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vvw8v"]
Sep 15 07:01:34.614321 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.614153    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 15 07:01:34.618050 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.617563    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"]
Sep 15 07:01:34.618050 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.617597    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5df6c7b697-6fm58"]
Sep 15 07:01:34.618050 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.617681    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:01:34.618653 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.618095    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lvw2b"]
Sep 15 07:01:34.620346 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.620326    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hpf95\""
Sep 15 07:01:34.620663 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.620644    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 07:01:34.621265 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.620646    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 07:01:34.622327 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.622308    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lvw2b"
Sep 15 07:01:34.624782 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.624753    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ks7r9\""
Sep 15 07:01:34.624891 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.624794    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 07:01:34.624891 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.624827    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 07:01:34.625265 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.625246    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 07:01:34.634659 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.634236    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vvw8v"]
Sep 15 07:01:34.636885 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.636864    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lvw2b"]
Sep 15 07:01:34.737123 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.737089    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:01:34.737540 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.737431    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:01:34.737540 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.737506    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:01:34.740261 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.740237    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 07:01:34.740514 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.740489    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 07:01:34.740599 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.740544    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 07:01:34.740864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.740840    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l7trv\""
Sep 15 07:01:34.740864 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.740854    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 07:01:34.741045 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.741022    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h7d9j\""
Sep 15 07:01:34.761170 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.761147    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bz528\" (UID: \"16f5f861-0b53-462e-bb9b-4727524236ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"
Sep 15 07:01:34.761268 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.761186    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.761268 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.761222    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/16f5f861-0b53-462e-bb9b-4727524236ba-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-bz528\" (UID: \"16f5f861-0b53-462e-bb9b-4727524236ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"
Sep 15 07:01:34.761268 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.761246    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b4fdda1-c7ea-4720-992f-a125c1ba938d-trusted-ca\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.761421 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.761271    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b4fdda1-c7ea-4720-992f-a125c1ba938d-ca-trust-extracted\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.761421 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.761328    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/371738e8-15d1-4b74-8c57-572edc740b7d-tmp-dir\") pod \"dns-default-vvw8v\" (UID: \"371738e8-15d1-4b74-8c57-572edc740b7d\") " pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:01:34.761421 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.761373    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/371738e8-15d1-4b74-8c57-572edc740b7d-config-volume\") pod \"dns-default-vvw8v\" (UID: \"371738e8-15d1-4b74-8c57-572edc740b7d\") " pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:01:34.761561 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.761433    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49mfb\" (UniqueName: \"kubernetes.io/projected/371738e8-15d1-4b74-8c57-572edc740b7d-kube-api-access-49mfb\") pod \"dns-default-vvw8v\" (UID: \"371738e8-15d1-4b74-8c57-572edc740b7d\") " pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:01:34.761561 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.761461    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d13caa1-05ce-4c88-becc-5632369bf463-cert\") pod \"ingress-canary-lvw2b\" (UID: \"1d13caa1-05ce-4c88-becc-5632369bf463\") " pod="openshift-ingress-canary/ingress-canary-lvw2b"
Sep 15 07:01:34.761561 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.761484    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-certificates\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.761561 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.761527    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b4fdda1-c7ea-4720-992f-a125c1ba938d-image-registry-private-configuration\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.761743 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.761568    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tgv8\" (UniqueName: \"kubernetes.io/projected/1d13caa1-05ce-4c88-becc-5632369bf463-kube-api-access-8tgv8\") pod \"ingress-canary-lvw2b\" (UID: \"1d13caa1-05ce-4c88-becc-5632369bf463\") " pod="openshift-ingress-canary/ingress-canary-lvw2b"
Sep 15 07:01:34.761743 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.761615    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls\") pod \"dns-default-vvw8v\" (UID: \"371738e8-15d1-4b74-8c57-572edc740b7d\") " pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:01:34.761743 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.761656    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qs7h\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-kube-api-access-5qs7h\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.761743 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.761701    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b4fdda1-c7ea-4720-992f-a125c1ba938d-installation-pull-secrets\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.761870 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.761745    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-bound-sa-token\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.862648 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.862561    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls\") pod \"dns-default-vvw8v\" (UID: \"371738e8-15d1-4b74-8c57-572edc740b7d\") " pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:01:34.862648 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.862606    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qs7h\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-kube-api-access-5qs7h\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.862648 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.862639    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b4fdda1-c7ea-4720-992f-a125c1ba938d-installation-pull-secrets\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.862948 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:34.862755    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 07:01:34.862948 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.862765    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-bound-sa-token\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.862948 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:34.862842    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls podName:371738e8-15d1-4b74-8c57-572edc740b7d nodeName:}" failed. No retries permitted until 2026-09-15 07:01:35.362820591 +0000 UTC m=+35.153738396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls") pod "dns-default-vvw8v" (UID: "371738e8-15d1-4b74-8c57-572edc740b7d") : secret "dns-default-metrics-tls" not found
Sep 15 07:01:34.862948 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.862889    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bz528\" (UID: \"16f5f861-0b53-462e-bb9b-4727524236ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"
Sep 15 07:01:34.862948 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.862919    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.863203 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.862955    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/16f5f861-0b53-462e-bb9b-4727524236ba-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-bz528\" (UID: \"16f5f861-0b53-462e-bb9b-4727524236ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"
Sep 15 07:01:34.863203 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.862980    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b4fdda1-c7ea-4720-992f-a125c1ba938d-trusted-ca\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.863203 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.863008    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b4fdda1-c7ea-4720-992f-a125c1ba938d-ca-trust-extracted\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.863203 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.863034    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/371738e8-15d1-4b74-8c57-572edc740b7d-tmp-dir\") pod \"dns-default-vvw8v\" (UID: \"371738e8-15d1-4b74-8c57-572edc740b7d\") " pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:01:34.863203 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.863063    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/371738e8-15d1-4b74-8c57-572edc740b7d-config-volume\") pod \"dns-default-vvw8v\" (UID: \"371738e8-15d1-4b74-8c57-572edc740b7d\") " pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:01:34.863203 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:34.863090    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 07:01:34.863203 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.863129    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49mfb\" (UniqueName: \"kubernetes.io/projected/371738e8-15d1-4b74-8c57-572edc740b7d-kube-api-access-49mfb\") pod \"dns-default-vvw8v\" (UID: \"371738e8-15d1-4b74-8c57-572edc740b7d\") " pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:01:34.863203 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:34.863163    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert podName:16f5f861-0b53-462e-bb9b-4727524236ba nodeName:}" failed. No retries permitted until 2026-09-15 07:01:35.363145903 +0000 UTC m=+35.154063719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-bz528" (UID: "16f5f861-0b53-462e-bb9b-4727524236ba") : secret "networking-console-plugin-cert" not found
Sep 15 07:01:34.863203 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.863185    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d13caa1-05ce-4c88-becc-5632369bf463-cert\") pod \"ingress-canary-lvw2b\" (UID: \"1d13caa1-05ce-4c88-becc-5632369bf463\") " pod="openshift-ingress-canary/ingress-canary-lvw2b"
Sep 15 07:01:34.863624 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.863215    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-certificates\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.863624 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.863276    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b4fdda1-c7ea-4720-992f-a125c1ba938d-image-registry-private-configuration\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.863624 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.863307    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tgv8\" (UniqueName: \"kubernetes.io/projected/1d13caa1-05ce-4c88-becc-5632369bf463-kube-api-access-8tgv8\") pod \"ingress-canary-lvw2b\" (UID: \"1d13caa1-05ce-4c88-becc-5632369bf463\") " pod="openshift-ingress-canary/ingress-canary-lvw2b"
Sep 15 07:01:34.863624 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.863476    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b4fdda1-c7ea-4720-992f-a125c1ba938d-ca-trust-extracted\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.863624 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.863613    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/371738e8-15d1-4b74-8c57-572edc740b7d-tmp-dir\") pod \"dns-default-vvw8v\" (UID: \"371738e8-15d1-4b74-8c57-572edc740b7d\") " pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:01:34.863978 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.863953    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-certificates\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.864099 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.863992    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/371738e8-15d1-4b74-8c57-572edc740b7d-config-volume\") pod \"dns-default-vvw8v\" (UID: \"371738e8-15d1-4b74-8c57-572edc740b7d\") " pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:01:34.864099 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.864004    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b4fdda1-c7ea-4720-992f-a125c1ba938d-trusted-ca\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.864190 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:34.864156    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 07:01:34.864190 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:34.864167    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5df6c7b697-6fm58: secret "image-registry-tls" not found
Sep 15 07:01:34.864271 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:34.864198    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls podName:4b4fdda1-c7ea-4720-992f-a125c1ba938d nodeName:}" failed. No retries permitted until 2026-09-15 07:01:35.364187611 +0000 UTC m=+35.155105409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls") pod "image-registry-5df6c7b697-6fm58" (UID: "4b4fdda1-c7ea-4720-992f-a125c1ba938d") : secret "image-registry-tls" not found
Sep 15 07:01:34.864514 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.864490    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/16f5f861-0b53-462e-bb9b-4727524236ba-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-bz528\" (UID: \"16f5f861-0b53-462e-bb9b-4727524236ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"
Sep 15 07:01:34.867581 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.867555    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b4fdda1-c7ea-4720-992f-a125c1ba938d-installation-pull-secrets\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.867692 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.867672    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d13caa1-05ce-4c88-becc-5632369bf463-cert\") pod \"ingress-canary-lvw2b\" (UID: \"1d13caa1-05ce-4c88-becc-5632369bf463\") " pod="openshift-ingress-canary/ingress-canary-lvw2b"
Sep 15 07:01:34.867779 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.867696    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b4fdda1-c7ea-4720-992f-a125c1ba938d-image-registry-private-configuration\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.873422 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.873396    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49mfb\" (UniqueName: \"kubernetes.io/projected/371738e8-15d1-4b74-8c57-572edc740b7d-kube-api-access-49mfb\") pod \"dns-default-vvw8v\" (UID: \"371738e8-15d1-4b74-8c57-572edc740b7d\") " pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:01:34.874133 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.874094    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qs7h\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-kube-api-access-5qs7h\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.875069 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.875048    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-bound-sa-token\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:34.875385 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.875359    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tgv8\" (UniqueName: \"kubernetes.io/projected/1d13caa1-05ce-4c88-becc-5632369bf463-kube-api-access-8tgv8\") pod \"ingress-canary-lvw2b\" (UID: \"1d13caa1-05ce-4c88-becc-5632369bf463\") " pod="openshift-ingress-canary/ingress-canary-lvw2b"
Sep 15 07:01:34.940089 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:34.940061    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lvw2b"
Sep 15 07:01:35.222843 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:35.222574    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lvw2b"]
Sep 15 07:01:35.227200 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:01:35.227162    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d13caa1_05ce_4c88_becc_5632369bf463.slice/crio-a869409eab1bbc486e883b09d3f641d9a5c89db391763a9a42a6077b31d9f9b9 WatchSource:0}: Error finding container a869409eab1bbc486e883b09d3f641d9a5c89db391763a9a42a6077b31d9f9b9: Status 404 returned error can't find the container with id a869409eab1bbc486e883b09d3f641d9a5c89db391763a9a42a6077b31d9f9b9
Sep 15 07:01:35.367045 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:35.367015    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls\") pod \"dns-default-vvw8v\" (UID: \"371738e8-15d1-4b74-8c57-572edc740b7d\") " pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:01:35.367227 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:35.367052    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bz528\" (UID: \"16f5f861-0b53-462e-bb9b-4727524236ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"
Sep 15 07:01:35.367227 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:35.367072    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:35.367227 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:35.367180    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 07:01:35.367377 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:35.367265    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert podName:16f5f861-0b53-462e-bb9b-4727524236ba nodeName:}" failed. No retries permitted until 2026-09-15 07:01:36.367241955 +0000 UTC m=+36.158159754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-bz528" (UID: "16f5f861-0b53-462e-bb9b-4727524236ba") : secret "networking-console-plugin-cert" not found
Sep 15 07:01:35.367377 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:35.367180    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 07:01:35.367377 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:35.367326    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls podName:371738e8-15d1-4b74-8c57-572edc740b7d nodeName:}" failed. No retries permitted until 2026-09-15 07:01:36.367309956 +0000 UTC m=+36.158227772 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls") pod "dns-default-vvw8v" (UID: "371738e8-15d1-4b74-8c57-572edc740b7d") : secret "dns-default-metrics-tls" not found
Sep 15 07:01:35.367377 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:35.367184    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 07:01:35.367377 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:35.367343    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5df6c7b697-6fm58: secret "image-registry-tls" not found
Sep 15 07:01:35.367377 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:35.367377    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls podName:4b4fdda1-c7ea-4720-992f-a125c1ba938d nodeName:}" failed. No retries permitted until 2026-09-15 07:01:36.367368452 +0000 UTC m=+36.158286251 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls") pod "image-registry-5df6c7b697-6fm58" (UID: "4b4fdda1-c7ea-4720-992f-a125c1ba938d") : secret "image-registry-tls" not found
Sep 15 07:01:35.905984 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:35.905952    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lvw2b" event={"ID":"1d13caa1-05ce-4c88-becc-5632369bf463","Type":"ContainerStarted","Data":"a869409eab1bbc486e883b09d3f641d9a5c89db391763a9a42a6077b31d9f9b9"}
Sep 15 07:01:36.376382 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:36.376350    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls\") pod \"dns-default-vvw8v\" (UID: \"371738e8-15d1-4b74-8c57-572edc740b7d\") " pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:01:36.377076 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:36.376405    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bz528\" (UID: \"16f5f861-0b53-462e-bb9b-4727524236ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"
Sep 15 07:01:36.377076 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:36.376489    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 07:01:36.377076 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:36.376495    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 07:01:36.377076 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:36.376530    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:36.377076 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:36.376545    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert podName:16f5f861-0b53-462e-bb9b-4727524236ba nodeName:}" failed. No retries permitted until 2026-09-15 07:01:38.376528568 +0000 UTC m=+38.167446383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-bz528" (UID: "16f5f861-0b53-462e-bb9b-4727524236ba") : secret "networking-console-plugin-cert" not found
Sep 15 07:01:36.377076 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:36.376603    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls podName:371738e8-15d1-4b74-8c57-572edc740b7d nodeName:}" failed. No retries permitted until 2026-09-15 07:01:38.376589076 +0000 UTC m=+38.167506879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls") pod "dns-default-vvw8v" (UID: "371738e8-15d1-4b74-8c57-572edc740b7d") : secret "dns-default-metrics-tls" not found
Sep 15 07:01:36.377076 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:36.376635    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 07:01:36.377076 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:36.376653    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5df6c7b697-6fm58: secret "image-registry-tls" not found
Sep 15 07:01:36.377076 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:36.376758    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls podName:4b4fdda1-c7ea-4720-992f-a125c1ba938d nodeName:}" failed. No retries permitted until 2026-09-15 07:01:38.37672907 +0000 UTC m=+38.167646881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls") pod "image-registry-5df6c7b697-6fm58" (UID: "4b4fdda1-c7ea-4720-992f-a125c1ba938d") : secret "image-registry-tls" not found
Sep 15 07:01:36.834004 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:36.833821    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h5zdl_fbc008a1-b0d8-45d4-aa3a-adf819a127af/konnectivity-agent/0.log" limit=1024
Sep 15 07:01:36.917989 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:36.917947    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h5zdl_fbc008a1-b0d8-45d4-aa3a-adf819a127af/konnectivity-agent/0.log" limit=1024
Sep 15 07:01:38.393435 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:38.393393    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bz528\" (UID: \"16f5f861-0b53-462e-bb9b-4727524236ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"
Sep 15 07:01:38.394075 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:38.393443    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:38.394075 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:38.393540    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls\") pod \"dns-default-vvw8v\" (UID: \"371738e8-15d1-4b74-8c57-572edc740b7d\") " pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:01:38.394075 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:38.393566    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 07:01:38.394075 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:38.393648    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 07:01:38.394075 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:38.393653    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 07:01:38.394075 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:38.393674    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5df6c7b697-6fm58: secret "image-registry-tls" not found
Sep 15 07:01:38.394075 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:38.393655    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert podName:16f5f861-0b53-462e-bb9b-4727524236ba nodeName:}" failed. No retries permitted until 2026-09-15 07:01:42.393634035 +0000 UTC m=+42.184551856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-bz528" (UID: "16f5f861-0b53-462e-bb9b-4727524236ba") : secret "networking-console-plugin-cert" not found
Sep 15 07:01:38.394075 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:38.393759    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls podName:371738e8-15d1-4b74-8c57-572edc740b7d nodeName:}" failed. No retries permitted until 2026-09-15 07:01:42.393738 +0000 UTC m=+42.184655800 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls") pod "dns-default-vvw8v" (UID: "371738e8-15d1-4b74-8c57-572edc740b7d") : secret "dns-default-metrics-tls" not found
Sep 15 07:01:38.394075 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:38.393777    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls podName:4b4fdda1-c7ea-4720-992f-a125c1ba938d nodeName:}" failed. No retries permitted until 2026-09-15 07:01:42.393767877 +0000 UTC m=+42.184685676 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls") pod "image-registry-5df6c7b697-6fm58" (UID: "4b4fdda1-c7ea-4720-992f-a125c1ba938d") : secret "image-registry-tls" not found
Sep 15 07:01:39.397008 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:39.396825    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h5zdl_fbc008a1-b0d8-45d4-aa3a-adf819a127af/konnectivity-agent/0.log" limit=1024
Sep 15 07:01:39.453553 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:39.453527    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h5zdl_fbc008a1-b0d8-45d4-aa3a-adf819a127af/konnectivity-agent/0.log" limit=1024
Sep 15 07:01:39.922394 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:39.922360    2568 generic.go:356] "Generic (PLEG): container finished" podID="6a977870-0600-4a83-a169-6ed663e485ae" containerID="61d279c6b838563aa37e01e6e3433311acaabee339a0faf5f8b3c12eee37e9c7" exitCode=0
Sep 15 07:01:39.922569 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:39.922432    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkzx6" event={"ID":"6a977870-0600-4a83-a169-6ed663e485ae","Type":"ContainerDied","Data":"61d279c6b838563aa37e01e6e3433311acaabee339a0faf5f8b3c12eee37e9c7"}
Sep 15 07:01:39.923991 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:39.923973    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lvw2b" event={"ID":"1d13caa1-05ce-4c88-becc-5632369bf463","Type":"ContainerStarted","Data":"0afa60ef43fd8507d0b11f0b673b910148aeeafefc2913a9b30cdc3e8e81aa7f"}
Sep 15 07:01:39.954414 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:39.954374    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lvw2b" podStartSLOduration=1.801207079 podStartE2EDuration="5.954362577s" totalImagesPullingTime="4.153155498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:01:39.954134344 +0000 UTC m=+39.745052166" watchObservedRunningTime="2026-09-15 07:01:39.954362577 +0000 UTC m=+39.745280421"
Sep 15 07:01:40.929396 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:40.929359    2568 generic.go:356] "Generic (PLEG): container finished" podID="6a977870-0600-4a83-a169-6ed663e485ae" containerID="3f790fe0f9e320f8a35a30fcb9b0773449e2b0e44aba9791252023fd43a77551" exitCode=0
Sep 15 07:01:40.929786 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:40.929444    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkzx6" event={"ID":"6a977870-0600-4a83-a169-6ed663e485ae","Type":"ContainerDied","Data":"3f790fe0f9e320f8a35a30fcb9b0773449e2b0e44aba9791252023fd43a77551"}
Sep 15 07:01:41.934602 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:41.934570    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tkzx6" event={"ID":"6a977870-0600-4a83-a169-6ed663e485ae","Type":"ContainerStarted","Data":"7a105d6173af2c78ea9ab31e9505618fd793b928b9098e37c44b64b78d720fa5"}
Sep 15 07:01:41.955515 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:41.955469    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tkzx6" podStartSLOduration=8.274985482 podStartE2EDuration="40.955456555s" totalImagesPullingTime="32.680471073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:01:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:01:41.95406277 +0000 UTC m=+41.744980591" watchObservedRunningTime="2026-09-15 07:01:41.955456555 +0000 UTC m=+41.746374378"
Sep 15 07:01:42.425406 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:42.425368    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls\") pod \"dns-default-vvw8v\" (UID: \"371738e8-15d1-4b74-8c57-572edc740b7d\") " pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:01:42.425554 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:42.425420    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bz528\" (UID: \"16f5f861-0b53-462e-bb9b-4727524236ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"
Sep 15 07:01:42.425554 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:42.425517    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:42.425554 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:42.425534    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 07:01:42.425654 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:42.425590    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 07:01:42.425654 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:42.425612    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 07:01:42.425654 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:42.425624    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5df6c7b697-6fm58: secret "image-registry-tls" not found
Sep 15 07:01:42.425654 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:42.425599    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls podName:371738e8-15d1-4b74-8c57-572edc740b7d nodeName:}" failed. No retries permitted until 2026-09-15 07:01:50.425579265 +0000 UTC m=+50.216497079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls") pod "dns-default-vvw8v" (UID: "371738e8-15d1-4b74-8c57-572edc740b7d") : secret "dns-default-metrics-tls" not found
Sep 15 07:01:42.425654 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:42.425653    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert podName:16f5f861-0b53-462e-bb9b-4727524236ba nodeName:}" failed. No retries permitted until 2026-09-15 07:01:50.425637853 +0000 UTC m=+50.216555660 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-bz528" (UID: "16f5f861-0b53-462e-bb9b-4727524236ba") : secret "networking-console-plugin-cert" not found
Sep 15 07:01:42.425839 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:42.425672    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls podName:4b4fdda1-c7ea-4720-992f-a125c1ba938d nodeName:}" failed. No retries permitted until 2026-09-15 07:01:50.425663484 +0000 UTC m=+50.216581287 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls") pod "image-registry-5df6c7b697-6fm58" (UID: "4b4fdda1-c7ea-4720-992f-a125c1ba938d") : secret "image-registry-tls" not found
Sep 15 07:01:43.738351 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:43.738317    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h5zdl_fbc008a1-b0d8-45d4-aa3a-adf819a127af/konnectivity-agent/0.log" limit=1024
Sep 15 07:01:43.789505 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:43.789468    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h5zdl_fbc008a1-b0d8-45d4-aa3a-adf819a127af/konnectivity-agent/0.log" limit=1024
Sep 15 07:01:50.486128 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:50.486091    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls\") pod \"dns-default-vvw8v\" (UID: \"371738e8-15d1-4b74-8c57-572edc740b7d\") " pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:01:50.486536 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:50.486135    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bz528\" (UID: \"16f5f861-0b53-462e-bb9b-4727524236ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"
Sep 15 07:01:50.486536 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:50.486155    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:01:50.486536 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:50.486242    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 07:01:50.486536 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:50.486256    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 07:01:50.486536 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:50.486272    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5df6c7b697-6fm58: secret "image-registry-tls" not found
Sep 15 07:01:50.486536 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:50.486252    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 07:01:50.486536 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:50.486305    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls podName:371738e8-15d1-4b74-8c57-572edc740b7d nodeName:}" failed. No retries permitted until 2026-09-15 07:02:06.486289148 +0000 UTC m=+66.277206946 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls") pod "dns-default-vvw8v" (UID: "371738e8-15d1-4b74-8c57-572edc740b7d") : secret "dns-default-metrics-tls" not found
Sep 15 07:01:50.486536 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:50.486329    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls podName:4b4fdda1-c7ea-4720-992f-a125c1ba938d nodeName:}" failed. No retries permitted until 2026-09-15 07:02:06.486313712 +0000 UTC m=+66.277231511 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls") pod "image-registry-5df6c7b697-6fm58" (UID: "4b4fdda1-c7ea-4720-992f-a125c1ba938d") : secret "image-registry-tls" not found
Sep 15 07:01:50.486536 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:01:50.486345    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert podName:16f5f861-0b53-462e-bb9b-4727524236ba nodeName:}" failed. No retries permitted until 2026-09-15 07:02:06.4863366 +0000 UTC m=+66.277254399 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-bz528" (UID: "16f5f861-0b53-462e-bb9b-4727524236ba") : secret "networking-console-plugin-cert" not found
Sep 15 07:01:58.890767 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:01:58.890737    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n92hd"
Sep 15 07:02:06.395901 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:06.395841    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb2dw\" (UniqueName: \"kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw\") pod \"network-check-target-tcldw\" (UID: \"69bff7ef-8a76-40f8-9e5f-1ad219bf15b8\") " pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:02:06.398063 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:06.398045    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 07:02:06.408583 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:06.408567    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 07:02:06.420064 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:06.420045    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb2dw\" (UniqueName: \"kubernetes.io/projected/69bff7ef-8a76-40f8-9e5f-1ad219bf15b8-kube-api-access-qb2dw\") pod \"network-check-target-tcldw\" (UID: \"69bff7ef-8a76-40f8-9e5f-1ad219bf15b8\") " pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:02:06.496478 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:06.496433    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls\") pod \"dns-default-vvw8v\" (UID: \"371738e8-15d1-4b74-8c57-572edc740b7d\") " pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:02:06.496478 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:06.496487    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bz528\" (UID: \"16f5f861-0b53-462e-bb9b-4727524236ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"
Sep 15 07:02:06.496641 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:06.496526    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:02:06.496641 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:06.496560    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs\") pod \"network-metrics-daemon-9r6zz\" (UID: \"8e7d8199-6790-4b03-bd95-5eeb637d2f99\") " pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:02:06.496641 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:02:06.496585    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 07:02:06.496813 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:02:06.496646    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert podName:16f5f861-0b53-462e-bb9b-4727524236ba nodeName:}" failed. No retries permitted until 2026-09-15 07:02:38.496631645 +0000 UTC m=+98.287549443 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-bz528" (UID: "16f5f861-0b53-462e-bb9b-4727524236ba") : secret "networking-console-plugin-cert" not found
Sep 15 07:02:06.496813 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:02:06.496660    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 07:02:06.496813 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:02:06.496675    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5df6c7b697-6fm58: secret "image-registry-tls" not found
Sep 15 07:02:06.496813 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:02:06.496738    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls podName:4b4fdda1-c7ea-4720-992f-a125c1ba938d nodeName:}" failed. No retries permitted until 2026-09-15 07:02:38.496726376 +0000 UTC m=+98.287644187 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls") pod "image-registry-5df6c7b697-6fm58" (UID: "4b4fdda1-c7ea-4720-992f-a125c1ba938d") : secret "image-registry-tls" not found
Sep 15 07:02:06.496813 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:02:06.496753    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 07:02:06.497071 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:02:06.496821    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls podName:371738e8-15d1-4b74-8c57-572edc740b7d nodeName:}" failed. No retries permitted until 2026-09-15 07:02:38.496803753 +0000 UTC m=+98.287721566 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls") pod "dns-default-vvw8v" (UID: "371738e8-15d1-4b74-8c57-572edc740b7d") : secret "dns-default-metrics-tls" not found
Sep 15 07:02:06.497071 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:06.496848    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret\") pod \"global-pull-secret-syncer-dzpwd\" (UID: \"7eaabe27-7956-4d37-abaa-d28ac2e47447\") " pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:02:06.499396 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:06.499376    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 07:02:06.499488 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:06.499412    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 07:02:06.507379 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:02:06.507363    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 15 07:02:06.507442 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:02:06.507413    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs podName:8e7d8199-6790-4b03-bd95-5eeb637d2f99 nodeName:}" failed. No retries permitted until 2026-09-15 07:03:10.507402246 +0000 UTC m=+130.298320045 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs") pod "network-metrics-daemon-9r6zz" (UID: "8e7d8199-6790-4b03-bd95-5eeb637d2f99") : secret "metrics-daemon-secret" not found
Sep 15 07:02:06.509320 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:06.509302    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7eaabe27-7956-4d37-abaa-d28ac2e47447-original-pull-secret\") pod \"global-pull-secret-syncer-dzpwd\" (UID: \"7eaabe27-7956-4d37-abaa-d28ac2e47447\") " pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:02:06.549150 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:06.549129    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dzpwd"
Sep 15 07:02:06.557815 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:06.557792    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l7trv\""
Sep 15 07:02:06.565798 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:06.565770    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:02:06.815899 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:06.815872    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dzpwd"]
Sep 15 07:02:06.819220 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:02:06.819192    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eaabe27_7956_4d37_abaa_d28ac2e47447.slice/crio-cfd275fb774c2d69ef6b2a427cbc86546ffdc542c2c0d9090173a0f5feff16f2 WatchSource:0}: Error finding container cfd275fb774c2d69ef6b2a427cbc86546ffdc542c2c0d9090173a0f5feff16f2: Status 404 returned error can't find the container with id cfd275fb774c2d69ef6b2a427cbc86546ffdc542c2c0d9090173a0f5feff16f2
Sep 15 07:02:06.833333 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:06.833310    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tcldw"]
Sep 15 07:02:06.835917 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:02:06.835897    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69bff7ef_8a76_40f8_9e5f_1ad219bf15b8.slice/crio-1b5ce064a5551966b0823deca902b9866fe39d2dc1d279d35c21e0a087035280 WatchSource:0}: Error finding container 1b5ce064a5551966b0823deca902b9866fe39d2dc1d279d35c21e0a087035280: Status 404 returned error can't find the container with id 1b5ce064a5551966b0823deca902b9866fe39d2dc1d279d35c21e0a087035280
Sep 15 07:02:06.993078 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:06.993044    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tcldw" event={"ID":"69bff7ef-8a76-40f8-9e5f-1ad219bf15b8","Type":"ContainerStarted","Data":"1b5ce064a5551966b0823deca902b9866fe39d2dc1d279d35c21e0a087035280"}
Sep 15 07:02:06.994204 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:06.994181    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dzpwd" event={"ID":"7eaabe27-7956-4d37-abaa-d28ac2e47447","Type":"ContainerStarted","Data":"cfd275fb774c2d69ef6b2a427cbc86546ffdc542c2c0d9090173a0f5feff16f2"}
Sep 15 07:02:12.011045 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:12.011002    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tcldw" event={"ID":"69bff7ef-8a76-40f8-9e5f-1ad219bf15b8","Type":"ContainerStarted","Data":"5b448fbb84a75ca50b0451882b0daeae792b9214ae525a40bc979c9b5a8d27e0"}
Sep 15 07:02:12.011477 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:12.011125    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:02:12.012652 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:12.012629    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dzpwd" event={"ID":"7eaabe27-7956-4d37-abaa-d28ac2e47447","Type":"ContainerStarted","Data":"09795637f4f313fcc4496a2e2a66253d4185ab6c7754521103e47e89850d2f7a"}
Sep 15 07:02:12.027631 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:12.027587    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tcldw" podStartSLOduration=66.418731687 podStartE2EDuration="1m11.027574312s" totalImagesPullingTime="4.608842625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:02:12.027216563 +0000 UTC m=+71.818134384" watchObservedRunningTime="2026-09-15 07:02:12.027574312 +0000 UTC m=+71.818492124"
Sep 15 07:02:12.041924 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:12.041887    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dzpwd" podStartSLOduration=66.411018986 podStartE2EDuration="1m11.041874157s" totalImagesPullingTime="4.630855171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:02:12.041295747 +0000 UTC m=+71.832213569" watchObservedRunningTime="2026-09-15 07:02:12.041874157 +0000 UTC m=+71.832791977"
Sep 15 07:02:38.513131 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:38.513093    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls\") pod \"dns-default-vvw8v\" (UID: \"371738e8-15d1-4b74-8c57-572edc740b7d\") " pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:02:38.513593 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:38.513137    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bz528\" (UID: \"16f5f861-0b53-462e-bb9b-4727524236ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"
Sep 15 07:02:38.513593 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:38.513156    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:02:38.513593 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:02:38.513220    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 07:02:38.513593 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:02:38.513267    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 07:02:38.513593 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:02:38.513305    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls podName:371738e8-15d1-4b74-8c57-572edc740b7d nodeName:}" failed. No retries permitted until 2026-09-15 07:03:42.513283762 +0000 UTC m=+162.304201565 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls") pod "dns-default-vvw8v" (UID: "371738e8-15d1-4b74-8c57-572edc740b7d") : secret "dns-default-metrics-tls" not found
Sep 15 07:02:38.513593 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:02:38.513235    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 07:02:38.513593 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:02:38.513326    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert podName:16f5f861-0b53-462e-bb9b-4727524236ba nodeName:}" failed. No retries permitted until 2026-09-15 07:03:42.513313868 +0000 UTC m=+162.304231671 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-bz528" (UID: "16f5f861-0b53-462e-bb9b-4727524236ba") : secret "networking-console-plugin-cert" not found
Sep 15 07:02:38.513593 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:02:38.513328    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5df6c7b697-6fm58: secret "image-registry-tls" not found
Sep 15 07:02:38.513593 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:02:38.513362    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls podName:4b4fdda1-c7ea-4720-992f-a125c1ba938d nodeName:}" failed. No retries permitted until 2026-09-15 07:03:42.513354708 +0000 UTC m=+162.304272507 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls") pod "image-registry-5df6c7b697-6fm58" (UID: "4b4fdda1-c7ea-4720-992f-a125c1ba938d") : secret "image-registry-tls" not found
Sep 15 07:02:43.017402 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:02:43.017372    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tcldw"
Sep 15 07:03:10.532158 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:03:10.532120    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs\") pod \"network-metrics-daemon-9r6zz\" (UID: \"8e7d8199-6790-4b03-bd95-5eeb637d2f99\") " pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:03:10.532606 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:03:10.532257    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 15 07:03:10.532606 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:03:10.532319    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs podName:8e7d8199-6790-4b03-bd95-5eeb637d2f99 nodeName:}" failed. No retries permitted until 2026-09-15 07:05:12.532301266 +0000 UTC m=+252.323219085 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs") pod "network-metrics-daemon-9r6zz" (UID: "8e7d8199-6790-4b03-bd95-5eeb637d2f99") : secret "metrics-daemon-secret" not found
Sep 15 07:03:37.613383 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:03:37.613327    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528" podUID="16f5f861-0b53-462e-bb9b-4727524236ba"
Sep 15 07:03:37.621494 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:03:37.621462    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5df6c7b697-6fm58" podUID="4b4fdda1-c7ea-4720-992f-a125c1ba938d"
Sep 15 07:03:37.631751 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:03:37.631729    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vvw8v" podUID="371738e8-15d1-4b74-8c57-572edc740b7d"
Sep 15 07:03:37.761478 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:03:37.761441    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9r6zz" podUID="8e7d8199-6790-4b03-bd95-5eeb637d2f99"
Sep 15 07:03:38.216256 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:03:38.216222    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"
Sep 15 07:03:38.216420 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:03:38.216222    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:03:38.216420 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:03:38.216221    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:03:42.560505 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:03:42.560465    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls\") pod \"dns-default-vvw8v\" (UID: \"371738e8-15d1-4b74-8c57-572edc740b7d\") " pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:03:42.560505 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:03:42.560510    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bz528\" (UID: \"16f5f861-0b53-462e-bb9b-4727524236ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"
Sep 15 07:03:42.561036 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:03:42.560531    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:03:42.561036 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:03:42.560610    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 07:03:42.561036 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:03:42.560632    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 07:03:42.561036 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:03:42.560642    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5df6c7b697-6fm58: secret "image-registry-tls" not found
Sep 15 07:03:42.561036 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:03:42.560616    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 07:03:42.561036 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:03:42.560688    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls podName:371738e8-15d1-4b74-8c57-572edc740b7d nodeName:}" failed. No retries permitted until 2026-09-15 07:05:44.560672583 +0000 UTC m=+284.351590387 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls") pod "dns-default-vvw8v" (UID: "371738e8-15d1-4b74-8c57-572edc740b7d") : secret "dns-default-metrics-tls" not found
Sep 15 07:03:42.561036 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:03:42.560704    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls podName:4b4fdda1-c7ea-4720-992f-a125c1ba938d nodeName:}" failed. No retries permitted until 2026-09-15 07:05:44.56069689 +0000 UTC m=+284.351614689 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls") pod "image-registry-5df6c7b697-6fm58" (UID: "4b4fdda1-c7ea-4720-992f-a125c1ba938d") : secret "image-registry-tls" not found
Sep 15 07:03:42.561036 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:03:42.560728    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert podName:16f5f861-0b53-462e-bb9b-4727524236ba nodeName:}" failed. No retries permitted until 2026-09-15 07:05:44.560722701 +0000 UTC m=+284.351640513 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-bz528" (UID: "16f5f861-0b53-462e-bb9b-4727524236ba") : secret "networking-console-plugin-cert" not found
Sep 15 07:03:50.737484 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:03:50.737451    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:05:12.571771 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:12.571696    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs\") pod \"network-metrics-daemon-9r6zz\" (UID: \"8e7d8199-6790-4b03-bd95-5eeb637d2f99\") " pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:05:12.572259 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:12.571864    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 15 07:05:12.572259 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:12.571939    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs podName:8e7d8199-6790-4b03-bd95-5eeb637d2f99 nodeName:}" failed. No retries permitted until 2026-09-15 07:07:14.571923234 +0000 UTC m=+374.362841032 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs") pod "network-metrics-daemon-9r6zz" (UID: "8e7d8199-6790-4b03-bd95-5eeb637d2f99") : secret "metrics-daemon-secret" not found
Sep 15 07:05:30.308433 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.308343    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-whnrm"]
Sep 15 07:05:30.311050 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.311032    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-x9hvx"]
Sep 15 07:05:30.311191 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.311170    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-whnrm"
Sep 15 07:05:30.313574 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.313557    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-8rz9j"]
Sep 15 07:05:30.313687 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.313670    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-x9hvx"
Sep 15 07:05:30.315098 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.315081    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 15 07:05:30.316169 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.316153    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-8rz9j"
Sep 15 07:05:30.316675 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.316654    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-df8bc4958-v6bd2"]
Sep 15 07:05:30.319218 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.319203    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:30.321751 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.321734    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 15 07:05:30.321848 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.321734    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 15 07:05:30.321848 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.321765    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 15 07:05:30.322121 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.322108    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qrrcv\""
Sep 15 07:05:30.331084 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.331063    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 15 07:05:30.331305 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.331101    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 15 07:05:30.331899 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.331844    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 07:05:30.331899 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.331870    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 07:05:30.332046 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.331953    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 15 07:05:30.332046 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.332000    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8kjjh\""
Sep 15 07:05:30.332153 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.332060    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 15 07:05:30.333195 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.333171    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-h4tgj\""
Sep 15 07:05:30.334051 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.334026    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-8rz9j"]
Sep 15 07:05:30.334758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.334733    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-whnrm"]
Sep 15 07:05:30.335581 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.335556    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 15 07:05:30.335840 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.335600    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 15 07:05:30.339652 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.339636    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4cw7v\""
Sep 15 07:05:30.339758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.339638    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 15 07:05:30.347037 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.347017    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 15 07:05:30.347374 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.347353    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-x9hvx"]
Sep 15 07:05:30.352334 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.352318    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 15 07:05:30.373000 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.372981    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-df8bc4958-v6bd2"]
Sep 15 07:05:30.394331 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.394306    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/97764651-185b-4a70-a59a-138dd852cbef-snapshots\") pod \"insights-operator-5844b856db-x9hvx\" (UID: \"97764651-185b-4a70-a59a-138dd852cbef\") " pod="openshift-insights/insights-operator-5844b856db-x9hvx"
Sep 15 07:05:30.394455 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.394340    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/97764651-185b-4a70-a59a-138dd852cbef-serving-cert\") pod \"insights-operator-5844b856db-x9hvx\" (UID: \"97764651-185b-4a70-a59a-138dd852cbef\") " pod="openshift-insights/insights-operator-5844b856db-x9hvx"
Sep 15 07:05:30.394455 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.394359    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97764651-185b-4a70-a59a-138dd852cbef-trusted-ca-bundle\") pod \"insights-operator-5844b856db-x9hvx\" (UID: \"97764651-185b-4a70-a59a-138dd852cbef\") " pod="openshift-insights/insights-operator-5844b856db-x9hvx"
Sep 15 07:05:30.394455 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.394385    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqv8d\" (UniqueName: \"kubernetes.io/projected/13b6b89c-c6c2-445f-a32e-828c94f1ac35-kube-api-access-lqv8d\") pod \"kube-storage-version-migrator-operator-6c8f84f897-whnrm\" (UID: \"13b6b89c-c6c2-445f-a32e-828c94f1ac35\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-whnrm"
Sep 15 07:05:30.394455 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.394428    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-stats-auth\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:30.394586 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.394457    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg5tk\" (UniqueName: \"kubernetes.io/projected/97764651-185b-4a70-a59a-138dd852cbef-kube-api-access-lg5tk\") pod \"insights-operator-5844b856db-x9hvx\" (UID: \"97764651-185b-4a70-a59a-138dd852cbef\") " pod="openshift-insights/insights-operator-5844b856db-x9hvx"
Sep 15 07:05:30.394586 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.394492    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-default-certificate\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:30.394586 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.394543    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97764651-185b-4a70-a59a-138dd852cbef-tmp\") pod \"insights-operator-5844b856db-x9hvx\" (UID: \"97764651-185b-4a70-a59a-138dd852cbef\") " pod="openshift-insights/insights-operator-5844b856db-x9hvx"
Sep 15 07:05:30.394586 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.394564    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-service-ca-bundle\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:30.394586 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.394580    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ddr8\" (UniqueName: \"kubernetes.io/projected/5f694574-2528-41d7-8029-dc893cb1ed4b-kube-api-access-7ddr8\") pod \"network-check-source-6f8b768455-8rz9j\" (UID: \"5f694574-2528-41d7-8029-dc893cb1ed4b\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-8rz9j"
Sep 15 07:05:30.394806 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.394606    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13b6b89c-c6c2-445f-a32e-828c94f1ac35-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-whnrm\" (UID: \"13b6b89c-c6c2-445f-a32e-828c94f1ac35\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-whnrm"
Sep 15 07:05:30.394806 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.394651    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr25h\" (UniqueName: \"kubernetes.io/projected/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-kube-api-access-tr25h\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:30.394806 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.394672    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-metrics-certs\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:30.394806 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.394689    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13b6b89c-c6c2-445f-a32e-828c94f1ac35-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-whnrm\" (UID: \"13b6b89c-c6c2-445f-a32e-828c94f1ac35\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-whnrm"
Sep 15 07:05:30.394806 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.394742    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97764651-185b-4a70-a59a-138dd852cbef-service-ca-bundle\") pod \"insights-operator-5844b856db-x9hvx\" (UID: \"97764651-185b-4a70-a59a-138dd852cbef\") " pod="openshift-insights/insights-operator-5844b856db-x9hvx"
Sep 15 07:05:30.406317 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.406291    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wxj7v"]
Sep 15 07:05:30.409264 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.409247    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wxj7v"
Sep 15 07:05:30.410174 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.410155    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5blq6"]
Sep 15 07:05:30.412851 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.412833    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-wpk8h"]
Sep 15 07:05:30.412949 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.412932    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5blq6"
Sep 15 07:05:30.413225 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.413205    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 15 07:05:30.413476 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.413451    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m4lmg\""
Sep 15 07:05:30.413574 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.413557    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 15 07:05:30.414149 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.414131    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 15 07:05:30.415611 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.415594    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-wpk8h"
Sep 15 07:05:30.416761 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.416742    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 15 07:05:30.418130 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.418115    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8mw4h\""
Sep 15 07:05:30.418498 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.418481    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 15 07:05:30.418672 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.418655    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 15 07:05:30.418732 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.418672    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 15 07:05:30.418732 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.418672    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-d6qsw\""
Sep 15 07:05:30.418853 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.418834    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 15 07:05:30.418966 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.418951    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 15 07:05:30.420567 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.420549    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wxj7v"]
Sep 15 07:05:30.426996 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.426975    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5blq6"]
Sep 15 07:05:30.428618 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.428599    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-wpk8h"]
Sep 15 07:05:30.494938 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.494914    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/97764651-185b-4a70-a59a-138dd852cbef-serving-cert\") pod \"insights-operator-5844b856db-x9hvx\" (UID: \"97764651-185b-4a70-a59a-138dd852cbef\") " pod="openshift-insights/insights-operator-5844b856db-x9hvx"
Sep 15 07:05:30.495055 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.494942    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97764651-185b-4a70-a59a-138dd852cbef-trusted-ca-bundle\") pod \"insights-operator-5844b856db-x9hvx\" (UID: \"97764651-185b-4a70-a59a-138dd852cbef\") " pod="openshift-insights/insights-operator-5844b856db-x9hvx"
Sep 15 07:05:30.495055 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.494975    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqv8d\" (UniqueName: \"kubernetes.io/projected/13b6b89c-c6c2-445f-a32e-828c94f1ac35-kube-api-access-lqv8d\") pod \"kube-storage-version-migrator-operator-6c8f84f897-whnrm\" (UID: \"13b6b89c-c6c2-445f-a32e-828c94f1ac35\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-whnrm"
Sep 15 07:05:30.495055 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.495021    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gskhz\" (UniqueName: \"kubernetes.io/projected/5c5ce87a-73d1-4c7d-92da-bab849f8e62a-kube-api-access-gskhz\") pod \"service-ca-operator-cf7c776b7-wpk8h\" (UID: \"5c5ce87a-73d1-4c7d-92da-bab849f8e62a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-wpk8h"
Sep 15 07:05:30.495055 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.495047    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-stats-auth\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:30.495265 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.495074    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg5tk\" (UniqueName: \"kubernetes.io/projected/97764651-185b-4a70-a59a-138dd852cbef-kube-api-access-lg5tk\") pod \"insights-operator-5844b856db-x9hvx\" (UID: \"97764651-185b-4a70-a59a-138dd852cbef\") " pod="openshift-insights/insights-operator-5844b856db-x9hvx"
Sep 15 07:05:30.495265 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.495143    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-default-certificate\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:30.495265 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.495188    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd455\" (UniqueName: \"kubernetes.io/projected/5c72e28c-b940-4153-90bd-54b2e77f8ccf-kube-api-access-rd455\") pod \"cluster-samples-operator-86499c89c4-wxj7v\" (UID: \"5c72e28c-b940-4153-90bd-54b2e77f8ccf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wxj7v"
Sep 15 07:05:30.495265 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.495232    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnfwl\" (UniqueName: \"kubernetes.io/projected/05e7b838-09d8-41bf-be7e-b9baa6bb106f-kube-api-access-gnfwl\") pod \"volume-data-source-validator-86695b7cc7-5blq6\" (UID: \"05e7b838-09d8-41bf-be7e-b9baa6bb106f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5blq6"
Sep 15 07:05:30.495477 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.495281    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97764651-185b-4a70-a59a-138dd852cbef-tmp\") pod \"insights-operator-5844b856db-x9hvx\" (UID: \"97764651-185b-4a70-a59a-138dd852cbef\") " pod="openshift-insights/insights-operator-5844b856db-x9hvx"
Sep 15 07:05:30.495477 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.495324    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-service-ca-bundle\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:30.495477 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.495354    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ddr8\" (UniqueName: \"kubernetes.io/projected/5f694574-2528-41d7-8029-dc893cb1ed4b-kube-api-access-7ddr8\") pod \"network-check-source-6f8b768455-8rz9j\" (UID: \"5f694574-2528-41d7-8029-dc893cb1ed4b\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-8rz9j"
Sep 15 07:05:30.495477 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.495379    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5c5ce87a-73d1-4c7d-92da-bab849f8e62a-config\") pod \"service-ca-operator-cf7c776b7-wpk8h\" (UID: \"5c5ce87a-73d1-4c7d-92da-bab849f8e62a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-wpk8h"
Sep 15 07:05:30.495477 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.495411    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13b6b89c-c6c2-445f-a32e-828c94f1ac35-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-whnrm\" (UID: \"13b6b89c-c6c2-445f-a32e-828c94f1ac35\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-whnrm"
Sep 15 07:05:30.495477 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.495437    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c5ce87a-73d1-4c7d-92da-bab849f8e62a-serving-cert\") pod \"service-ca-operator-cf7c776b7-wpk8h\" (UID: \"5c5ce87a-73d1-4c7d-92da-bab849f8e62a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-wpk8h"
Sep 15 07:05:30.495477 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.495462    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c72e28c-b940-4153-90bd-54b2e77f8ccf-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-wxj7v\" (UID: \"5c72e28c-b940-4153-90bd-54b2e77f8ccf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wxj7v"
Sep 15 07:05:30.495888 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.495489    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr25h\" (UniqueName: \"kubernetes.io/projected/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-kube-api-access-tr25h\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:30.495888 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.495521    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-metrics-certs\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:30.495888 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.495547    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13b6b89c-c6c2-445f-a32e-828c94f1ac35-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-whnrm\" (UID: \"13b6b89c-c6c2-445f-a32e-828c94f1ac35\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-whnrm"
Sep 15 07:05:30.495888 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.495583    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97764651-185b-4a70-a59a-138dd852cbef-service-ca-bundle\") pod \"insights-operator-5844b856db-x9hvx\" (UID: \"97764651-185b-4a70-a59a-138dd852cbef\") " pod="openshift-insights/insights-operator-5844b856db-x9hvx"
Sep 15 07:05:30.495888 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.495588    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97764651-185b-4a70-a59a-138dd852cbef-tmp\") pod \"insights-operator-5844b856db-x9hvx\" (UID: \"97764651-185b-4a70-a59a-138dd852cbef\") " pod="openshift-insights/insights-operator-5844b856db-x9hvx"
Sep 15 07:05:30.495888 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.495632    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/97764651-185b-4a70-a59a-138dd852cbef-snapshots\") pod \"insights-operator-5844b856db-x9hvx\" (UID: \"97764651-185b-4a70-a59a-138dd852cbef\") " pod="openshift-insights/insights-operator-5844b856db-x9hvx"
Sep 15 07:05:30.495888 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:30.495761    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 07:05:30.495888 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:30.495827    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-metrics-certs podName:e5e3323d-9a48-4d23-ad31-a0d3401e6b60 nodeName:}" failed. No retries permitted until 2026-09-15 07:05:30.995809437 +0000 UTC m=+270.786727243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-metrics-certs") pod "router-default-df8bc4958-v6bd2" (UID: "e5e3323d-9a48-4d23-ad31-a0d3401e6b60") : secret "router-metrics-certs-default" not found
Sep 15 07:05:30.496271 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.496046    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97764651-185b-4a70-a59a-138dd852cbef-trusted-ca-bundle\") pod \"insights-operator-5844b856db-x9hvx\" (UID: \"97764651-185b-4a70-a59a-138dd852cbef\") " pod="openshift-insights/insights-operator-5844b856db-x9hvx"
Sep 15 07:05:30.496408 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.496328    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13b6b89c-c6c2-445f-a32e-828c94f1ac35-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-whnrm\" (UID: \"13b6b89c-c6c2-445f-a32e-828c94f1ac35\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-whnrm"
Sep 15 07:05:30.496504 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:30.496408    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-service-ca-bundle podName:e5e3323d-9a48-4d23-ad31-a0d3401e6b60 nodeName:}" failed. No retries permitted until 2026-09-15 07:05:30.99639107 +0000 UTC m=+270.787308891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-service-ca-bundle") pod "router-default-df8bc4958-v6bd2" (UID: "e5e3323d-9a48-4d23-ad31-a0d3401e6b60") : configmap references non-existent config key: service-ca.crt
Sep 15 07:05:30.496567 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.496528    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97764651-185b-4a70-a59a-138dd852cbef-service-ca-bundle\") pod \"insights-operator-5844b856db-x9hvx\" (UID: \"97764651-185b-4a70-a59a-138dd852cbef\") " pod="openshift-insights/insights-operator-5844b856db-x9hvx"
Sep 15 07:05:30.496657 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.496632    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/97764651-185b-4a70-a59a-138dd852cbef-snapshots\") pod \"insights-operator-5844b856db-x9hvx\" (UID: \"97764651-185b-4a70-a59a-138dd852cbef\") " pod="openshift-insights/insights-operator-5844b856db-x9hvx"
Sep 15 07:05:30.497766 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.497743    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-default-certificate\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:30.497862 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.497828    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13b6b89c-c6c2-445f-a32e-828c94f1ac35-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-whnrm\" (UID: \"13b6b89c-c6c2-445f-a32e-828c94f1ac35\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-whnrm"
Sep 15 07:05:30.497862 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.497835    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/97764651-185b-4a70-a59a-138dd852cbef-serving-cert\") pod \"insights-operator-5844b856db-x9hvx\" (UID: \"97764651-185b-4a70-a59a-138dd852cbef\") " pod="openshift-insights/insights-operator-5844b856db-x9hvx"
Sep 15 07:05:30.498028 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.498010    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-stats-auth\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:30.502759 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.502731    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqv8d\" (UniqueName: \"kubernetes.io/projected/13b6b89c-c6c2-445f-a32e-828c94f1ac35-kube-api-access-lqv8d\") pod \"kube-storage-version-migrator-operator-6c8f84f897-whnrm\" (UID: \"13b6b89c-c6c2-445f-a32e-828c94f1ac35\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-whnrm"
Sep 15 07:05:30.502759 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.502744    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ddr8\" (UniqueName: \"kubernetes.io/projected/5f694574-2528-41d7-8029-dc893cb1ed4b-kube-api-access-7ddr8\") pod \"network-check-source-6f8b768455-8rz9j\" (UID: \"5f694574-2528-41d7-8029-dc893cb1ed4b\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-8rz9j"
Sep 15 07:05:30.503231 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.503203    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg5tk\" (UniqueName: \"kubernetes.io/projected/97764651-185b-4a70-a59a-138dd852cbef-kube-api-access-lg5tk\") pod \"insights-operator-5844b856db-x9hvx\" (UID: \"97764651-185b-4a70-a59a-138dd852cbef\") " pod="openshift-insights/insights-operator-5844b856db-x9hvx"
Sep 15 07:05:30.503645 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.503602    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr25h\" (UniqueName: \"kubernetes.io/projected/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-kube-api-access-tr25h\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:30.596060 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.595983    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gskhz\" (UniqueName: \"kubernetes.io/projected/5c5ce87a-73d1-4c7d-92da-bab849f8e62a-kube-api-access-gskhz\") pod \"service-ca-operator-cf7c776b7-wpk8h\" (UID: \"5c5ce87a-73d1-4c7d-92da-bab849f8e62a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-wpk8h"
Sep 15 07:05:30.596060 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.596018    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd455\" (UniqueName: \"kubernetes.io/projected/5c72e28c-b940-4153-90bd-54b2e77f8ccf-kube-api-access-rd455\") pod \"cluster-samples-operator-86499c89c4-wxj7v\" (UID: \"5c72e28c-b940-4153-90bd-54b2e77f8ccf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wxj7v"
Sep 15 07:05:30.596060 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.596039    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnfwl\" (UniqueName: \"kubernetes.io/projected/05e7b838-09d8-41bf-be7e-b9baa6bb106f-kube-api-access-gnfwl\") pod \"volume-data-source-validator-86695b7cc7-5blq6\" (UID: \"05e7b838-09d8-41bf-be7e-b9baa6bb106f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5blq6"
Sep 15 07:05:30.596294 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.596200    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5c5ce87a-73d1-4c7d-92da-bab849f8e62a-config\") pod \"service-ca-operator-cf7c776b7-wpk8h\" (UID: \"5c5ce87a-73d1-4c7d-92da-bab849f8e62a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-wpk8h"
Sep 15 07:05:30.596294 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.596233    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c5ce87a-73d1-4c7d-92da-bab849f8e62a-serving-cert\") pod \"service-ca-operator-cf7c776b7-wpk8h\" (UID: \"5c5ce87a-73d1-4c7d-92da-bab849f8e62a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-wpk8h"
Sep 15 07:05:30.596294 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.596251    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c72e28c-b940-4153-90bd-54b2e77f8ccf-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-wxj7v\" (UID: \"5c72e28c-b940-4153-90bd-54b2e77f8ccf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wxj7v"
Sep 15 07:05:30.596441 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:30.596376    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 07:05:30.596441 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:30.596427    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c72e28c-b940-4153-90bd-54b2e77f8ccf-samples-operator-tls podName:5c72e28c-b940-4153-90bd-54b2e77f8ccf nodeName:}" failed. No retries permitted until 2026-09-15 07:05:31.096415783 +0000 UTC m=+270.887333582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5c72e28c-b940-4153-90bd-54b2e77f8ccf-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-wxj7v" (UID: "5c72e28c-b940-4153-90bd-54b2e77f8ccf") : secret "samples-operator-tls" not found
Sep 15 07:05:30.596807 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.596783    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5c5ce87a-73d1-4c7d-92da-bab849f8e62a-config\") pod \"service-ca-operator-cf7c776b7-wpk8h\" (UID: \"5c5ce87a-73d1-4c7d-92da-bab849f8e62a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-wpk8h"
Sep 15 07:05:30.598294 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.598278    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c5ce87a-73d1-4c7d-92da-bab849f8e62a-serving-cert\") pod \"service-ca-operator-cf7c776b7-wpk8h\" (UID: \"5c5ce87a-73d1-4c7d-92da-bab849f8e62a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-wpk8h"
Sep 15 07:05:30.605993 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.605973    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd455\" (UniqueName: \"kubernetes.io/projected/5c72e28c-b940-4153-90bd-54b2e77f8ccf-kube-api-access-rd455\") pod \"cluster-samples-operator-86499c89c4-wxj7v\" (UID: \"5c72e28c-b940-4153-90bd-54b2e77f8ccf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wxj7v"
Sep 15 07:05:30.606320 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.606299    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnfwl\" (UniqueName: \"kubernetes.io/projected/05e7b838-09d8-41bf-be7e-b9baa6bb106f-kube-api-access-gnfwl\") pod \"volume-data-source-validator-86695b7cc7-5blq6\" (UID: \"05e7b838-09d8-41bf-be7e-b9baa6bb106f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5blq6"
Sep 15 07:05:30.607031 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.607007    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gskhz\" (UniqueName: \"kubernetes.io/projected/5c5ce87a-73d1-4c7d-92da-bab849f8e62a-kube-api-access-gskhz\") pod \"service-ca-operator-cf7c776b7-wpk8h\" (UID: \"5c5ce87a-73d1-4c7d-92da-bab849f8e62a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-wpk8h"
Sep 15 07:05:30.620802 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.620781    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-whnrm"
Sep 15 07:05:30.626960 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.626945    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-x9hvx"
Sep 15 07:05:30.632697 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.632679    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-8rz9j"
Sep 15 07:05:30.725608 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.725580    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5blq6"
Sep 15 07:05:30.730588 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.730569    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-wpk8h"
Sep 15 07:05:30.890259 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.890112    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-whnrm"]
Sep 15 07:05:30.892899 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:05:30.892865    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b6b89c_c6c2_445f_a32e_828c94f1ac35.slice/crio-dce0b39885af4bd170480ee6c4e2fb2ce101859429c0934e05d2aa1e97da631f WatchSource:0}: Error finding container dce0b39885af4bd170480ee6c4e2fb2ce101859429c0934e05d2aa1e97da631f: Status 404 returned error can't find the container with id dce0b39885af4bd170480ee6c4e2fb2ce101859429c0934e05d2aa1e97da631f
Sep 15 07:05:30.893391 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.893371    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-x9hvx"]
Sep 15 07:05:30.895389 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:05:30.895368    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97764651_185b_4a70_a59a_138dd852cbef.slice/crio-cba6588643352a6722ad43a37a63d443844c95684a378ee2a493c8c37adb4016 WatchSource:0}: Error finding container cba6588643352a6722ad43a37a63d443844c95684a378ee2a493c8c37adb4016: Status 404 returned error can't find the container with id cba6588643352a6722ad43a37a63d443844c95684a378ee2a493c8c37adb4016
Sep 15 07:05:30.912415 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.912393    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-8rz9j"]
Sep 15 07:05:30.915655 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:05:30.915625    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f694574_2528_41d7_8029_dc893cb1ed4b.slice/crio-31a8bd0e0f5524c0ddcc3e413c8e6feabb9392402b6dd966eb0c0807fd4fd95c WatchSource:0}: Error finding container 31a8bd0e0f5524c0ddcc3e413c8e6feabb9392402b6dd966eb0c0807fd4fd95c: Status 404 returned error can't find the container with id 31a8bd0e0f5524c0ddcc3e413c8e6feabb9392402b6dd966eb0c0807fd4fd95c
Sep 15 07:05:30.997040 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:30.997009    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5blq6"]
Sep 15 07:05:31.000584 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:31.000560    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-wpk8h"]
Sep 15 07:05:31.001978 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:05:31.001946    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e7b838_09d8_41bf_be7e_b9baa6bb106f.slice/crio-6f3aaaea98ef0cdec438bda87a8976325b08500f933ab40a69f07285b48856dd WatchSource:0}: Error finding container 6f3aaaea98ef0cdec438bda87a8976325b08500f933ab40a69f07285b48856dd: Status 404 returned error can't find the container with id 6f3aaaea98ef0cdec438bda87a8976325b08500f933ab40a69f07285b48856dd
Sep 15 07:05:31.002078 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:31.002037    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-service-ca-bundle\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:31.002143 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:31.002104    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-metrics-certs\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:31.002200 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:31.002174    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-service-ca-bundle podName:e5e3323d-9a48-4d23-ad31-a0d3401e6b60 nodeName:}" failed. No retries permitted until 2026-09-15 07:05:32.002153502 +0000 UTC m=+271.793071315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-service-ca-bundle") pod "router-default-df8bc4958-v6bd2" (UID: "e5e3323d-9a48-4d23-ad31-a0d3401e6b60") : configmap references non-existent config key: service-ca.crt
Sep 15 07:05:31.002261 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:31.002215    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 07:05:31.002309 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:31.002264    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-metrics-certs podName:e5e3323d-9a48-4d23-ad31-a0d3401e6b60 nodeName:}" failed. No retries permitted until 2026-09-15 07:05:32.002245288 +0000 UTC m=+271.793163086 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-metrics-certs") pod "router-default-df8bc4958-v6bd2" (UID: "e5e3323d-9a48-4d23-ad31-a0d3401e6b60") : secret "router-metrics-certs-default" not found
Sep 15 07:05:31.002992 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:05:31.002971    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c5ce87a_73d1_4c7d_92da_bab849f8e62a.slice/crio-9e3d97f9111570025a4131f2c7b431dac3a8b9621e3ad74406cd31200790211c WatchSource:0}: Error finding container 9e3d97f9111570025a4131f2c7b431dac3a8b9621e3ad74406cd31200790211c: Status 404 returned error can't find the container with id 9e3d97f9111570025a4131f2c7b431dac3a8b9621e3ad74406cd31200790211c
Sep 15 07:05:31.102532 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:31.102509    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c72e28c-b940-4153-90bd-54b2e77f8ccf-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-wxj7v\" (UID: \"5c72e28c-b940-4153-90bd-54b2e77f8ccf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wxj7v"
Sep 15 07:05:31.102683 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:31.102665    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 07:05:31.102780 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:31.102750    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c72e28c-b940-4153-90bd-54b2e77f8ccf-samples-operator-tls podName:5c72e28c-b940-4153-90bd-54b2e77f8ccf nodeName:}" failed. No retries permitted until 2026-09-15 07:05:32.102730192 +0000 UTC m=+271.893648008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5c72e28c-b940-4153-90bd-54b2e77f8ccf-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-wxj7v" (UID: "5c72e28c-b940-4153-90bd-54b2e77f8ccf") : secret "samples-operator-tls" not found
Sep 15 07:05:31.480175 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:31.480134    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5blq6" event={"ID":"05e7b838-09d8-41bf-be7e-b9baa6bb106f","Type":"ContainerStarted","Data":"6f3aaaea98ef0cdec438bda87a8976325b08500f933ab40a69f07285b48856dd"}
Sep 15 07:05:31.481190 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:31.481164    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-wpk8h" event={"ID":"5c5ce87a-73d1-4c7d-92da-bab849f8e62a","Type":"ContainerStarted","Data":"9e3d97f9111570025a4131f2c7b431dac3a8b9621e3ad74406cd31200790211c"}
Sep 15 07:05:31.482211 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:31.482184    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-x9hvx" event={"ID":"97764651-185b-4a70-a59a-138dd852cbef","Type":"ContainerStarted","Data":"cba6588643352a6722ad43a37a63d443844c95684a378ee2a493c8c37adb4016"}
Sep 15 07:05:31.483238 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:31.483217    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-whnrm" event={"ID":"13b6b89c-c6c2-445f-a32e-828c94f1ac35","Type":"ContainerStarted","Data":"dce0b39885af4bd170480ee6c4e2fb2ce101859429c0934e05d2aa1e97da631f"}
Sep 15 07:05:31.484480 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:31.484458    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-8rz9j" event={"ID":"5f694574-2528-41d7-8029-dc893cb1ed4b","Type":"ContainerStarted","Data":"0cf44241293e24170ffbf51eb7ebe5917da8c5b6b677f35315c79b3f899afbb6"}
Sep 15 07:05:31.484561 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:31.484494    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-8rz9j" event={"ID":"5f694574-2528-41d7-8029-dc893cb1ed4b","Type":"ContainerStarted","Data":"31a8bd0e0f5524c0ddcc3e413c8e6feabb9392402b6dd966eb0c0807fd4fd95c"}
Sep 15 07:05:31.500521 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:31.500478    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-8rz9j" podStartSLOduration=1.500466232 podStartE2EDuration="1.500466232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:05:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:05:31.49940836 +0000 UTC m=+271.290326182" watchObservedRunningTime="2026-09-15 07:05:31.500466232 +0000 UTC m=+271.291384050"
Sep 15 07:05:32.009326 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:32.009269    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-metrics-certs\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:32.009516 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:32.009495    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-service-ca-bundle\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:32.009516 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:32.009500    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 07:05:32.009639 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:32.009585    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-metrics-certs podName:e5e3323d-9a48-4d23-ad31-a0d3401e6b60 nodeName:}" failed. No retries permitted until 2026-09-15 07:05:34.009564281 +0000 UTC m=+273.800482086 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-metrics-certs") pod "router-default-df8bc4958-v6bd2" (UID: "e5e3323d-9a48-4d23-ad31-a0d3401e6b60") : secret "router-metrics-certs-default" not found
Sep 15 07:05:32.009706 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:32.009677    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-service-ca-bundle podName:e5e3323d-9a48-4d23-ad31-a0d3401e6b60 nodeName:}" failed. No retries permitted until 2026-09-15 07:05:34.009659951 +0000 UTC m=+273.800577764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-service-ca-bundle") pod "router-default-df8bc4958-v6bd2" (UID: "e5e3323d-9a48-4d23-ad31-a0d3401e6b60") : configmap references non-existent config key: service-ca.crt
Sep 15 07:05:32.110408 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:32.110380    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c72e28c-b940-4153-90bd-54b2e77f8ccf-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-wxj7v\" (UID: \"5c72e28c-b940-4153-90bd-54b2e77f8ccf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wxj7v"
Sep 15 07:05:32.110580 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:32.110556    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 07:05:32.110646 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:32.110640    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c72e28c-b940-4153-90bd-54b2e77f8ccf-samples-operator-tls podName:5c72e28c-b940-4153-90bd-54b2e77f8ccf nodeName:}" failed. No retries permitted until 2026-09-15 07:05:34.110619958 +0000 UTC m=+273.901537758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5c72e28c-b940-4153-90bd-54b2e77f8ccf-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-wxj7v" (UID: "5c72e28c-b940-4153-90bd-54b2e77f8ccf") : secret "samples-operator-tls" not found
Sep 15 07:05:33.494344 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:33.494296    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5blq6" event={"ID":"05e7b838-09d8-41bf-be7e-b9baa6bb106f","Type":"ContainerStarted","Data":"f87b6d1cd9e40e8a9c948c2e39c92b5a3fea4e9de0944b29c411f1ac23b82aae"}
Sep 15 07:05:33.509345 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:33.509291    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5blq6" podStartSLOduration=2.043756951 podStartE2EDuration="3.509272681s" totalImagesPullingTime="1.46551573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:05:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:05:33.507429395 +0000 UTC m=+273.298347215" watchObservedRunningTime="2026-09-15 07:05:33.509272681 +0000 UTC m=+273.300190501"
Sep 15 07:05:34.028818 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:34.028777    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-metrics-certs\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:34.029009 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:34.028902    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-service-ca-bundle\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:34.029009 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:34.028947    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 07:05:34.029121 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:34.029025    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-service-ca-bundle podName:e5e3323d-9a48-4d23-ad31-a0d3401e6b60 nodeName:}" failed. No retries permitted until 2026-09-15 07:05:38.029006375 +0000 UTC m=+277.819924188 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-service-ca-bundle") pod "router-default-df8bc4958-v6bd2" (UID: "e5e3323d-9a48-4d23-ad31-a0d3401e6b60") : configmap references non-existent config key: service-ca.crt
Sep 15 07:05:34.029121 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:34.029046    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-metrics-certs podName:e5e3323d-9a48-4d23-ad31-a0d3401e6b60 nodeName:}" failed. No retries permitted until 2026-09-15 07:05:38.029037457 +0000 UTC m=+277.819955256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-metrics-certs") pod "router-default-df8bc4958-v6bd2" (UID: "e5e3323d-9a48-4d23-ad31-a0d3401e6b60") : secret "router-metrics-certs-default" not found
Sep 15 07:05:34.130228 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:34.130185    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c72e28c-b940-4153-90bd-54b2e77f8ccf-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-wxj7v\" (UID: \"5c72e28c-b940-4153-90bd-54b2e77f8ccf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wxj7v"
Sep 15 07:05:34.130473 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:34.130323    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 07:05:34.130473 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:34.130388    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c72e28c-b940-4153-90bd-54b2e77f8ccf-samples-operator-tls podName:5c72e28c-b940-4153-90bd-54b2e77f8ccf nodeName:}" failed. No retries permitted until 2026-09-15 07:05:38.130372038 +0000 UTC m=+277.921289836 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5c72e28c-b940-4153-90bd-54b2e77f8ccf-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-wxj7v" (UID: "5c72e28c-b940-4153-90bd-54b2e77f8ccf") : secret "samples-operator-tls" not found
Sep 15 07:05:34.500475 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:34.500436    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-wpk8h" event={"ID":"5c5ce87a-73d1-4c7d-92da-bab849f8e62a","Type":"ContainerStarted","Data":"0a6c26c31789b61a937dfdea98546bd1672ea50cad59930bfae05c18eefcd36a"}
Sep 15 07:05:34.502136 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:34.502109    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-x9hvx" event={"ID":"97764651-185b-4a70-a59a-138dd852cbef","Type":"ContainerStarted","Data":"4931d8a208c2ed5459b190dc1f46f68a3ddb7fcc0a3891eda9b6ae11a1b27b50"}
Sep 15 07:05:34.503785 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:34.503762    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-whnrm" event={"ID":"13b6b89c-c6c2-445f-a32e-828c94f1ac35","Type":"ContainerStarted","Data":"1d007c586e26afa0bf488299c72e946339f707b1abf1baf1435b675ac71c1219"}
Sep 15 07:05:34.515383 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:34.515254    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-wpk8h" podStartSLOduration=1.294300487 podStartE2EDuration="4.515235885s" totalImagesPullingTime="3.220935398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:05:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:05:34.514614576 +0000 UTC m=+274.305532399" watchObservedRunningTime="2026-09-15 07:05:34.515235885 +0000 UTC m=+274.306153709"
Sep 15 07:05:34.530462 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:34.530388    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-whnrm" podStartSLOduration=1.198110075 podStartE2EDuration="4.530372684s" totalImagesPullingTime="3.332262609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:05:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:05:34.529649629 +0000 UTC m=+274.320567452" watchObservedRunningTime="2026-09-15 07:05:34.530372684 +0000 UTC m=+274.321290506"
Sep 15 07:05:34.546903 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:34.546857    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-x9hvx" podStartSLOduration=1.222222346 podStartE2EDuration="4.546841831s" totalImagesPullingTime="3.324619485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:05:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:05:34.546333131 +0000 UTC m=+274.337250984" watchObservedRunningTime="2026-09-15 07:05:34.546841831 +0000 UTC m=+274.337759653"
Sep 15 07:05:34.965833 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:34.965801    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jmb6d"]
Sep 15 07:05:34.969234 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:34.969214    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:34.971433 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:34.971399    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 07:05:34.971588 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:34.971447    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qbhxm\""
Sep 15 07:05:34.972273 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:34.972249    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 07:05:34.980994 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:34.980972    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jmb6d"]
Sep 15 07:05:35.038744 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:35.038702    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-data-volume\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:35.038852 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:35.038751    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:35.038852 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:35.038781    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-crio-socket\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:35.038852 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:35.038806    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:35.039010 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:35.038907    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shkxz\" (UniqueName: \"kubernetes.io/projected/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-kube-api-access-shkxz\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:35.139407 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:35.139374    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-crio-socket\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:35.139544 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:35.139420    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:35.139544 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:35.139501    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-crio-socket\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:35.139544 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:35.139530    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 07:05:35.139670 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:35.139577    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shkxz\" (UniqueName: \"kubernetes.io/projected/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-kube-api-access-shkxz\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:35.139670 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:35.139590    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-insights-runtime-extractor-tls podName:9225807a-3d64-4e72-b62c-d67b1b6a7cb3 nodeName:}" failed. No retries permitted until 2026-09-15 07:05:35.639570821 +0000 UTC m=+275.430488627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jmb6d" (UID: "9225807a-3d64-4e72-b62c-d67b1b6a7cb3") : secret "insights-runtime-extractor-tls" not found
Sep 15 07:05:35.139814 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:35.139706    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-data-volume\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:35.139814 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:35.139753    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:35.139910 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:35.139828    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 07:05:35.139910 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:35.139868    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-kube-rbac-proxy-cm podName:9225807a-3d64-4e72-b62c-d67b1b6a7cb3 nodeName:}" failed. No retries permitted until 2026-09-15 07:05:35.639855795 +0000 UTC m=+275.430773600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jmb6d" (UID: "9225807a-3d64-4e72-b62c-d67b1b6a7cb3") : configmap "kube-rbac-proxy" not found
Sep 15 07:05:35.140103 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:35.140083    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-data-volume\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:35.147654 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:35.147633    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shkxz\" (UniqueName: \"kubernetes.io/projected/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-kube-api-access-shkxz\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:35.645143 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:35.645093    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:35.645636 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:35.645178    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:35.645636 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:35.645201    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 07:05:35.645636 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:35.645270    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-kube-rbac-proxy-cm podName:9225807a-3d64-4e72-b62c-d67b1b6a7cb3 nodeName:}" failed. No retries permitted until 2026-09-15 07:05:36.645250413 +0000 UTC m=+276.436168229 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jmb6d" (UID: "9225807a-3d64-4e72-b62c-d67b1b6a7cb3") : configmap "kube-rbac-proxy" not found
Sep 15 07:05:35.645636 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:35.645315    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 07:05:35.645636 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:35.645364    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-insights-runtime-extractor-tls podName:9225807a-3d64-4e72-b62c-d67b1b6a7cb3 nodeName:}" failed. No retries permitted until 2026-09-15 07:05:36.64535096 +0000 UTC m=+276.436268775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jmb6d" (UID: "9225807a-3d64-4e72-b62c-d67b1b6a7cb3") : secret "insights-runtime-extractor-tls" not found
Sep 15 07:05:36.654579 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:36.654548    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:36.654932 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:36.654592    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:36.654932 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:36.654665    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 07:05:36.654932 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:36.654678    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 07:05:36.654932 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:36.654744    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-kube-rbac-proxy-cm podName:9225807a-3d64-4e72-b62c-d67b1b6a7cb3 nodeName:}" failed. No retries permitted until 2026-09-15 07:05:38.65470794 +0000 UTC m=+278.445625740 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jmb6d" (UID: "9225807a-3d64-4e72-b62c-d67b1b6a7cb3") : configmap "kube-rbac-proxy" not found
Sep 15 07:05:36.654932 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:36.654763    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-insights-runtime-extractor-tls podName:9225807a-3d64-4e72-b62c-d67b1b6a7cb3 nodeName:}" failed. No retries permitted until 2026-09-15 07:05:38.65475674 +0000 UTC m=+278.445674540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jmb6d" (UID: "9225807a-3d64-4e72-b62c-d67b1b6a7cb3") : secret "insights-runtime-extractor-tls" not found
Sep 15 07:05:36.945890 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:36.945866    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7p7gl_33d4f8d4-2be4-453c-8f99-a19ce58c1e36/dns-node-resolver/0.log"
Sep 15 07:05:37.746707 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:37.746680    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8k4fj_67a0be6f-84c1-4b98-b6d1-0dad5516fe99/node-ca/0.log"
Sep 15 07:05:38.063764 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.063682    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-service-ca-bundle\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:38.063764 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.063745    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-metrics-certs\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:38.063923 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:38.063850    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-service-ca-bundle podName:e5e3323d-9a48-4d23-ad31-a0d3401e6b60 nodeName:}" failed. No retries permitted until 2026-09-15 07:05:46.063833073 +0000 UTC m=+285.854750871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-service-ca-bundle") pod "router-default-df8bc4958-v6bd2" (UID: "e5e3323d-9a48-4d23-ad31-a0d3401e6b60") : configmap references non-existent config key: service-ca.crt
Sep 15 07:05:38.063923 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:38.063900    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 07:05:38.063993 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:38.063942    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-metrics-certs podName:e5e3323d-9a48-4d23-ad31-a0d3401e6b60 nodeName:}" failed. No retries permitted until 2026-09-15 07:05:46.063932017 +0000 UTC m=+285.854849816 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-metrics-certs") pod "router-default-df8bc4958-v6bd2" (UID: "e5e3323d-9a48-4d23-ad31-a0d3401e6b60") : secret "router-metrics-certs-default" not found
Sep 15 07:05:38.091648 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.091621    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-h4kzb"]
Sep 15 07:05:38.094937 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.094922    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-h4kzb"
Sep 15 07:05:38.097294 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.097272    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 15 07:05:38.097402 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.097332    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-4bg42\""
Sep 15 07:05:38.097402 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.097387    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 15 07:05:38.098200 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.098182    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 15 07:05:38.098296 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.098187    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 15 07:05:38.102096 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.102067    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-h4kzb"]
Sep 15 07:05:38.164396 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.164372    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b55w9\" (UniqueName: \"kubernetes.io/projected/8cbe0e93-94c1-4519-a36f-e241b6a111f4-kube-api-access-b55w9\") pod \"service-ca-568869fdc5-h4kzb\" (UID: \"8cbe0e93-94c1-4519-a36f-e241b6a111f4\") " pod="openshift-service-ca/service-ca-568869fdc5-h4kzb"
Sep 15 07:05:38.164527 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.164402    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8cbe0e93-94c1-4519-a36f-e241b6a111f4-signing-cabundle\") pod \"service-ca-568869fdc5-h4kzb\" (UID: \"8cbe0e93-94c1-4519-a36f-e241b6a111f4\") " pod="openshift-service-ca/service-ca-568869fdc5-h4kzb"
Sep 15 07:05:38.164527 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.164424    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8cbe0e93-94c1-4519-a36f-e241b6a111f4-signing-key\") pod \"service-ca-568869fdc5-h4kzb\" (UID: \"8cbe0e93-94c1-4519-a36f-e241b6a111f4\") " pod="openshift-service-ca/service-ca-568869fdc5-h4kzb"
Sep 15 07:05:38.164635 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.164569    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c72e28c-b940-4153-90bd-54b2e77f8ccf-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-wxj7v\" (UID: \"5c72e28c-b940-4153-90bd-54b2e77f8ccf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wxj7v"
Sep 15 07:05:38.164734 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:38.164696    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 07:05:38.164788 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:38.164781    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c72e28c-b940-4153-90bd-54b2e77f8ccf-samples-operator-tls podName:5c72e28c-b940-4153-90bd-54b2e77f8ccf nodeName:}" failed. No retries permitted until 2026-09-15 07:05:46.16476375 +0000 UTC m=+285.955681555 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5c72e28c-b940-4153-90bd-54b2e77f8ccf-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-wxj7v" (UID: "5c72e28c-b940-4153-90bd-54b2e77f8ccf") : secret "samples-operator-tls" not found
Sep 15 07:05:38.265305 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.265279    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8cbe0e93-94c1-4519-a36f-e241b6a111f4-signing-key\") pod \"service-ca-568869fdc5-h4kzb\" (UID: \"8cbe0e93-94c1-4519-a36f-e241b6a111f4\") " pod="openshift-service-ca/service-ca-568869fdc5-h4kzb"
Sep 15 07:05:38.265416 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.265404    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b55w9\" (UniqueName: \"kubernetes.io/projected/8cbe0e93-94c1-4519-a36f-e241b6a111f4-kube-api-access-b55w9\") pod \"service-ca-568869fdc5-h4kzb\" (UID: \"8cbe0e93-94c1-4519-a36f-e241b6a111f4\") " pod="openshift-service-ca/service-ca-568869fdc5-h4kzb"
Sep 15 07:05:38.265467 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.265424    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8cbe0e93-94c1-4519-a36f-e241b6a111f4-signing-cabundle\") pod \"service-ca-568869fdc5-h4kzb\" (UID: \"8cbe0e93-94c1-4519-a36f-e241b6a111f4\") " pod="openshift-service-ca/service-ca-568869fdc5-h4kzb"
Sep 15 07:05:38.266018 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.266001    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8cbe0e93-94c1-4519-a36f-e241b6a111f4-signing-cabundle\") pod \"service-ca-568869fdc5-h4kzb\" (UID: \"8cbe0e93-94c1-4519-a36f-e241b6a111f4\") " pod="openshift-service-ca/service-ca-568869fdc5-h4kzb"
Sep 15 07:05:38.267611 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.267594    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8cbe0e93-94c1-4519-a36f-e241b6a111f4-signing-key\") pod \"service-ca-568869fdc5-h4kzb\" (UID: \"8cbe0e93-94c1-4519-a36f-e241b6a111f4\") " pod="openshift-service-ca/service-ca-568869fdc5-h4kzb"
Sep 15 07:05:38.273237 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.273214    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b55w9\" (UniqueName: \"kubernetes.io/projected/8cbe0e93-94c1-4519-a36f-e241b6a111f4-kube-api-access-b55w9\") pod \"service-ca-568869fdc5-h4kzb\" (UID: \"8cbe0e93-94c1-4519-a36f-e241b6a111f4\") " pod="openshift-service-ca/service-ca-568869fdc5-h4kzb"
Sep 15 07:05:38.404168 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.404114    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-h4kzb"
Sep 15 07:05:38.545874 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.545845    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lvw2b_1d13caa1-05ce-4c88-becc-5632369bf463/serve-healthcheck-canary/0.log"
Sep 15 07:05:38.668758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.668730    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:38.668873 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.668777    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:38.668873 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:38.668862    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 07:05:38.668989 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:38.668873    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 07:05:38.668989 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:38.668923    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-insights-runtime-extractor-tls podName:9225807a-3d64-4e72-b62c-d67b1b6a7cb3 nodeName:}" failed. No retries permitted until 2026-09-15 07:05:42.668909596 +0000 UTC m=+282.459827415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jmb6d" (UID: "9225807a-3d64-4e72-b62c-d67b1b6a7cb3") : secret "insights-runtime-extractor-tls" not found
Sep 15 07:05:38.668989 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:38.668941    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-kube-rbac-proxy-cm podName:9225807a-3d64-4e72-b62c-d67b1b6a7cb3 nodeName:}" failed. No retries permitted until 2026-09-15 07:05:42.668934126 +0000 UTC m=+282.459851924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jmb6d" (UID: "9225807a-3d64-4e72-b62c-d67b1b6a7cb3") : configmap "kube-rbac-proxy" not found
Sep 15 07:05:38.675263 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:38.675236    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-h4kzb"]
Sep 15 07:05:38.678197 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:05:38.678176    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cbe0e93_94c1_4519_a36f_e241b6a111f4.slice/crio-c0addc12f5f557d995ada31392d7baa7ca3b491f8fd371df82f6cc89e71d4d2f WatchSource:0}: Error finding container c0addc12f5f557d995ada31392d7baa7ca3b491f8fd371df82f6cc89e71d4d2f: Status 404 returned error can't find the container with id c0addc12f5f557d995ada31392d7baa7ca3b491f8fd371df82f6cc89e71d4d2f
Sep 15 07:05:39.521606 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:39.521569    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-h4kzb" event={"ID":"8cbe0e93-94c1-4519-a36f-e241b6a111f4","Type":"ContainerStarted","Data":"45450301a3f1a526b4aabfe690a10ca323d6a00b80badf7ac3f778a46a5f8b88"}
Sep 15 07:05:39.522078 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:39.521619    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-h4kzb" event={"ID":"8cbe0e93-94c1-4519-a36f-e241b6a111f4","Type":"ContainerStarted","Data":"c0addc12f5f557d995ada31392d7baa7ca3b491f8fd371df82f6cc89e71d4d2f"}
Sep 15 07:05:39.541784 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:39.538272    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-h4kzb" podStartSLOduration=1.538250402 podStartE2EDuration="1.538250402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:05:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:05:39.537032297 +0000 UTC m=+279.327950118" watchObservedRunningTime="2026-09-15 07:05:39.538250402 +0000 UTC m=+279.329168223"
Sep 15 07:05:41.216690 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:41.216647    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vvw8v" podUID="371738e8-15d1-4b74-8c57-572edc740b7d"
Sep 15 07:05:41.216690 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:41.216649    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528" podUID="16f5f861-0b53-462e-bb9b-4727524236ba"
Sep 15 07:05:41.217170 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:41.216735    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5df6c7b697-6fm58" podUID="4b4fdda1-c7ea-4720-992f-a125c1ba938d"
Sep 15 07:05:41.528912 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:41.528837    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:05:41.529055 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:41.528837    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:05:41.529055 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:41.528837    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"
Sep 15 07:05:42.703985 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:42.703945    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:42.704452 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:42.704022    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:42.704452 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:42.704202    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 07:05:42.704452 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:42.704283    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-insights-runtime-extractor-tls podName:9225807a-3d64-4e72-b62c-d67b1b6a7cb3 nodeName:}" failed. No retries permitted until 2026-09-15 07:05:50.704260147 +0000 UTC m=+290.495177947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jmb6d" (UID: "9225807a-3d64-4e72-b62c-d67b1b6a7cb3") : secret "insights-runtime-extractor-tls" not found
Sep 15 07:05:42.704651 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:42.704627    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:44.619575 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:44.619532    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bz528\" (UID: \"16f5f861-0b53-462e-bb9b-4727524236ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"
Sep 15 07:05:44.620104 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:44.619642    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls\") pod \"dns-default-vvw8v\" (UID: \"371738e8-15d1-4b74-8c57-572edc740b7d\") " pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:05:44.620104 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:44.619684    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:05:44.620104 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:44.619693    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 07:05:44.620104 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:44.619783    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert podName:16f5f861-0b53-462e-bb9b-4727524236ba nodeName:}" failed. No retries permitted until 2026-09-15 07:07:46.61976405 +0000 UTC m=+406.410681850 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-bz528" (UID: "16f5f861-0b53-462e-bb9b-4727524236ba") : secret "networking-console-plugin-cert" not found
Sep 15 07:05:44.622088 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:44.622061    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls\") pod \"image-registry-5df6c7b697-6fm58\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") " pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:05:44.622199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:44.622111    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/371738e8-15d1-4b74-8c57-572edc740b7d-metrics-tls\") pod \"dns-default-vvw8v\" (UID: \"371738e8-15d1-4b74-8c57-572edc740b7d\") " pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:05:44.833298 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:44.833271    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hpf95\""
Sep 15 07:05:44.833298 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:44.833289    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-987jx\""
Sep 15 07:05:44.841269 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:44.841250    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:05:44.841345 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:44.841330    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:05:45.125560 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:45.125526    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vvw8v"]
Sep 15 07:05:45.127642 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:45.127592    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5df6c7b697-6fm58"]
Sep 15 07:05:45.130379 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:05:45.130353    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod371738e8_15d1_4b74_8c57_572edc740b7d.slice/crio-f44a9b78904b2d477018884b871c804d4aae49d2d2eb5eac310f60e2836b1fc1 WatchSource:0}: Error finding container f44a9b78904b2d477018884b871c804d4aae49d2d2eb5eac310f60e2836b1fc1: Status 404 returned error can't find the container with id f44a9b78904b2d477018884b871c804d4aae49d2d2eb5eac310f60e2836b1fc1
Sep 15 07:05:45.130911 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:05:45.130895    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b4fdda1_c7ea_4720_992f_a125c1ba938d.slice/crio-f90765663e6ca823fa1171f798506ba91713aec7a56a453b2320ed3ac238b3bf WatchSource:0}: Error finding container f90765663e6ca823fa1171f798506ba91713aec7a56a453b2320ed3ac238b3bf: Status 404 returned error can't find the container with id f90765663e6ca823fa1171f798506ba91713aec7a56a453b2320ed3ac238b3bf
Sep 15 07:05:45.543940 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:45.543852    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vvw8v" event={"ID":"371738e8-15d1-4b74-8c57-572edc740b7d","Type":"ContainerStarted","Data":"f44a9b78904b2d477018884b871c804d4aae49d2d2eb5eac310f60e2836b1fc1"}
Sep 15 07:05:45.545296 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:45.545270    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5df6c7b697-6fm58" event={"ID":"4b4fdda1-c7ea-4720-992f-a125c1ba938d","Type":"ContainerStarted","Data":"5241c8901535a5d80c74e1f4fa7427f4d2b5132aa2a9c036f2f1f93de850d0e3"}
Sep 15 07:05:45.545417 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:45.545314    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5df6c7b697-6fm58" event={"ID":"4b4fdda1-c7ea-4720-992f-a125c1ba938d","Type":"ContainerStarted","Data":"f90765663e6ca823fa1171f798506ba91713aec7a56a453b2320ed3ac238b3bf"}
Sep 15 07:05:45.545417 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:45.545389    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:05:45.563572 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:45.563525    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5df6c7b697-6fm58" podStartSLOduration=284.56351097 podStartE2EDuration="4m44.56351097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:01:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:05:45.562780391 +0000 UTC m=+285.353698211" watchObservedRunningTime="2026-09-15 07:05:45.56351097 +0000 UTC m=+285.354428790"
Sep 15 07:05:46.132235 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:46.132200    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-service-ca-bundle\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:46.132610 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:46.132251    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-metrics-certs\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:46.132610 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:46.132405    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-service-ca-bundle podName:e5e3323d-9a48-4d23-ad31-a0d3401e6b60 nodeName:}" failed. No retries permitted until 2026-09-15 07:06:02.132381551 +0000 UTC m=+301.923299357 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-service-ca-bundle") pod "router-default-df8bc4958-v6bd2" (UID: "e5e3323d-9a48-4d23-ad31-a0d3401e6b60") : configmap references non-existent config key: service-ca.crt
Sep 15 07:05:46.134598 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:46.134572    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-metrics-certs\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:05:46.233759 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:46.233704    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c72e28c-b940-4153-90bd-54b2e77f8ccf-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-wxj7v\" (UID: \"5c72e28c-b940-4153-90bd-54b2e77f8ccf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wxj7v"
Sep 15 07:05:46.236065 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:46.236032    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c72e28c-b940-4153-90bd-54b2e77f8ccf-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-wxj7v\" (UID: \"5c72e28c-b940-4153-90bd-54b2e77f8ccf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wxj7v"
Sep 15 07:05:46.319529 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:46.319497    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wxj7v"
Sep 15 07:05:46.587411 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:46.587381    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wxj7v"]
Sep 15 07:05:47.554987 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:47.554923    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wxj7v" event={"ID":"5c72e28c-b940-4153-90bd-54b2e77f8ccf","Type":"ContainerStarted","Data":"c94e6acc7d0f0bd3e0bcb3be873a4a2c63a09ca7d2bd3274eba537ced6fcd677"}
Sep 15 07:05:48.561360 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:48.561326    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vvw8v" event={"ID":"371738e8-15d1-4b74-8c57-572edc740b7d","Type":"ContainerStarted","Data":"1130894df24ef7e21accb18517a3378e956aab8e45b567dc73f67366a8aa1e89"}
Sep 15 07:05:48.561865 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:48.561386    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vvw8v" event={"ID":"371738e8-15d1-4b74-8c57-572edc740b7d","Type":"ContainerStarted","Data":"34589689333a98e882ecd9e71d400d4c2c3380942b6313c19253fcc8714ac8ec"}
Sep 15 07:05:48.561865 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:48.561457    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:05:48.578031 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:48.577973    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vvw8v" podStartSLOduration=251.877601165 podStartE2EDuration="4m14.577952281s" totalImagesPullingTime="2.700351116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:05:48.575964034 +0000 UTC m=+288.366881861" watchObservedRunningTime="2026-09-15 07:05:48.577952281 +0000 UTC m=+288.368870105"
Sep 15 07:05:49.566705 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:49.566659    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wxj7v" event={"ID":"5c72e28c-b940-4153-90bd-54b2e77f8ccf","Type":"ContainerStarted","Data":"ec5370aa9f0813331a9ab1d1d45f13ec3b5cba11e0a75d56db66b8ced89313ee"}
Sep 15 07:05:49.567119 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:49.566741    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wxj7v" event={"ID":"5c72e28c-b940-4153-90bd-54b2e77f8ccf","Type":"ContainerStarted","Data":"9e67d384ec3bd908f01282778541c07bdb169a28df848e4663e8e257615955d8"}
Sep 15 07:05:49.582061 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:49.582015    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wxj7v" podStartSLOduration=16.861839686 podStartE2EDuration="19.582000536s" totalImagesPullingTime="2.72016085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:05:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:05:49.579973553 +0000 UTC m=+289.370891374" watchObservedRunningTime="2026-09-15 07:05:49.582000536 +0000 UTC m=+289.372918356"
Sep 15 07:05:50.775958 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:50.775920    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:50.778187 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:50.778152    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9225807a-3d64-4e72-b62c-d67b1b6a7cb3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jmb6d\" (UID: \"9225807a-3d64-4e72-b62c-d67b1b6a7cb3\") " pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:50.878587 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:50.878559    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jmb6d"
Sep 15 07:05:51.149739 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:51.149661    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jmb6d"]
Sep 15 07:05:51.153072 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:05:51.153048    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9225807a_3d64_4e72_b62c_d67b1b6a7cb3.slice/crio-577968395f9803b1e671cf1f28d15f999d08584897f624bf84fa0fb4d6c0422a WatchSource:0}: Error finding container 577968395f9803b1e671cf1f28d15f999d08584897f624bf84fa0fb4d6c0422a: Status 404 returned error can't find the container with id 577968395f9803b1e671cf1f28d15f999d08584897f624bf84fa0fb4d6c0422a
Sep 15 07:05:51.574492 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:51.574454    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jmb6d" event={"ID":"9225807a-3d64-4e72-b62c-d67b1b6a7cb3","Type":"ContainerStarted","Data":"dc08162d38257d6e4dd664d4e546e815d82501184fb41152225f1dbd64c58c21"}
Sep 15 07:05:51.574649 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:51.574508    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jmb6d" event={"ID":"9225807a-3d64-4e72-b62c-d67b1b6a7cb3","Type":"ContainerStarted","Data":"577968395f9803b1e671cf1f28d15f999d08584897f624bf84fa0fb4d6c0422a"}
Sep 15 07:05:53.583282 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:53.583247    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jmb6d" event={"ID":"9225807a-3d64-4e72-b62c-d67b1b6a7cb3","Type":"ContainerStarted","Data":"124507d0852a03cec027cea5fd5915e76080de32b22778b586e59420c4ad4f19"}
Sep 15 07:05:53.738848 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:05:53.738800    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9r6zz" podUID="8e7d8199-6790-4b03-bd95-5eeb637d2f99"
Sep 15 07:05:54.588899 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:54.588863    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jmb6d" event={"ID":"9225807a-3d64-4e72-b62c-d67b1b6a7cb3","Type":"ContainerStarted","Data":"fd9d246c8a582696ad4f410fd3e096a82487be3551c6195e5f801b2f7c9e0fd2"}
Sep 15 07:05:54.605855 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:54.605811    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jmb6d" podStartSLOduration=18.027668978 podStartE2EDuration="20.605796299s" totalImagesPullingTime="2.578127321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:05:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:05:54.604241157 +0000 UTC m=+294.395158978" watchObservedRunningTime="2026-09-15 07:05:54.605796299 +0000 UTC m=+294.396714121"
Sep 15 07:05:58.569577 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:05:58.569541    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vvw8v"
Sep 15 07:06:00.629071 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:00.629041    2568 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 07:06:01.000581 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:01.000550    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-jfxld"]
Sep 15 07:06:01.003515 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:01.003498    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-jfxld"
Sep 15 07:06:01.005880 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:01.005852    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-g2rm2\""
Sep 15 07:06:01.005991 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:01.005898    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 15 07:06:01.005991 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:01.005902    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 15 07:06:01.014274 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:01.014250    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-jfxld"]
Sep 15 07:06:01.155598 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:01.155564    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7trq\" (UniqueName: \"kubernetes.io/projected/4803d979-5738-459d-9aab-27bd1d842697-kube-api-access-v7trq\") pod \"downloads-76f99584f4-jfxld\" (UID: \"4803d979-5738-459d-9aab-27bd1d842697\") " pod="openshift-console/downloads-76f99584f4-jfxld"
Sep 15 07:06:01.256282 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:01.256200    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7trq\" (UniqueName: \"kubernetes.io/projected/4803d979-5738-459d-9aab-27bd1d842697-kube-api-access-v7trq\") pod \"downloads-76f99584f4-jfxld\" (UID: \"4803d979-5738-459d-9aab-27bd1d842697\") " pod="openshift-console/downloads-76f99584f4-jfxld"
Sep 15 07:06:01.264283 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:01.264245    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7trq\" (UniqueName: \"kubernetes.io/projected/4803d979-5738-459d-9aab-27bd1d842697-kube-api-access-v7trq\") pod \"downloads-76f99584f4-jfxld\" (UID: \"4803d979-5738-459d-9aab-27bd1d842697\") " pod="openshift-console/downloads-76f99584f4-jfxld"
Sep 15 07:06:01.313448 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:01.313414    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-jfxld"
Sep 15 07:06:01.581370 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:01.581290    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-jfxld"]
Sep 15 07:06:01.584227 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:06:01.584196    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4803d979_5738_459d_9aab_27bd1d842697.slice/crio-ac13c2b8e35cfa9ebb5a26ba7592c3f611d260a134a6b87d77df94fc62f627b8 WatchSource:0}: Error finding container ac13c2b8e35cfa9ebb5a26ba7592c3f611d260a134a6b87d77df94fc62f627b8: Status 404 returned error can't find the container with id ac13c2b8e35cfa9ebb5a26ba7592c3f611d260a134a6b87d77df94fc62f627b8
Sep 15 07:06:01.611504 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:01.611476    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-jfxld" event={"ID":"4803d979-5738-459d-9aab-27bd1d842697","Type":"ContainerStarted","Data":"ac13c2b8e35cfa9ebb5a26ba7592c3f611d260a134a6b87d77df94fc62f627b8"}
Sep 15 07:06:02.162033 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:02.161984    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-service-ca-bundle\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:06:02.162609 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:02.162585    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5e3323d-9a48-4d23-ad31-a0d3401e6b60-service-ca-bundle\") pod \"router-default-df8bc4958-v6bd2\" (UID: \"e5e3323d-9a48-4d23-ad31-a0d3401e6b60\") " pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:06:02.440775 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:02.440685    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4cw7v\""
Sep 15 07:06:02.449514 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:02.449486    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:06:02.731593 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:02.731495    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-df8bc4958-v6bd2"]
Sep 15 07:06:02.735293 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:06:02.735260    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5e3323d_9a48_4d23_ad31_a0d3401e6b60.slice/crio-f4232d93cf722c319bf0b351259b78ac162a3ee729b7f201361d49eb0028a38b WatchSource:0}: Error finding container f4232d93cf722c319bf0b351259b78ac162a3ee729b7f201361d49eb0028a38b: Status 404 returned error can't find the container with id f4232d93cf722c319bf0b351259b78ac162a3ee729b7f201361d49eb0028a38b
Sep 15 07:06:03.621560 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:03.621526    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-df8bc4958-v6bd2" event={"ID":"e5e3323d-9a48-4d23-ad31-a0d3401e6b60","Type":"ContainerStarted","Data":"be77f3aee854866d639a334cfa8d4b4bb9186a31021963bb316ee33c0f70a084"}
Sep 15 07:06:03.622035 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:03.621577    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-df8bc4958-v6bd2" event={"ID":"e5e3323d-9a48-4d23-ad31-a0d3401e6b60","Type":"ContainerStarted","Data":"f4232d93cf722c319bf0b351259b78ac162a3ee729b7f201361d49eb0028a38b"}
Sep 15 07:06:03.640609 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:03.640553    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-df8bc4958-v6bd2" podStartSLOduration=33.640532284 podStartE2EDuration="33.640532284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:05:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:06:03.638117333 +0000 UTC m=+303.429035156" watchObservedRunningTime="2026-09-15 07:06:03.640532284 +0000 UTC m=+303.431450105"
Sep 15 07:06:04.450624 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:04.450586    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:06:04.453498 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:04.453473    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:06:04.625772 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:04.625743    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:06:04.627042 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:04.627016    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-df8bc4958-v6bd2"
Sep 15 07:06:04.846462 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:04.846427    2568 patch_prober.go:28] interesting pod/image-registry-5df6c7b697-6fm58 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 15 07:06:04.846634 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:04.846488    2568 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5df6c7b697-6fm58" podUID="4b4fdda1-c7ea-4720-992f-a125c1ba938d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 07:06:06.554744 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:06.554699    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:06:08.736230 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:08.736192    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:06:14.380384 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.380195    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn"]
Sep 15 07:06:14.385422 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.385119    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn"
Sep 15 07:06:14.388819 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.388774    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 15 07:06:14.388819 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.388808    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 07:06:14.388994 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.388975    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 07:06:14.389739 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.389140    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 07:06:14.389739 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.389182    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-tgmd9\""
Sep 15 07:06:14.389739 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.389140    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 15 07:06:14.399834 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.398741    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn"]
Sep 15 07:06:14.408549 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.408519    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4qbl5"]
Sep 15 07:06:14.413575 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.413554    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.416373 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.416332    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 07:06:14.416495 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.416377    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 07:06:14.416599 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.416581    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 07:06:14.416666 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.416602    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-65mcg\""
Sep 15 07:06:14.570919 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.570809    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84bb02b4-6541-4aa5-b13d-e1dd1c181977-sys\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.570919 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.570886    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dvzq\" (UniqueName: \"kubernetes.io/projected/84bb02b4-6541-4aa5-b13d-e1dd1c181977-kube-api-access-7dvzq\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.571111 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.570965    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/84bb02b4-6541-4aa5-b13d-e1dd1c181977-node-exporter-textfile\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.571111 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.571009    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ab36021-eea1-424a-9e63-84c45ea557ef-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-jjmrn\" (UID: \"9ab36021-eea1-424a-9e63-84c45ea557ef\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn"
Sep 15 07:06:14.571111 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.571039    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/84bb02b4-6541-4aa5-b13d-e1dd1c181977-root\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.571111 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.571082    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft9gr\" (UniqueName: \"kubernetes.io/projected/9ab36021-eea1-424a-9e63-84c45ea557ef-kube-api-access-ft9gr\") pod \"openshift-state-metrics-67dcf8c979-jjmrn\" (UID: \"9ab36021-eea1-424a-9e63-84c45ea557ef\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn"
Sep 15 07:06:14.571293 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.571110    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84bb02b4-6541-4aa5-b13d-e1dd1c181977-metrics-client-ca\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.571293 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.571144    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/84bb02b4-6541-4aa5-b13d-e1dd1c181977-node-exporter-wtmp\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.571293 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.571169    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/84bb02b4-6541-4aa5-b13d-e1dd1c181977-node-exporter-tls\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.571293 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.571224    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ab36021-eea1-424a-9e63-84c45ea557ef-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-jjmrn\" (UID: \"9ab36021-eea1-424a-9e63-84c45ea557ef\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn"
Sep 15 07:06:14.571293 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.571287    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84bb02b4-6541-4aa5-b13d-e1dd1c181977-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.571520 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.571313    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/84bb02b4-6541-4aa5-b13d-e1dd1c181977-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.571520 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.571346    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ab36021-eea1-424a-9e63-84c45ea557ef-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-jjmrn\" (UID: \"9ab36021-eea1-424a-9e63-84c45ea557ef\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn"
Sep 15 07:06:14.672027 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.671994    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84bb02b4-6541-4aa5-b13d-e1dd1c181977-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.672202 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.672039    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/84bb02b4-6541-4aa5-b13d-e1dd1c181977-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.672295 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.672272    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ab36021-eea1-424a-9e63-84c45ea557ef-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-jjmrn\" (UID: \"9ab36021-eea1-424a-9e63-84c45ea557ef\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn"
Sep 15 07:06:14.672355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.672337    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84bb02b4-6541-4aa5-b13d-e1dd1c181977-sys\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.672409 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.672393    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dvzq\" (UniqueName: \"kubernetes.io/projected/84bb02b4-6541-4aa5-b13d-e1dd1c181977-kube-api-access-7dvzq\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.672457 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.672440    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/84bb02b4-6541-4aa5-b13d-e1dd1c181977-node-exporter-textfile\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.672505 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.672449    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84bb02b4-6541-4aa5-b13d-e1dd1c181977-sys\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.672505 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.672477    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ab36021-eea1-424a-9e63-84c45ea557ef-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-jjmrn\" (UID: \"9ab36021-eea1-424a-9e63-84c45ea557ef\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn"
Sep 15 07:06:14.672615 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.672503    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/84bb02b4-6541-4aa5-b13d-e1dd1c181977-root\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.672615 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.672536    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft9gr\" (UniqueName: \"kubernetes.io/projected/9ab36021-eea1-424a-9e63-84c45ea557ef-kube-api-access-ft9gr\") pod \"openshift-state-metrics-67dcf8c979-jjmrn\" (UID: \"9ab36021-eea1-424a-9e63-84c45ea557ef\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn"
Sep 15 07:06:14.672615 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.672566    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84bb02b4-6541-4aa5-b13d-e1dd1c181977-metrics-client-ca\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.672615 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.672596    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/84bb02b4-6541-4aa5-b13d-e1dd1c181977-node-exporter-wtmp\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.672836 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.672611    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/84bb02b4-6541-4aa5-b13d-e1dd1c181977-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.672836 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.672622    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/84bb02b4-6541-4aa5-b13d-e1dd1c181977-node-exporter-tls\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.672836 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.672675    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ab36021-eea1-424a-9e63-84c45ea557ef-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-jjmrn\" (UID: \"9ab36021-eea1-424a-9e63-84c45ea557ef\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn"
Sep 15 07:06:14.672836 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.672753    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/84bb02b4-6541-4aa5-b13d-e1dd1c181977-node-exporter-textfile\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.672836 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.672817    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/84bb02b4-6541-4aa5-b13d-e1dd1c181977-root\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.673081 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.672948    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/84bb02b4-6541-4aa5-b13d-e1dd1c181977-node-exporter-wtmp\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.673135 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.673105    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84bb02b4-6541-4aa5-b13d-e1dd1c181977-metrics-client-ca\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.673135 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.673121    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ab36021-eea1-424a-9e63-84c45ea557ef-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-jjmrn\" (UID: \"9ab36021-eea1-424a-9e63-84c45ea557ef\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn"
Sep 15 07:06:14.675575 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.675548    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84bb02b4-6541-4aa5-b13d-e1dd1c181977-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.675736 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.675700    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/84bb02b4-6541-4aa5-b13d-e1dd1c181977-node-exporter-tls\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.676083 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.676064    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ab36021-eea1-424a-9e63-84c45ea557ef-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-jjmrn\" (UID: \"9ab36021-eea1-424a-9e63-84c45ea557ef\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn"
Sep 15 07:06:14.676293 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.676273    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ab36021-eea1-424a-9e63-84c45ea557ef-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-jjmrn\" (UID: \"9ab36021-eea1-424a-9e63-84c45ea557ef\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn"
Sep 15 07:06:14.680494 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.680445    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dvzq\" (UniqueName: \"kubernetes.io/projected/84bb02b4-6541-4aa5-b13d-e1dd1c181977-kube-api-access-7dvzq\") pod \"node-exporter-4qbl5\" (UID: \"84bb02b4-6541-4aa5-b13d-e1dd1c181977\") " pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:14.681264 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.681242    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft9gr\" (UniqueName: \"kubernetes.io/projected/9ab36021-eea1-424a-9e63-84c45ea557ef-kube-api-access-ft9gr\") pod \"openshift-state-metrics-67dcf8c979-jjmrn\" (UID: \"9ab36021-eea1-424a-9e63-84c45ea557ef\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn"
Sep 15 07:06:14.699689 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.699662    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn"
Sep 15 07:06:14.725511 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:14.725480    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4qbl5"
Sep 15 07:06:15.454579 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.454539    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 07:06:15.458910 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.458888    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.461253 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.461231    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 15 07:06:15.461253 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.461247    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 15 07:06:15.461408 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.461247    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 15 07:06:15.461945 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.461927    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 15 07:06:15.462093 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.461975    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 15 07:06:15.462093 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.461975    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 15 07:06:15.462093 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.462024    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 15 07:06:15.462093 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.462032    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 15 07:06:15.462363 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.462339    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6zj78\""
Sep 15 07:06:15.462562 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.462490    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 15 07:06:15.471911 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.471892    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 07:06:15.583521 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.583486    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-config-volume\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.583741 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.583540    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.583741 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.583581    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.583741 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.583640    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.583741 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.583699    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wvjt\" (UniqueName: \"kubernetes.io/projected/cfe9b16c-ea73-4113-8c20-6a692be955f6-kube-api-access-8wvjt\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.583955 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.583744    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.583955 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.583783    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-web-config\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.583955 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.583808    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.583955 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.583835    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfe9b16c-ea73-4113-8c20-6a692be955f6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.583955 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.583890    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfe9b16c-ea73-4113-8c20-6a692be955f6-config-out\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.584120 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.583989    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cfe9b16c-ea73-4113-8c20-6a692be955f6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.584120 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.584020    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfe9b16c-ea73-4113-8c20-6a692be955f6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.584120 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.584052    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfe9b16c-ea73-4113-8c20-6a692be955f6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.685320 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.685281    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cfe9b16c-ea73-4113-8c20-6a692be955f6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.685320 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.685324    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfe9b16c-ea73-4113-8c20-6a692be955f6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.685563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.685350    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfe9b16c-ea73-4113-8c20-6a692be955f6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.685563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.685370    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-config-volume\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.685563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.685401    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.685563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.685419    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.685563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.685440    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.685563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.685473    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvjt\" (UniqueName: \"kubernetes.io/projected/cfe9b16c-ea73-4113-8c20-6a692be955f6-kube-api-access-8wvjt\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.685563 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:06:15.685495    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfe9b16c-ea73-4113-8c20-6a692be955f6-alertmanager-trusted-ca-bundle podName:cfe9b16c-ea73-4113-8c20-6a692be955f6 nodeName:}" failed. No retries permitted until 2026-09-15 07:06:16.185470367 +0000 UTC m=+315.976388185 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/cfe9b16c-ea73-4113-8c20-6a692be955f6-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "cfe9b16c-ea73-4113-8c20-6a692be955f6") : configmap references non-existent config key: ca-bundle.crt
Sep 15 07:06:15.685563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.685545    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.685969 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.685578    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-web-config\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.685969 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.685601    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.685969 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.685633    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfe9b16c-ea73-4113-8c20-6a692be955f6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.685969 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.685686    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfe9b16c-ea73-4113-8c20-6a692be955f6-config-out\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.685969 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.685789    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cfe9b16c-ea73-4113-8c20-6a692be955f6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.686224 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.686190    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfe9b16c-ea73-4113-8c20-6a692be955f6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.688992 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.688888    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfe9b16c-ea73-4113-8c20-6a692be955f6-config-out\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.688992 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.688948    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-web-config\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.689214 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.689185    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.689397 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.689356    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.689655 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.689634    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.689792 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.689767    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfe9b16c-ea73-4113-8c20-6a692be955f6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.690040 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.690022    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-config-volume\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.690486 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.690469    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.691613 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.691595    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:15.696947 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:15.696924    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wvjt\" (UniqueName: \"kubernetes.io/projected/cfe9b16c-ea73-4113-8c20-6a692be955f6-kube-api-access-8wvjt\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:16.190911 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.190850    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfe9b16c-ea73-4113-8c20-6a692be955f6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:16.191774 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.191747    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfe9b16c-ea73-4113-8c20-6a692be955f6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:16.370565 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.370534    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:06:16.441406 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.441324    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"]
Sep 15 07:06:16.445491 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.445469    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.448861 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.448826    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 15 07:06:16.448985 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.448879    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 15 07:06:16.449181 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.449166    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 15 07:06:16.449384 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.449371    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 15 07:06:16.449858 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.449688    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-67p77\""
Sep 15 07:06:16.449858 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.449751    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 15 07:06:16.449858 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.449817    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-eiknnrdbdabe\""
Sep 15 07:06:16.460437 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.460415    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"]
Sep 15 07:06:16.595042 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.595009    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/846145ce-5668-4682-920a-64532767e101-metrics-client-ca\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.595042 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.595047    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/846145ce-5668-4682-920a-64532767e101-secret-thanos-querier-tls\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.595267 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.595148    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/846145ce-5668-4682-920a-64532767e101-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.595267 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.595184    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/846145ce-5668-4682-920a-64532767e101-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.595267 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.595216    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/846145ce-5668-4682-920a-64532767e101-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.595404 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.595319    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/846145ce-5668-4682-920a-64532767e101-secret-grpc-tls\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.595404 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.595377    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/846145ce-5668-4682-920a-64532767e101-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.595485 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.595403    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpmp8\" (UniqueName: \"kubernetes.io/projected/846145ce-5668-4682-920a-64532767e101-kube-api-access-hpmp8\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.696060 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.695970    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/846145ce-5668-4682-920a-64532767e101-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.696060 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.696022    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpmp8\" (UniqueName: \"kubernetes.io/projected/846145ce-5668-4682-920a-64532767e101-kube-api-access-hpmp8\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.696287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.696064    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/846145ce-5668-4682-920a-64532767e101-metrics-client-ca\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.696287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.696149    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/846145ce-5668-4682-920a-64532767e101-secret-thanos-querier-tls\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.696287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.696242    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/846145ce-5668-4682-920a-64532767e101-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.696287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.696281    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/846145ce-5668-4682-920a-64532767e101-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.696487 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.696324    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/846145ce-5668-4682-920a-64532767e101-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.696487 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.696375    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/846145ce-5668-4682-920a-64532767e101-secret-grpc-tls\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.696957 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.696885    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/846145ce-5668-4682-920a-64532767e101-metrics-client-ca\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.705135 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.699581    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/846145ce-5668-4682-920a-64532767e101-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.705135 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.699688    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/846145ce-5668-4682-920a-64532767e101-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.705135 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.699790    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/846145ce-5668-4682-920a-64532767e101-secret-grpc-tls\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.705135 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.699872    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/846145ce-5668-4682-920a-64532767e101-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.705135 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.700088    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/846145ce-5668-4682-920a-64532767e101-secret-thanos-querier-tls\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.705135 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.700112    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/846145ce-5668-4682-920a-64532767e101-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.705135 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.704612    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpmp8\" (UniqueName: \"kubernetes.io/projected/846145ce-5668-4682-920a-64532767e101-kube-api-access-hpmp8\") pod \"thanos-querier-6ffd4d9f94-mwf2f\" (UID: \"846145ce-5668-4682-920a-64532767e101\") " pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:16.756727 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:16.756681    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:17.686560 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:06:17.686526    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84bb02b4_6541_4aa5_b13d_e1dd1c181977.slice/crio-30190e0b08d1335cb849be70ac9cc8e620fa258411244364faf7df7adc4391f7 WatchSource:0}: Error finding container 30190e0b08d1335cb849be70ac9cc8e620fa258411244364faf7df7adc4391f7: Status 404 returned error can't find the container with id 30190e0b08d1335cb849be70ac9cc8e620fa258411244364faf7df7adc4391f7
Sep 15 07:06:17.717179 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:17.716045    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 07:06:17.957565 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:17.957447    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn"]
Sep 15 07:06:17.961501 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:06:17.961465    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab36021_eea1_424a_9e63_84c45ea557ef.slice/crio-3e2828b1f39a99e2eb68e3c61da8ae5112890e1d1ea18e043823a3b12000b602 WatchSource:0}: Error finding container 3e2828b1f39a99e2eb68e3c61da8ae5112890e1d1ea18e043823a3b12000b602: Status 404 returned error can't find the container with id 3e2828b1f39a99e2eb68e3c61da8ae5112890e1d1ea18e043823a3b12000b602
Sep 15 07:06:17.975243 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:17.975207    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"]
Sep 15 07:06:17.977447 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:17.977421    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 07:06:17.978058 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:06:17.978027    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846145ce_5668_4682_920a_64532767e101.slice/crio-c5014e3a08d7981613701b0c74cf056bfa0ca988fc61b7bdbca894fce2ffc68b WatchSource:0}: Error finding container c5014e3a08d7981613701b0c74cf056bfa0ca988fc61b7bdbca894fce2ffc68b: Status 404 returned error can't find the container with id c5014e3a08d7981613701b0c74cf056bfa0ca988fc61b7bdbca894fce2ffc68b
Sep 15 07:06:17.981313 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:06:17.981267    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe9b16c_ea73_4113_8c20_6a692be955f6.slice/crio-250c0aba5ec2e982bad60a43881af7fda8591d6fd448ebe07d3acdb8c0226616 WatchSource:0}: Error finding container 250c0aba5ec2e982bad60a43881af7fda8591d6fd448ebe07d3acdb8c0226616: Status 404 returned error can't find the container with id 250c0aba5ec2e982bad60a43881af7fda8591d6fd448ebe07d3acdb8c0226616
Sep 15 07:06:18.681699 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:18.681649    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-jfxld" event={"ID":"4803d979-5738-459d-9aab-27bd1d842697","Type":"ContainerStarted","Data":"2ae2c3faba4464cdfd043ae54bc552b80443648de387cd31c6f86ac79082ea70"}
Sep 15 07:06:18.682659 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:18.682631    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-jfxld"
Sep 15 07:06:18.685300 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:18.685272    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qbl5" event={"ID":"84bb02b4-6541-4aa5-b13d-e1dd1c181977","Type":"ContainerStarted","Data":"30190e0b08d1335cb849be70ac9cc8e620fa258411244364faf7df7adc4391f7"}
Sep 15 07:06:18.687220 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:18.687193    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfe9b16c-ea73-4113-8c20-6a692be955f6","Type":"ContainerStarted","Data":"250c0aba5ec2e982bad60a43881af7fda8591d6fd448ebe07d3acdb8c0226616"}
Sep 15 07:06:18.689300 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:18.689267    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f" event={"ID":"846145ce-5668-4682-920a-64532767e101","Type":"ContainerStarted","Data":"c5014e3a08d7981613701b0c74cf056bfa0ca988fc61b7bdbca894fce2ffc68b"}
Sep 15 07:06:18.692195 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:18.692173    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-jfxld"
Sep 15 07:06:18.696921 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:18.696789    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn" event={"ID":"9ab36021-eea1-424a-9e63-84c45ea557ef","Type":"ContainerStarted","Data":"16250fa4bd936f9bd7ade2112bd932aecaf557ad1f6f9d904649e93f0825163c"}
Sep 15 07:06:18.696921 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:18.696855    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn" event={"ID":"9ab36021-eea1-424a-9e63-84c45ea557ef","Type":"ContainerStarted","Data":"38cd72d614bfc67ed4b519ebeffaee441a86463dc4e0791232dece8a12f985c6"}
Sep 15 07:06:18.696921 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:18.696883    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn" event={"ID":"9ab36021-eea1-424a-9e63-84c45ea557ef","Type":"ContainerStarted","Data":"3e2828b1f39a99e2eb68e3c61da8ae5112890e1d1ea18e043823a3b12000b602"}
Sep 15 07:06:18.701112 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:18.700485    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-jfxld" podStartSLOduration=2.50206692 podStartE2EDuration="18.700469562s" totalImagesPullingTime="16.198402642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:06:18.699155126 +0000 UTC m=+318.490072947" watchObservedRunningTime="2026-09-15 07:06:18.700469562 +0000 UTC m=+318.491387384"
Sep 15 07:06:19.703869 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:19.703829    2568 generic.go:356] "Generic (PLEG): container finished" podID="84bb02b4-6541-4aa5-b13d-e1dd1c181977" containerID="e2e8dde8ee96fcd111c6616d823aa337f2236d0536b5bb2bc94b3be1d46089ec" exitCode=0
Sep 15 07:06:19.704600 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:19.704019    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qbl5" event={"ID":"84bb02b4-6541-4aa5-b13d-e1dd1c181977","Type":"ContainerDied","Data":"e2e8dde8ee96fcd111c6616d823aa337f2236d0536b5bb2bc94b3be1d46089ec"}
Sep 15 07:06:20.711703 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:20.711653    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qbl5" event={"ID":"84bb02b4-6541-4aa5-b13d-e1dd1c181977","Type":"ContainerStarted","Data":"80f60a138c52185d44f76523926d621f0174ff6d9f1a2df91d89c0a1b0a4b6b8"}
Sep 15 07:06:20.712178 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:20.711813    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qbl5" event={"ID":"84bb02b4-6541-4aa5-b13d-e1dd1c181977","Type":"ContainerStarted","Data":"c86e4b1187740d42c8adfd9d59ece23caee1f16241d875da2a39baafe3913545"}
Sep 15 07:06:22.729688 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:22.729649    2568 generic.go:356] "Generic (PLEG): container finished" podID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerID="5159bbe007687b5488ad899bd78579a32bf490e581ae8740ef304271e280d96a" exitCode=0
Sep 15 07:06:22.730174 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:22.729743    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfe9b16c-ea73-4113-8c20-6a692be955f6","Type":"ContainerDied","Data":"5159bbe007687b5488ad899bd78579a32bf490e581ae8740ef304271e280d96a"}
Sep 15 07:06:22.732466 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:22.732435    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f" event={"ID":"846145ce-5668-4682-920a-64532767e101","Type":"ContainerStarted","Data":"cbe721ed3f49796aac01007d9e095373ace57a28624b53078e3d8e4c28f238cf"}
Sep 15 07:06:22.732575 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:22.732508    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f" event={"ID":"846145ce-5668-4682-920a-64532767e101","Type":"ContainerStarted","Data":"98435c3f3c97ceb054bbfec1b765283312f4a2f688809d17eb0018a32f038163"}
Sep 15 07:06:22.732575 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:22.732550    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f" event={"ID":"846145ce-5668-4682-920a-64532767e101","Type":"ContainerStarted","Data":"f62029989915a4ed8257c31f21898c84926d074c9a4ac8a7ee22d5ed95c88641"}
Sep 15 07:06:22.735061 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:22.735036    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn" event={"ID":"9ab36021-eea1-424a-9e63-84c45ea557ef","Type":"ContainerStarted","Data":"cff51101958250101d29781941a6c3d7ddf61aeb46359bc90b0fa6e83cbb7cc4"}
Sep 15 07:06:22.756869 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:22.756813    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4qbl5" podStartSLOduration=7.368789207 podStartE2EDuration="8.756791724s" totalImagesPullingTime="1.271821194s" totalInitContainerRuntime="116.181323ms" isStatefulPod=true podCreationTimestamp="2026-09-15 07:06:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:06:20.734721283 +0000 UTC m=+320.525639098" watchObservedRunningTime="2026-09-15 07:06:22.756791724 +0000 UTC m=+322.547709546"
Sep 15 07:06:22.771464 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:22.771411    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jjmrn" podStartSLOduration=5.041594904 podStartE2EDuration="8.771394599s" totalImagesPullingTime="3.729799695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:06:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:06:22.76986265 +0000 UTC m=+322.560780475" watchObservedRunningTime="2026-09-15 07:06:22.771394599 +0000 UTC m=+322.562312420"
Sep 15 07:06:23.113458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.113372    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66d455df47-mx8t7"]
Sep 15 07:06:23.127474 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.127439    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66d455df47-mx8t7"]
Sep 15 07:06:23.127643 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.127581    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.129974 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.129946    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 15 07:06:23.130130 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.130110    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 15 07:06:23.130232 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.130212    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 15 07:06:23.130335 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.130231    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 15 07:06:23.130390 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.130333    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 15 07:06:23.130441 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.130404    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-f7qfg\""
Sep 15 07:06:23.136110 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.135835    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 15 07:06:23.164165 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.164134    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-service-ca\") pod \"console-66d455df47-mx8t7\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") " pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.164351 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.164185    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c23b48d-a009-47b2-a462-4e4fadb6cb87-console-oauth-config\") pod \"console-66d455df47-mx8t7\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") " pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.164351 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.164244    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c23b48d-a009-47b2-a462-4e4fadb6cb87-console-serving-cert\") pod \"console-66d455df47-mx8t7\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") " pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.164351 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.164284    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pt74\" (UniqueName: \"kubernetes.io/projected/0c23b48d-a009-47b2-a462-4e4fadb6cb87-kube-api-access-8pt74\") pod \"console-66d455df47-mx8t7\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") " pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.164351 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.164332    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-oauth-serving-cert\") pod \"console-66d455df47-mx8t7\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") " pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.164571 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.164352    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-console-config\") pod \"console-66d455df47-mx8t7\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") " pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.164571 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.164431    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-trusted-ca-bundle\") pod \"console-66d455df47-mx8t7\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") " pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.177421 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.177389    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5df6c7b697-6fm58"]
Sep 15 07:06:23.265702 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.265663    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pt74\" (UniqueName: \"kubernetes.io/projected/0c23b48d-a009-47b2-a462-4e4fadb6cb87-kube-api-access-8pt74\") pod \"console-66d455df47-mx8t7\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") " pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.266210 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.266074    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-oauth-serving-cert\") pod \"console-66d455df47-mx8t7\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") " pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.266210 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.266204    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-console-config\") pod \"console-66d455df47-mx8t7\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") " pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.266398 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.266296    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-trusted-ca-bundle\") pod \"console-66d455df47-mx8t7\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") " pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.266398 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.266340    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-service-ca\") pod \"console-66d455df47-mx8t7\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") " pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.266398 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.266368    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c23b48d-a009-47b2-a462-4e4fadb6cb87-console-oauth-config\") pod \"console-66d455df47-mx8t7\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") " pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.266588 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.266414    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c23b48d-a009-47b2-a462-4e4fadb6cb87-console-serving-cert\") pod \"console-66d455df47-mx8t7\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") " pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.267345 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.267097    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-console-config\") pod \"console-66d455df47-mx8t7\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") " pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.267503 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.267435    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-service-ca\") pod \"console-66d455df47-mx8t7\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") " pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.267503 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.267474    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-oauth-serving-cert\") pod \"console-66d455df47-mx8t7\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") " pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.268643 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.268596    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-trusted-ca-bundle\") pod \"console-66d455df47-mx8t7\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") " pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.270109 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.270068    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c23b48d-a009-47b2-a462-4e4fadb6cb87-console-oauth-config\") pod \"console-66d455df47-mx8t7\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") " pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.271266 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.271225    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c23b48d-a009-47b2-a462-4e4fadb6cb87-console-serving-cert\") pod \"console-66d455df47-mx8t7\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") " pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.274524 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.274504    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pt74\" (UniqueName: \"kubernetes.io/projected/0c23b48d-a009-47b2-a462-4e4fadb6cb87-kube-api-access-8pt74\") pod \"console-66d455df47-mx8t7\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") " pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.440352 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.440315    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:23.880525 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:23.880495    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66d455df47-mx8t7"]
Sep 15 07:06:23.905002 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:06:23.904974    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c23b48d_a009_47b2_a462_4e4fadb6cb87.slice/crio-bfc31a27ae59de485afc66fa95554e7800b5370b63a53ff2542d9fe25b4bcbb5 WatchSource:0}: Error finding container bfc31a27ae59de485afc66fa95554e7800b5370b63a53ff2542d9fe25b4bcbb5: Status 404 returned error can't find the container with id bfc31a27ae59de485afc66fa95554e7800b5370b63a53ff2542d9fe25b4bcbb5
Sep 15 07:06:24.747544 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:24.747339    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d455df47-mx8t7" event={"ID":"0c23b48d-a009-47b2-a462-4e4fadb6cb87","Type":"ContainerStarted","Data":"bfc31a27ae59de485afc66fa95554e7800b5370b63a53ff2542d9fe25b4bcbb5"}
Sep 15 07:06:24.752829 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:24.752768    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f" event={"ID":"846145ce-5668-4682-920a-64532767e101","Type":"ContainerStarted","Data":"cbc5cb6ba861af9020674dfc3e0afa7c61d5b82179ee4e6dab413ccd946284b6"}
Sep 15 07:06:24.753052 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:24.752848    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f" event={"ID":"846145ce-5668-4682-920a-64532767e101","Type":"ContainerStarted","Data":"2f99d5e81efbc690960b2bcd121e1a535cd47782697845dd292f5c7c42325a07"}
Sep 15 07:06:24.753052 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:24.752891    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f" event={"ID":"846145ce-5668-4682-920a-64532767e101","Type":"ContainerStarted","Data":"9453be14db022ef0876dbd40482ee2f385975385737a2736c737ff6075a59751"}
Sep 15 07:06:24.753349 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:24.753181    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:24.779364 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:24.778900    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f" podStartSLOduration=3.306311145 podStartE2EDuration="8.778877658s" totalImagesPullingTime="5.472566513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:06:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:06:24.776268806 +0000 UTC m=+324.567186628" watchObservedRunningTime="2026-09-15 07:06:24.778877658 +0000 UTC m=+324.569795482"
Sep 15 07:06:26.767537 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:26.767478    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfe9b16c-ea73-4113-8c20-6a692be955f6","Type":"ContainerStarted","Data":"c70c0c266373673ba73092f610c598c86d777fe9f600f80f16d8532edabcfab7"}
Sep 15 07:06:26.768025 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:26.767572    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfe9b16c-ea73-4113-8c20-6a692be955f6","Type":"ContainerStarted","Data":"e1fd24cb1ff3fa7f26e37d245b8901c708edc5f5859998b2c0a7feed8db9ed29"}
Sep 15 07:06:26.768025 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:26.767614    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfe9b16c-ea73-4113-8c20-6a692be955f6","Type":"ContainerStarted","Data":"9c527a70ca1c26f684fc0d4d4ac1736c4b3d333447f7f3586dc5b9e22ae92f52"}
Sep 15 07:06:27.776284 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:27.776250    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfe9b16c-ea73-4113-8c20-6a692be955f6","Type":"ContainerStarted","Data":"92fd3f62811694fe4ba48c93ccba051a09251deb0b7050296e2501f2e82c554e"}
Sep 15 07:06:27.776646 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:27.776330    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfe9b16c-ea73-4113-8c20-6a692be955f6","Type":"ContainerStarted","Data":"59b2ff0bdeb5964a19b1e4381bb157e1d570d25c5b41c4e20e73c60a3c582dde"}
Sep 15 07:06:28.782914 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:28.782879    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfe9b16c-ea73-4113-8c20-6a692be955f6","Type":"ContainerStarted","Data":"d2921582d2f5418c63422ff30a78563c2747dece8bc91c72abb0dfea4445368c"}
Sep 15 07:06:28.784405 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:28.784381    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d455df47-mx8t7" event={"ID":"0c23b48d-a009-47b2-a462-4e4fadb6cb87","Type":"ContainerStarted","Data":"bc3a05e04b3eb07d109895d8f731c3a4fe5bcbb93ddce80b065b7246d181b288"}
Sep 15 07:06:28.808339 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:28.808295    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=6.79574925 podStartE2EDuration="13.80827905s" totalImagesPullingTime="6.992376651s" totalInitContainerRuntime="20.153149ms" isStatefulPod=false podCreationTimestamp="2026-09-15 07:06:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:06:28.808019839 +0000 UTC m=+328.598937659" watchObservedRunningTime="2026-09-15 07:06:28.80827905 +0000 UTC m=+328.599196867"
Sep 15 07:06:28.826174 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:28.825670    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66d455df47-mx8t7" podStartSLOduration=1.801729398 podStartE2EDuration="5.825647414s" totalImagesPullingTime="4.023918016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:06:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:06:28.824009479 +0000 UTC m=+328.614927301" watchObservedRunningTime="2026-09-15 07:06:28.825647414 +0000 UTC m=+328.616565236"
Sep 15 07:06:30.765563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:30.765536    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6ffd4d9f94-mwf2f"
Sep 15 07:06:33.441128 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:33.441090    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:33.441534 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:33.441154    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:33.446114 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:33.446089    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:33.808753 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:33.808657    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:06:48.204540 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.204492    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5df6c7b697-6fm58" podUID="4b4fdda1-c7ea-4720-992f-a125c1ba938d" containerName="registry" containerID="cri-o://5241c8901535a5d80c74e1f4fa7427f4d2b5132aa2a9c036f2f1f93de850d0e3" gracePeriod=30
Sep 15 07:06:48.487972 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.487941    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:06:48.595759 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.595705    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qs7h\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-kube-api-access-5qs7h\") pod \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") "
Sep 15 07:06:48.595938 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.595802    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b4fdda1-c7ea-4720-992f-a125c1ba938d-installation-pull-secrets\") pod \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") "
Sep 15 07:06:48.595938 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.595840    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls\") pod \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") "
Sep 15 07:06:48.595938 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.595871    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-certificates\") pod \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") "
Sep 15 07:06:48.595938 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.595902    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b4fdda1-c7ea-4720-992f-a125c1ba938d-image-registry-private-configuration\") pod \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") "
Sep 15 07:06:48.596137 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.595950    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-bound-sa-token\") pod \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") "
Sep 15 07:06:48.596137 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.595996    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b4fdda1-c7ea-4720-992f-a125c1ba938d-trusted-ca\") pod \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") "
Sep 15 07:06:48.596137 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.596020    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b4fdda1-c7ea-4720-992f-a125c1ba938d-ca-trust-extracted\") pod \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\" (UID: \"4b4fdda1-c7ea-4720-992f-a125c1ba938d\") "
Sep 15 07:06:48.596547 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.596402    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4b4fdda1-c7ea-4720-992f-a125c1ba938d" (UID: "4b4fdda1-c7ea-4720-992f-a125c1ba938d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 07:06:48.596781 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.596662    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b4fdda1-c7ea-4720-992f-a125c1ba938d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4b4fdda1-c7ea-4720-992f-a125c1ba938d" (UID: "4b4fdda1-c7ea-4720-992f-a125c1ba938d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 07:06:48.598563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.598516    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b4fdda1-c7ea-4720-992f-a125c1ba938d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4b4fdda1-c7ea-4720-992f-a125c1ba938d" (UID: "4b4fdda1-c7ea-4720-992f-a125c1ba938d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:06:48.598658 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.598573    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4b4fdda1-c7ea-4720-992f-a125c1ba938d" (UID: "4b4fdda1-c7ea-4720-992f-a125c1ba938d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:06:48.598658 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.598582    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4b4fdda1-c7ea-4720-992f-a125c1ba938d" (UID: "4b4fdda1-c7ea-4720-992f-a125c1ba938d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:06:48.598856 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.598839    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b4fdda1-c7ea-4720-992f-a125c1ba938d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4b4fdda1-c7ea-4720-992f-a125c1ba938d" (UID: "4b4fdda1-c7ea-4720-992f-a125c1ba938d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:06:48.598919 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.598897    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-kube-api-access-5qs7h" (OuterVolumeSpecName: "kube-api-access-5qs7h") pod "4b4fdda1-c7ea-4720-992f-a125c1ba938d" (UID: "4b4fdda1-c7ea-4720-992f-a125c1ba938d"). InnerVolumeSpecName "kube-api-access-5qs7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:06:48.604642 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.604618    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b4fdda1-c7ea-4720-992f-a125c1ba938d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4b4fdda1-c7ea-4720-992f-a125c1ba938d" (UID: "4b4fdda1-c7ea-4720-992f-a125c1ba938d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 07:06:48.697518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.697484    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qs7h\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-kube-api-access-5qs7h\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:06:48.697518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.697512    2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b4fdda1-c7ea-4720-992f-a125c1ba938d-installation-pull-secrets\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:06:48.697518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.697522    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:06:48.697768 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.697532    2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b4fdda1-c7ea-4720-992f-a125c1ba938d-registry-certificates\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:06:48.697768 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.697542    2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b4fdda1-c7ea-4720-992f-a125c1ba938d-image-registry-private-configuration\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:06:48.697768 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.697551    2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b4fdda1-c7ea-4720-992f-a125c1ba938d-bound-sa-token\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:06:48.697768 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.697563    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b4fdda1-c7ea-4720-992f-a125c1ba938d-trusted-ca\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:06:48.697768 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.697575    2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b4fdda1-c7ea-4720-992f-a125c1ba938d-ca-trust-extracted\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:06:48.862184 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.862148    2568 generic.go:356] "Generic (PLEG): container finished" podID="4b4fdda1-c7ea-4720-992f-a125c1ba938d" containerID="5241c8901535a5d80c74e1f4fa7427f4d2b5132aa2a9c036f2f1f93de850d0e3" exitCode=0
Sep 15 07:06:48.862371 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.862189    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5df6c7b697-6fm58" event={"ID":"4b4fdda1-c7ea-4720-992f-a125c1ba938d","Type":"ContainerDied","Data":"5241c8901535a5d80c74e1f4fa7427f4d2b5132aa2a9c036f2f1f93de850d0e3"}
Sep 15 07:06:48.862371 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.862233    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5df6c7b697-6fm58" event={"ID":"4b4fdda1-c7ea-4720-992f-a125c1ba938d","Type":"ContainerDied","Data":"f90765663e6ca823fa1171f798506ba91713aec7a56a453b2320ed3ac238b3bf"}
Sep 15 07:06:48.862371 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.862256    2568 scope.go:117] "RemoveContainer" containerID="5241c8901535a5d80c74e1f4fa7427f4d2b5132aa2a9c036f2f1f93de850d0e3"
Sep 15 07:06:48.862371 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.862192    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df6c7b697-6fm58"
Sep 15 07:06:48.880440 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.880423    2568 scope.go:117] "RemoveContainer" containerID="5241c8901535a5d80c74e1f4fa7427f4d2b5132aa2a9c036f2f1f93de850d0e3"
Sep 15 07:06:48.880769 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:06:48.880748    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5241c8901535a5d80c74e1f4fa7427f4d2b5132aa2a9c036f2f1f93de850d0e3\": container with ID starting with 5241c8901535a5d80c74e1f4fa7427f4d2b5132aa2a9c036f2f1f93de850d0e3 not found: ID does not exist" containerID="5241c8901535a5d80c74e1f4fa7427f4d2b5132aa2a9c036f2f1f93de850d0e3"
Sep 15 07:06:48.880819 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.880777    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5241c8901535a5d80c74e1f4fa7427f4d2b5132aa2a9c036f2f1f93de850d0e3"} err="failed to get container status \"5241c8901535a5d80c74e1f4fa7427f4d2b5132aa2a9c036f2f1f93de850d0e3\": rpc error: code = NotFound desc = could not find container \"5241c8901535a5d80c74e1f4fa7427f4d2b5132aa2a9c036f2f1f93de850d0e3\": container with ID starting with 5241c8901535a5d80c74e1f4fa7427f4d2b5132aa2a9c036f2f1f93de850d0e3 not found: ID does not exist"
Sep 15 07:06:48.894675 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.894650    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5df6c7b697-6fm58"]
Sep 15 07:06:48.898615 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:48.898592    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5df6c7b697-6fm58"]
Sep 15 07:06:49.867677 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:49.867645    2568 generic.go:356] "Generic (PLEG): container finished" podID="97764651-185b-4a70-a59a-138dd852cbef" containerID="4931d8a208c2ed5459b190dc1f46f68a3ddb7fcc0a3891eda9b6ae11a1b27b50" exitCode=0
Sep 15 07:06:49.868106 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:49.867738    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-x9hvx" event={"ID":"97764651-185b-4a70-a59a-138dd852cbef","Type":"ContainerDied","Data":"4931d8a208c2ed5459b190dc1f46f68a3ddb7fcc0a3891eda9b6ae11a1b27b50"}
Sep 15 07:06:49.868172 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:49.868123    2568 scope.go:117] "RemoveContainer" containerID="4931d8a208c2ed5459b190dc1f46f68a3ddb7fcc0a3891eda9b6ae11a1b27b50"
Sep 15 07:06:50.743535 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:50.743480    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b4fdda1-c7ea-4720-992f-a125c1ba938d" path="/var/lib/kubelet/pods/4b4fdda1-c7ea-4720-992f-a125c1ba938d/volumes"
Sep 15 07:06:50.874948 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:50.874914    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-x9hvx" event={"ID":"97764651-185b-4a70-a59a-138dd852cbef","Type":"ContainerStarted","Data":"d26595f9850ddcff41b47602d49651ad9248e7e5bb040243e65b5305906a8841"}
Sep 15 07:06:50.876280 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:50.876253    2568 generic.go:356] "Generic (PLEG): container finished" podID="13b6b89c-c6c2-445f-a32e-828c94f1ac35" containerID="1d007c586e26afa0bf488299c72e946339f707b1abf1baf1435b675ac71c1219" exitCode=0
Sep 15 07:06:50.876395 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:50.876308    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-whnrm" event={"ID":"13b6b89c-c6c2-445f-a32e-828c94f1ac35","Type":"ContainerDied","Data":"1d007c586e26afa0bf488299c72e946339f707b1abf1baf1435b675ac71c1219"}
Sep 15 07:06:50.876614 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:50.876598    2568 scope.go:117] "RemoveContainer" containerID="1d007c586e26afa0bf488299c72e946339f707b1abf1baf1435b675ac71c1219"
Sep 15 07:06:51.883053 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:51.883018    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-whnrm" event={"ID":"13b6b89c-c6c2-445f-a32e-828c94f1ac35","Type":"ContainerStarted","Data":"73edc5e4849eb103b7826ba893af0948fb17600eaaaba5bcf812ffa3cddcae81"}
Sep 15 07:06:55.900465 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:55.900429    2568 generic.go:356] "Generic (PLEG): container finished" podID="5c5ce87a-73d1-4c7d-92da-bab849f8e62a" containerID="0a6c26c31789b61a937dfdea98546bd1672ea50cad59930bfae05c18eefcd36a" exitCode=0
Sep 15 07:06:55.900850 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:55.900504    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-wpk8h" event={"ID":"5c5ce87a-73d1-4c7d-92da-bab849f8e62a","Type":"ContainerDied","Data":"0a6c26c31789b61a937dfdea98546bd1672ea50cad59930bfae05c18eefcd36a"}
Sep 15 07:06:55.900904 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:55.900864    2568 scope.go:117] "RemoveContainer" containerID="0a6c26c31789b61a937dfdea98546bd1672ea50cad59930bfae05c18eefcd36a"
Sep 15 07:06:56.905548 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:06:56.905516    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-wpk8h" event={"ID":"5c5ce87a-73d1-4c7d-92da-bab849f8e62a","Type":"ContainerStarted","Data":"d6cb87d602eeb25c2ddf1bfa1d37487d9e4415ffe7699dacb68b97b4174e318a"}
Sep 15 07:07:14.612175 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:14.612138    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs\") pod \"network-metrics-daemon-9r6zz\" (UID: \"8e7d8199-6790-4b03-bd95-5eeb637d2f99\") " pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:07:14.614504 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:14.614479    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e7d8199-6790-4b03-bd95-5eeb637d2f99-metrics-certs\") pod \"network-metrics-daemon-9r6zz\" (UID: \"8e7d8199-6790-4b03-bd95-5eeb637d2f99\") " pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:07:14.739057 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:14.739025    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h7d9j\""
Sep 15 07:07:14.746889 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:14.746871    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9r6zz"
Sep 15 07:07:15.013058 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:15.012991    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9r6zz"]
Sep 15 07:07:15.015894 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:07:15.015863    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e7d8199_6790_4b03_bd95_5eeb637d2f99.slice/crio-ca2ae8de70a2c27c0afc3b03cc62fbfacbcc272e213adc9ba2256f3497cbd59c WatchSource:0}: Error finding container ca2ae8de70a2c27c0afc3b03cc62fbfacbcc272e213adc9ba2256f3497cbd59c: Status 404 returned error can't find the container with id ca2ae8de70a2c27c0afc3b03cc62fbfacbcc272e213adc9ba2256f3497cbd59c
Sep 15 07:07:15.988846 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:15.988811    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9r6zz" event={"ID":"8e7d8199-6790-4b03-bd95-5eeb637d2f99","Type":"ContainerStarted","Data":"ca2ae8de70a2c27c0afc3b03cc62fbfacbcc272e213adc9ba2256f3497cbd59c"}
Sep 15 07:07:16.994973 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:16.994933    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9r6zz" event={"ID":"8e7d8199-6790-4b03-bd95-5eeb637d2f99","Type":"ContainerStarted","Data":"13dd9266270a7533239d8c867ba17a7cc325da1f61f9e105d2516d94a6df92af"}
Sep 15 07:07:16.995395 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:16.994989    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9r6zz" event={"ID":"8e7d8199-6790-4b03-bd95-5eeb637d2f99","Type":"ContainerStarted","Data":"6f673c76be0eb0eeb0c3c2e763d5edb4216112c8f6876145451c28120d7fb414"}
Sep 15 07:07:17.013291 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:17.013104    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9r6zz" podStartSLOduration=374.668038241 podStartE2EDuration="6m16.013086976s" totalImagesPullingTime="1.345048735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:07:17.01272929 +0000 UTC m=+376.803647102" watchObservedRunningTime="2026-09-15 07:07:17.013086976 +0000 UTC m=+376.804004798"
Sep 15 07:07:34.672887 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:34.672851    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 07:07:34.673414 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:34.673157    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="alertmanager" containerID="cri-o://9c527a70ca1c26f684fc0d4d4ac1736c4b3d333447f7f3586dc5b9e22ae92f52" gracePeriod=120
Sep 15 07:07:34.673414 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:34.673210    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="kube-rbac-proxy-metric" containerID="cri-o://92fd3f62811694fe4ba48c93ccba051a09251deb0b7050296e2501f2e82c554e" gracePeriod=120
Sep 15 07:07:34.673414 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:34.673282    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="kube-rbac-proxy-web" containerID="cri-o://c70c0c266373673ba73092f610c598c86d777fe9f600f80f16d8532edabcfab7" gracePeriod=120
Sep 15 07:07:34.673414 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:34.673304    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="kube-rbac-proxy" containerID="cri-o://59b2ff0bdeb5964a19b1e4381bb157e1d570d25c5b41c4e20e73c60a3c582dde" gracePeriod=120
Sep 15 07:07:34.673414 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:34.673318    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="config-reloader" containerID="cri-o://e1fd24cb1ff3fa7f26e37d245b8901c708edc5f5859998b2c0a7feed8db9ed29" gracePeriod=120
Sep 15 07:07:34.673414 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:34.673334    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="prom-label-proxy" containerID="cri-o://d2921582d2f5418c63422ff30a78563c2747dece8bc91c72abb0dfea4445368c" gracePeriod=120
Sep 15 07:07:35.070690 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:35.070612    2568 generic.go:356] "Generic (PLEG): container finished" podID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerID="d2921582d2f5418c63422ff30a78563c2747dece8bc91c72abb0dfea4445368c" exitCode=0
Sep 15 07:07:35.070690 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:35.070636    2568 generic.go:356] "Generic (PLEG): container finished" podID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerID="92fd3f62811694fe4ba48c93ccba051a09251deb0b7050296e2501f2e82c554e" exitCode=0
Sep 15 07:07:35.070690 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:35.070643    2568 generic.go:356] "Generic (PLEG): container finished" podID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerID="59b2ff0bdeb5964a19b1e4381bb157e1d570d25c5b41c4e20e73c60a3c582dde" exitCode=0
Sep 15 07:07:35.070690 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:35.070648    2568 generic.go:356] "Generic (PLEG): container finished" podID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerID="e1fd24cb1ff3fa7f26e37d245b8901c708edc5f5859998b2c0a7feed8db9ed29" exitCode=0
Sep 15 07:07:35.070690 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:35.070654    2568 generic.go:356] "Generic (PLEG): container finished" podID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerID="9c527a70ca1c26f684fc0d4d4ac1736c4b3d333447f7f3586dc5b9e22ae92f52" exitCode=0
Sep 15 07:07:35.070690 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:35.070678    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfe9b16c-ea73-4113-8c20-6a692be955f6","Type":"ContainerDied","Data":"d2921582d2f5418c63422ff30a78563c2747dece8bc91c72abb0dfea4445368c"}
Sep 15 07:07:35.071001 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:35.070755    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfe9b16c-ea73-4113-8c20-6a692be955f6","Type":"ContainerDied","Data":"92fd3f62811694fe4ba48c93ccba051a09251deb0b7050296e2501f2e82c554e"}
Sep 15 07:07:35.071001 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:35.070783    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfe9b16c-ea73-4113-8c20-6a692be955f6","Type":"ContainerDied","Data":"59b2ff0bdeb5964a19b1e4381bb157e1d570d25c5b41c4e20e73c60a3c582dde"}
Sep 15 07:07:35.071001 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:35.070808    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfe9b16c-ea73-4113-8c20-6a692be955f6","Type":"ContainerDied","Data":"e1fd24cb1ff3fa7f26e37d245b8901c708edc5f5859998b2c0a7feed8db9ed29"}
Sep 15 07:07:35.071001 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:35.070832    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfe9b16c-ea73-4113-8c20-6a692be955f6","Type":"ContainerDied","Data":"9c527a70ca1c26f684fc0d4d4ac1736c4b3d333447f7f3586dc5b9e22ae92f52"}
Sep 15 07:07:35.927947 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:35.927919    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.078506 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.078413    2568 generic.go:356] "Generic (PLEG): container finished" podID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerID="c70c0c266373673ba73092f610c598c86d777fe9f600f80f16d8532edabcfab7" exitCode=0
Sep 15 07:07:36.078506 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.078472    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfe9b16c-ea73-4113-8c20-6a692be955f6","Type":"ContainerDied","Data":"c70c0c266373673ba73092f610c598c86d777fe9f600f80f16d8532edabcfab7"}
Sep 15 07:07:36.078506 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.078497    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.078744 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.078546    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfe9b16c-ea73-4113-8c20-6a692be955f6","Type":"ContainerDied","Data":"250c0aba5ec2e982bad60a43881af7fda8591d6fd448ebe07d3acdb8c0226616"}
Sep 15 07:07:36.078744 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.078615    2568 scope.go:117] "RemoveContainer" containerID="d2921582d2f5418c63422ff30a78563c2747dece8bc91c72abb0dfea4445368c"
Sep 15 07:07:36.086431 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.086411    2568 scope.go:117] "RemoveContainer" containerID="92fd3f62811694fe4ba48c93ccba051a09251deb0b7050296e2501f2e82c554e"
Sep 15 07:07:36.091620 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.091596    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-web-config\") pod \"cfe9b16c-ea73-4113-8c20-6a692be955f6\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") "
Sep 15 07:07:36.091735 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.091629    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-kube-rbac-proxy-web\") pod \"cfe9b16c-ea73-4113-8c20-6a692be955f6\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") "
Sep 15 07:07:36.091735 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.091668    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-main-tls\") pod \"cfe9b16c-ea73-4113-8c20-6a692be955f6\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") "
Sep 15 07:07:36.091735 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.091685    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfe9b16c-ea73-4113-8c20-6a692be955f6-alertmanager-trusted-ca-bundle\") pod \"cfe9b16c-ea73-4113-8c20-6a692be955f6\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") "
Sep 15 07:07:36.091735 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.091705    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-cluster-tls-config\") pod \"cfe9b16c-ea73-4113-8c20-6a692be955f6\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") "
Sep 15 07:07:36.091950 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.091746    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-config-volume\") pod \"cfe9b16c-ea73-4113-8c20-6a692be955f6\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") "
Sep 15 07:07:36.092001 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.091960    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cfe9b16c-ea73-4113-8c20-6a692be955f6-alertmanager-main-db\") pod \"cfe9b16c-ea73-4113-8c20-6a692be955f6\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") "
Sep 15 07:07:36.092001 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.091995    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfe9b16c-ea73-4113-8c20-6a692be955f6-metrics-client-ca\") pod \"cfe9b16c-ea73-4113-8c20-6a692be955f6\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") "
Sep 15 07:07:36.092109 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.092048    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"cfe9b16c-ea73-4113-8c20-6a692be955f6\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") "
Sep 15 07:07:36.092109 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.092084    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wvjt\" (UniqueName: \"kubernetes.io/projected/cfe9b16c-ea73-4113-8c20-6a692be955f6-kube-api-access-8wvjt\") pod \"cfe9b16c-ea73-4113-8c20-6a692be955f6\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") "
Sep 15 07:07:36.092207 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.092153    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfe9b16c-ea73-4113-8c20-6a692be955f6-tls-assets\") pod \"cfe9b16c-ea73-4113-8c20-6a692be955f6\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") "
Sep 15 07:07:36.092207 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.092190    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfe9b16c-ea73-4113-8c20-6a692be955f6-config-out\") pod \"cfe9b16c-ea73-4113-8c20-6a692be955f6\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") "
Sep 15 07:07:36.092318 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.092154    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfe9b16c-ea73-4113-8c20-6a692be955f6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "cfe9b16c-ea73-4113-8c20-6a692be955f6" (UID: "cfe9b16c-ea73-4113-8c20-6a692be955f6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 07:07:36.092318 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.092229    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-kube-rbac-proxy\") pod \"cfe9b16c-ea73-4113-8c20-6a692be955f6\" (UID: \"cfe9b16c-ea73-4113-8c20-6a692be955f6\") "
Sep 15 07:07:36.092318 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.092285    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfe9b16c-ea73-4113-8c20-6a692be955f6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "cfe9b16c-ea73-4113-8c20-6a692be955f6" (UID: "cfe9b16c-ea73-4113-8c20-6a692be955f6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 07:07:36.092558 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.092534    2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfe9b16c-ea73-4113-8c20-6a692be955f6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:07:36.092625 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.092565    2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cfe9b16c-ea73-4113-8c20-6a692be955f6-alertmanager-main-db\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:07:36.092686 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.092659    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfe9b16c-ea73-4113-8c20-6a692be955f6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "cfe9b16c-ea73-4113-8c20-6a692be955f6" (UID: "cfe9b16c-ea73-4113-8c20-6a692be955f6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 07:07:36.094723 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.094571    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-config-volume" (OuterVolumeSpecName: "config-volume") pod "cfe9b16c-ea73-4113-8c20-6a692be955f6" (UID: "cfe9b16c-ea73-4113-8c20-6a692be955f6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:07:36.094723 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.094661    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfe9b16c-ea73-4113-8c20-6a692be955f6-kube-api-access-8wvjt" (OuterVolumeSpecName: "kube-api-access-8wvjt") pod "cfe9b16c-ea73-4113-8c20-6a692be955f6" (UID: "cfe9b16c-ea73-4113-8c20-6a692be955f6"). InnerVolumeSpecName "kube-api-access-8wvjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:07:36.094886 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.094789    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "cfe9b16c-ea73-4113-8c20-6a692be955f6" (UID: "cfe9b16c-ea73-4113-8c20-6a692be955f6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:07:36.095056 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.095024    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "cfe9b16c-ea73-4113-8c20-6a692be955f6" (UID: "cfe9b16c-ea73-4113-8c20-6a692be955f6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:07:36.095509 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.095492    2568 scope.go:117] "RemoveContainer" containerID="59b2ff0bdeb5964a19b1e4381bb157e1d570d25c5b41c4e20e73c60a3c582dde"
Sep 15 07:07:36.095731 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.095543    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfe9b16c-ea73-4113-8c20-6a692be955f6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "cfe9b16c-ea73-4113-8c20-6a692be955f6" (UID: "cfe9b16c-ea73-4113-8c20-6a692be955f6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:07:36.096483 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.096456    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "cfe9b16c-ea73-4113-8c20-6a692be955f6" (UID: "cfe9b16c-ea73-4113-8c20-6a692be955f6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:07:36.096595 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.096489    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "cfe9b16c-ea73-4113-8c20-6a692be955f6" (UID: "cfe9b16c-ea73-4113-8c20-6a692be955f6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:07:36.098127 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.098094    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfe9b16c-ea73-4113-8c20-6a692be955f6-config-out" (OuterVolumeSpecName: "config-out") pod "cfe9b16c-ea73-4113-8c20-6a692be955f6" (UID: "cfe9b16c-ea73-4113-8c20-6a692be955f6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 07:07:36.100351 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.100331    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "cfe9b16c-ea73-4113-8c20-6a692be955f6" (UID: "cfe9b16c-ea73-4113-8c20-6a692be955f6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:07:36.106895 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.106875    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-web-config" (OuterVolumeSpecName: "web-config") pod "cfe9b16c-ea73-4113-8c20-6a692be955f6" (UID: "cfe9b16c-ea73-4113-8c20-6a692be955f6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:07:36.113424 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.113406    2568 scope.go:117] "RemoveContainer" containerID="c70c0c266373673ba73092f610c598c86d777fe9f600f80f16d8532edabcfab7"
Sep 15 07:07:36.120107 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.120087    2568 scope.go:117] "RemoveContainer" containerID="e1fd24cb1ff3fa7f26e37d245b8901c708edc5f5859998b2c0a7feed8db9ed29"
Sep 15 07:07:36.126999 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.126980    2568 scope.go:117] "RemoveContainer" containerID="9c527a70ca1c26f684fc0d4d4ac1736c4b3d333447f7f3586dc5b9e22ae92f52"
Sep 15 07:07:36.133919 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.133903    2568 scope.go:117] "RemoveContainer" containerID="5159bbe007687b5488ad899bd78579a32bf490e581ae8740ef304271e280d96a"
Sep 15 07:07:36.140770 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.140750    2568 scope.go:117] "RemoveContainer" containerID="d2921582d2f5418c63422ff30a78563c2747dece8bc91c72abb0dfea4445368c"
Sep 15 07:07:36.141024 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:07:36.141005    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2921582d2f5418c63422ff30a78563c2747dece8bc91c72abb0dfea4445368c\": container with ID starting with d2921582d2f5418c63422ff30a78563c2747dece8bc91c72abb0dfea4445368c not found: ID does not exist" containerID="d2921582d2f5418c63422ff30a78563c2747dece8bc91c72abb0dfea4445368c"
Sep 15 07:07:36.141079 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.141033    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2921582d2f5418c63422ff30a78563c2747dece8bc91c72abb0dfea4445368c"} err="failed to get container status \"d2921582d2f5418c63422ff30a78563c2747dece8bc91c72abb0dfea4445368c\": rpc error: code = NotFound desc = could not find container \"d2921582d2f5418c63422ff30a78563c2747dece8bc91c72abb0dfea4445368c\": container with ID starting with d2921582d2f5418c63422ff30a78563c2747dece8bc91c72abb0dfea4445368c not found: ID does not exist"
Sep 15 07:07:36.141079 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.141052    2568 scope.go:117] "RemoveContainer" containerID="92fd3f62811694fe4ba48c93ccba051a09251deb0b7050296e2501f2e82c554e"
Sep 15 07:07:36.141315 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:07:36.141295    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92fd3f62811694fe4ba48c93ccba051a09251deb0b7050296e2501f2e82c554e\": container with ID starting with 92fd3f62811694fe4ba48c93ccba051a09251deb0b7050296e2501f2e82c554e not found: ID does not exist" containerID="92fd3f62811694fe4ba48c93ccba051a09251deb0b7050296e2501f2e82c554e"
Sep 15 07:07:36.141373 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.141326    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92fd3f62811694fe4ba48c93ccba051a09251deb0b7050296e2501f2e82c554e"} err="failed to get container status \"92fd3f62811694fe4ba48c93ccba051a09251deb0b7050296e2501f2e82c554e\": rpc error: code = NotFound desc = could not find container \"92fd3f62811694fe4ba48c93ccba051a09251deb0b7050296e2501f2e82c554e\": container with ID starting with 92fd3f62811694fe4ba48c93ccba051a09251deb0b7050296e2501f2e82c554e not found: ID does not exist"
Sep 15 07:07:36.141438 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.141349    2568 scope.go:117] "RemoveContainer" containerID="59b2ff0bdeb5964a19b1e4381bb157e1d570d25c5b41c4e20e73c60a3c582dde"
Sep 15 07:07:36.141630 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:07:36.141614    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59b2ff0bdeb5964a19b1e4381bb157e1d570d25c5b41c4e20e73c60a3c582dde\": container with ID starting with 59b2ff0bdeb5964a19b1e4381bb157e1d570d25c5b41c4e20e73c60a3c582dde not found: ID does not exist" containerID="59b2ff0bdeb5964a19b1e4381bb157e1d570d25c5b41c4e20e73c60a3c582dde"
Sep 15 07:07:36.141672 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.141635    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59b2ff0bdeb5964a19b1e4381bb157e1d570d25c5b41c4e20e73c60a3c582dde"} err="failed to get container status \"59b2ff0bdeb5964a19b1e4381bb157e1d570d25c5b41c4e20e73c60a3c582dde\": rpc error: code = NotFound desc = could not find container \"59b2ff0bdeb5964a19b1e4381bb157e1d570d25c5b41c4e20e73c60a3c582dde\": container with ID starting with 59b2ff0bdeb5964a19b1e4381bb157e1d570d25c5b41c4e20e73c60a3c582dde not found: ID does not exist"
Sep 15 07:07:36.141672 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.141648    2568 scope.go:117] "RemoveContainer" containerID="c70c0c266373673ba73092f610c598c86d777fe9f600f80f16d8532edabcfab7"
Sep 15 07:07:36.141918 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:07:36.141900    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c70c0c266373673ba73092f610c598c86d777fe9f600f80f16d8532edabcfab7\": container with ID starting with c70c0c266373673ba73092f610c598c86d777fe9f600f80f16d8532edabcfab7 not found: ID does not exist" containerID="c70c0c266373673ba73092f610c598c86d777fe9f600f80f16d8532edabcfab7"
Sep 15 07:07:36.141964 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.141924    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c70c0c266373673ba73092f610c598c86d777fe9f600f80f16d8532edabcfab7"} err="failed to get container status \"c70c0c266373673ba73092f610c598c86d777fe9f600f80f16d8532edabcfab7\": rpc error: code = NotFound desc = could not find container \"c70c0c266373673ba73092f610c598c86d777fe9f600f80f16d8532edabcfab7\": container with ID starting with c70c0c266373673ba73092f610c598c86d777fe9f600f80f16d8532edabcfab7 not found: ID does not exist"
Sep 15 07:07:36.141964 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.141937    2568 scope.go:117] "RemoveContainer" containerID="e1fd24cb1ff3fa7f26e37d245b8901c708edc5f5859998b2c0a7feed8db9ed29"
Sep 15 07:07:36.142162 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:07:36.142144    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1fd24cb1ff3fa7f26e37d245b8901c708edc5f5859998b2c0a7feed8db9ed29\": container with ID starting with e1fd24cb1ff3fa7f26e37d245b8901c708edc5f5859998b2c0a7feed8db9ed29 not found: ID does not exist" containerID="e1fd24cb1ff3fa7f26e37d245b8901c708edc5f5859998b2c0a7feed8db9ed29"
Sep 15 07:07:36.142225 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.142169    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1fd24cb1ff3fa7f26e37d245b8901c708edc5f5859998b2c0a7feed8db9ed29"} err="failed to get container status \"e1fd24cb1ff3fa7f26e37d245b8901c708edc5f5859998b2c0a7feed8db9ed29\": rpc error: code = NotFound desc = could not find container \"e1fd24cb1ff3fa7f26e37d245b8901c708edc5f5859998b2c0a7feed8db9ed29\": container with ID starting with e1fd24cb1ff3fa7f26e37d245b8901c708edc5f5859998b2c0a7feed8db9ed29 not found: ID does not exist"
Sep 15 07:07:36.142225 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.142190    2568 scope.go:117] "RemoveContainer" containerID="9c527a70ca1c26f684fc0d4d4ac1736c4b3d333447f7f3586dc5b9e22ae92f52"
Sep 15 07:07:36.142457 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:07:36.142442    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c527a70ca1c26f684fc0d4d4ac1736c4b3d333447f7f3586dc5b9e22ae92f52\": container with ID starting with 9c527a70ca1c26f684fc0d4d4ac1736c4b3d333447f7f3586dc5b9e22ae92f52 not found: ID does not exist" containerID="9c527a70ca1c26f684fc0d4d4ac1736c4b3d333447f7f3586dc5b9e22ae92f52"
Sep 15 07:07:36.142495 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.142462    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c527a70ca1c26f684fc0d4d4ac1736c4b3d333447f7f3586dc5b9e22ae92f52"} err="failed to get container status \"9c527a70ca1c26f684fc0d4d4ac1736c4b3d333447f7f3586dc5b9e22ae92f52\": rpc error: code = NotFound desc = could not find container \"9c527a70ca1c26f684fc0d4d4ac1736c4b3d333447f7f3586dc5b9e22ae92f52\": container with ID starting with 9c527a70ca1c26f684fc0d4d4ac1736c4b3d333447f7f3586dc5b9e22ae92f52 not found: ID does not exist"
Sep 15 07:07:36.142495 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.142474    2568 scope.go:117] "RemoveContainer" containerID="5159bbe007687b5488ad899bd78579a32bf490e581ae8740ef304271e280d96a"
Sep 15 07:07:36.142700 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:07:36.142683    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5159bbe007687b5488ad899bd78579a32bf490e581ae8740ef304271e280d96a\": container with ID starting with 5159bbe007687b5488ad899bd78579a32bf490e581ae8740ef304271e280d96a not found: ID does not exist" containerID="5159bbe007687b5488ad899bd78579a32bf490e581ae8740ef304271e280d96a"
Sep 15 07:07:36.142782 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.142707    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5159bbe007687b5488ad899bd78579a32bf490e581ae8740ef304271e280d96a"} err="failed to get container status \"5159bbe007687b5488ad899bd78579a32bf490e581ae8740ef304271e280d96a\": rpc error: code = NotFound desc = could not find container \"5159bbe007687b5488ad899bd78579a32bf490e581ae8740ef304271e280d96a\": container with ID starting with 5159bbe007687b5488ad899bd78579a32bf490e581ae8740ef304271e280d96a not found: ID does not exist"
Sep 15 07:07:36.193691 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.193651    2568 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfe9b16c-ea73-4113-8c20-6a692be955f6-config-out\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:07:36.193691 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.193684    2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:07:36.193691 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.193699    2568 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-web-config\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:07:36.193955 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.193737    2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:07:36.193955 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.193751    2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-main-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:07:36.193955 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.193765    2568 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-cluster-tls-config\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:07:36.193955 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.193777    2568 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-config-volume\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:07:36.193955 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.193788    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfe9b16c-ea73-4113-8c20-6a692be955f6-metrics-client-ca\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:07:36.193955 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.193799    2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cfe9b16c-ea73-4113-8c20-6a692be955f6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:07:36.193955 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.193812    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wvjt\" (UniqueName: \"kubernetes.io/projected/cfe9b16c-ea73-4113-8c20-6a692be955f6-kube-api-access-8wvjt\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:07:36.193955 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.193822    2568 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfe9b16c-ea73-4113-8c20-6a692be955f6-tls-assets\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:07:36.401671 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.401594    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 07:07:36.406341 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.406314    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 07:07:36.431371 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431344    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 07:07:36.431638 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431627    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="prom-label-proxy"
Sep 15 07:07:36.431679 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431640    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="prom-label-proxy"
Sep 15 07:07:36.431679 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431654    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="kube-rbac-proxy"
Sep 15 07:07:36.431679 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431660    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="kube-rbac-proxy"
Sep 15 07:07:36.431679 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431673    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="alertmanager"
Sep 15 07:07:36.431679 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431678    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="alertmanager"
Sep 15 07:07:36.431843 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431684    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="kube-rbac-proxy-metric"
Sep 15 07:07:36.431843 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431689    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="kube-rbac-proxy-metric"
Sep 15 07:07:36.431843 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431700    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="config-reloader"
Sep 15 07:07:36.431843 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431705    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="config-reloader"
Sep 15 07:07:36.431843 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431723    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="kube-rbac-proxy-web"
Sep 15 07:07:36.431843 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431728    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="kube-rbac-proxy-web"
Sep 15 07:07:36.431843 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431736    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b4fdda1-c7ea-4720-992f-a125c1ba938d" containerName="registry"
Sep 15 07:07:36.431843 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431741    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b4fdda1-c7ea-4720-992f-a125c1ba938d" containerName="registry"
Sep 15 07:07:36.431843 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431747    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="init-config-reloader"
Sep 15 07:07:36.431843 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431751    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="init-config-reloader"
Sep 15 07:07:36.431843 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431799    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="prom-label-proxy"
Sep 15 07:07:36.431843 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431808    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="config-reloader"
Sep 15 07:07:36.431843 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431813    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="kube-rbac-proxy-web"
Sep 15 07:07:36.431843 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431819    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="kube-rbac-proxy"
Sep 15 07:07:36.431843 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431824    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b4fdda1-c7ea-4720-992f-a125c1ba938d" containerName="registry"
Sep 15 07:07:36.431843 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431830    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="kube-rbac-proxy-metric"
Sep 15 07:07:36.431843 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.431835    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" containerName="alertmanager"
Sep 15 07:07:36.436643 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.436625    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.446346 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.446209    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 15 07:07:36.446346 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.446230    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6zj78\""
Sep 15 07:07:36.446346 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.446234    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 15 07:07:36.446803 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.446318    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 15 07:07:36.446803 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.446324    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 15 07:07:36.446803 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.446484    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 15 07:07:36.446803 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.446517    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 15 07:07:36.446990 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.446928    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 15 07:07:36.447085 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.447064    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 15 07:07:36.448364 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.448328    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 07:07:36.451460 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.451442    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 15 07:07:36.597824 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.597784    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.597824 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.597824    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.598032 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.597843    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.598032 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.597887    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.598032 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.597936    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.598032 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.597953    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.598032 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.597977    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-config-out\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.598032 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.597997    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-web-config\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.598206 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.598039    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.598206 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.598096    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.598206 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.598123    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.598206 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.598177    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.598206 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.598200    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqvvq\" (UniqueName: \"kubernetes.io/projected/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-kube-api-access-kqvvq\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.699116 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.699082    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.699262 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.699124    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.699379 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.699360    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.699423 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.699392    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqvvq\" (UniqueName: \"kubernetes.io/projected/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-kube-api-access-kqvvq\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.699460 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.699420    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.699460 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.699441    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.699460 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.699457    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.699600 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.699565    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.699655 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.699628    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.699705 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.699657    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.699705 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.699697    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-config-out\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.699838 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.699746    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-web-config\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.699838 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.699777    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.699945 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.699834    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.700642 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.700326    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.700877 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.700852    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.702376 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.702350    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.702483 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.702359    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.702565 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.702505    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.702675 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.702655    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.702833 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.702802    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.702966 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.702948    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.703076 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.703058    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.703179 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.703156    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-config-out\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.704092 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.704066    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-web-config\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.707203 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.707186    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqvvq\" (UniqueName: \"kubernetes.io/projected/1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5-kube-api-access-kqvvq\") pod \"alertmanager-main-0\" (UID: \"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:36.745193 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.745161    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfe9b16c-ea73-4113-8c20-6a692be955f6" path="/var/lib/kubelet/pods/cfe9b16c-ea73-4113-8c20-6a692be955f6/volumes"
Sep 15 07:07:36.745309 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:36.745286    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 07:07:37.022557 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:37.022531    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 07:07:37.024334 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:07:37.024308    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c2dc3a6_aa78_4aeb_8a26_acb838ea81d5.slice/crio-a99bded212a7a1beb50f9ee984a8899bdeb1694d691950e5720b46b092330730 WatchSource:0}: Error finding container a99bded212a7a1beb50f9ee984a8899bdeb1694d691950e5720b46b092330730: Status 404 returned error can't find the container with id a99bded212a7a1beb50f9ee984a8899bdeb1694d691950e5720b46b092330730
Sep 15 07:07:37.084434 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:37.084379    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5","Type":"ContainerStarted","Data":"a99bded212a7a1beb50f9ee984a8899bdeb1694d691950e5720b46b092330730"}
Sep 15 07:07:38.090424 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.090395    2568 generic.go:356] "Generic (PLEG): container finished" podID="1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5" containerID="e97623bfc64926e295702a5db20befde0780e1169cc2c75432f15aef4fca4117" exitCode=0
Sep 15 07:07:38.090792 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.090442    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5","Type":"ContainerDied","Data":"e97623bfc64926e295702a5db20befde0780e1169cc2c75432f15aef4fca4117"}
Sep 15 07:07:38.708956 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.708921    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"]
Sep 15 07:07:38.713334 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.713314    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.716264 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.716243    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 15 07:07:38.716568 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.716552    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 15 07:07:38.716640 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.716561    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 15 07:07:38.716858 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.716843    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 15 07:07:38.716911 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.716892    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mddwm\""
Sep 15 07:07:38.716911 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.716848    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 15 07:07:38.731268 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.731245    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 15 07:07:38.797733 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.794235    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"]
Sep 15 07:07:38.819040 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.819004    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/765da131-7b50-4cac-b922-f11249472394-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.819182 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.819055    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k68dq\" (UniqueName: \"kubernetes.io/projected/765da131-7b50-4cac-b922-f11249472394-kube-api-access-k68dq\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.819182 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.819115    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/765da131-7b50-4cac-b922-f11249472394-metrics-client-ca\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.819248 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.819203    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/765da131-7b50-4cac-b922-f11249472394-telemeter-client-tls\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.819248 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.819238    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/765da131-7b50-4cac-b922-f11249472394-federate-client-tls\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.819314 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.819281    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/765da131-7b50-4cac-b922-f11249472394-secret-telemeter-client\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.819348 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.819311    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/765da131-7b50-4cac-b922-f11249472394-serving-certs-ca-bundle\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.819348 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.819332    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/765da131-7b50-4cac-b922-f11249472394-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.919839 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.919811    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/765da131-7b50-4cac-b922-f11249472394-telemeter-client-tls\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.919925 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.919844    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/765da131-7b50-4cac-b922-f11249472394-federate-client-tls\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.919925 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.919871    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/765da131-7b50-4cac-b922-f11249472394-secret-telemeter-client\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.919925 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.919897    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/765da131-7b50-4cac-b922-f11249472394-serving-certs-ca-bundle\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.919925 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.919916    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/765da131-7b50-4cac-b922-f11249472394-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.920118 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.919941    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/765da131-7b50-4cac-b922-f11249472394-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.920118 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.919975    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k68dq\" (UniqueName: \"kubernetes.io/projected/765da131-7b50-4cac-b922-f11249472394-kube-api-access-k68dq\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.920118 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.920000    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/765da131-7b50-4cac-b922-f11249472394-metrics-client-ca\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.920766 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.920735    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/765da131-7b50-4cac-b922-f11249472394-serving-certs-ca-bundle\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.920938 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.920784    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/765da131-7b50-4cac-b922-f11249472394-metrics-client-ca\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.920938 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.920903    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/765da131-7b50-4cac-b922-f11249472394-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.922989 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.922966    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/765da131-7b50-4cac-b922-f11249472394-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.923194 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.923167    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/765da131-7b50-4cac-b922-f11249472394-federate-client-tls\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.923257 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.923195    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/765da131-7b50-4cac-b922-f11249472394-secret-telemeter-client\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.923257 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.923216    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/765da131-7b50-4cac-b922-f11249472394-telemeter-client-tls\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:38.927595 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:38.927572    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k68dq\" (UniqueName: \"kubernetes.io/projected/765da131-7b50-4cac-b922-f11249472394-kube-api-access-k68dq\") pod \"telemeter-client-6d7ccf8f5b-r5gqq\" (UID: \"765da131-7b50-4cac-b922-f11249472394\") " pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:39.022863 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:39.022793    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"
Sep 15 07:07:39.100339 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:39.100294    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5","Type":"ContainerStarted","Data":"b5bd3ef045285159a58e6f2d632db92dcd55e8659e239d906532bf86eac91af0"}
Sep 15 07:07:39.100670 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:39.100385    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5","Type":"ContainerStarted","Data":"6f18d4910b0d8acdabdca6648bacc3a53c137e33352584b2790cac844aa11d93"}
Sep 15 07:07:39.100670 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:39.100435    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5","Type":"ContainerStarted","Data":"37c204d4c72c02bdfd539e081285ba6f5fe05e141a9c71eed3654177da6a096c"}
Sep 15 07:07:39.100670 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:39.100476    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5","Type":"ContainerStarted","Data":"e309f1b332e8f29330c33a4d2ad78a67dd7f07a7e4aea9fabad7e85ca821e497"}
Sep 15 07:07:39.100670 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:39.100525    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5","Type":"ContainerStarted","Data":"e3bd6929ba8d466f3f9f0a5bafec2c2084f13e10ba4d4573266248ba1585a07e"}
Sep 15 07:07:39.100670 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:39.100564    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5","Type":"ContainerStarted","Data":"476504fc4e67d828e147099018cbba41121593323033767a381cfcf513034f20"}
Sep 15 07:07:39.128210 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:39.128165    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.112318113 podStartE2EDuration="3.128148637s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.830524ms" isStatefulPod=false podCreationTimestamp="2026-09-15 07:07:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:07:39.12620939 +0000 UTC m=+398.917127212" watchObservedRunningTime="2026-09-15 07:07:39.128148637 +0000 UTC m=+398.919066491"
Sep 15 07:07:39.300781 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:39.300307    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq"]
Sep 15 07:07:39.303200 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:07:39.303153    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod765da131_7b50_4cac_b922_f11249472394.slice/crio-85714b96699209630d86208c5cacc2d14166bfcf8b3badfeb04bf78bb2ffaf6a WatchSource:0}: Error finding container 85714b96699209630d86208c5cacc2d14166bfcf8b3badfeb04bf78bb2ffaf6a: Status 404 returned error can't find the container with id 85714b96699209630d86208c5cacc2d14166bfcf8b3badfeb04bf78bb2ffaf6a
Sep 15 07:07:40.106021 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:40.105984    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq" event={"ID":"765da131-7b50-4cac-b922-f11249472394","Type":"ContainerStarted","Data":"85714b96699209630d86208c5cacc2d14166bfcf8b3badfeb04bf78bb2ffaf6a"}
Sep 15 07:07:42.116559 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.116478    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq" event={"ID":"765da131-7b50-4cac-b922-f11249472394","Type":"ContainerStarted","Data":"c9b868dd3a112afc79c368a6105fdc6149d55e316f46eefeb260c65cf352bcc7"}
Sep 15 07:07:42.116559 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.116529    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq" event={"ID":"765da131-7b50-4cac-b922-f11249472394","Type":"ContainerStarted","Data":"127a0e42c9d15400629d1d5142b08e4e26665a3a4ae59ea1e7563ef718b34353"}
Sep 15 07:07:42.116559 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.116550    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq" event={"ID":"765da131-7b50-4cac-b922-f11249472394","Type":"ContainerStarted","Data":"fd84c854b7ff3959cfe89815f7a13a137f5b9c1d9736a71bb04791fe650830e3"}
Sep 15 07:07:42.136454 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.136407    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6d7ccf8f5b-r5gqq" podStartSLOduration=1.594644045 podStartE2EDuration="4.1363921s" totalImagesPullingTime="2.541748055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:07:42.136247337 +0000 UTC m=+401.927165161" watchObservedRunningTime="2026-09-15 07:07:42.1363921 +0000 UTC m=+401.927309902"
Sep 15 07:07:42.215413 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.215376    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6658876476-n7n2x"]
Sep 15 07:07:42.218585 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.218566    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.228445 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.228421    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6658876476-n7n2x"]
Sep 15 07:07:42.355750 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.355670    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-trusted-ca-bundle\") pod \"console-6658876476-n7n2x\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") " pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.355750 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.355758    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-console-config\") pod \"console-6658876476-n7n2x\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") " pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.355974 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.355840    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6dfee45-42ef-4854-8cc7-6df6f54b0993-console-serving-cert\") pod \"console-6658876476-n7n2x\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") " pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.355974 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.355861    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6dfee45-42ef-4854-8cc7-6df6f54b0993-console-oauth-config\") pod \"console-6658876476-n7n2x\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") " pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.355974 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.355883    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-oauth-serving-cert\") pod \"console-6658876476-n7n2x\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") " pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.355974 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.355905    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8jch\" (UniqueName: \"kubernetes.io/projected/e6dfee45-42ef-4854-8cc7-6df6f54b0993-kube-api-access-c8jch\") pod \"console-6658876476-n7n2x\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") " pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.356103 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.355999    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-service-ca\") pod \"console-6658876476-n7n2x\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") " pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.456833 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.456797    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-trusted-ca-bundle\") pod \"console-6658876476-n7n2x\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") " pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.457029 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.456838    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-console-config\") pod \"console-6658876476-n7n2x\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") " pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.457029 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.456897    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6dfee45-42ef-4854-8cc7-6df6f54b0993-console-serving-cert\") pod \"console-6658876476-n7n2x\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") " pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.457029 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.456923    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6dfee45-42ef-4854-8cc7-6df6f54b0993-console-oauth-config\") pod \"console-6658876476-n7n2x\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") " pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.457029 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.456952    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-oauth-serving-cert\") pod \"console-6658876476-n7n2x\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") " pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.457029 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.456973    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8jch\" (UniqueName: \"kubernetes.io/projected/e6dfee45-42ef-4854-8cc7-6df6f54b0993-kube-api-access-c8jch\") pod \"console-6658876476-n7n2x\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") " pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.457029 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.457011    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-service-ca\") pod \"console-6658876476-n7n2x\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") " pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.457748 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.457700    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-console-config\") pod \"console-6658876476-n7n2x\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") " pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.457869 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.457781    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-service-ca\") pod \"console-6658876476-n7n2x\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") " pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.457869 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.457802    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-oauth-serving-cert\") pod \"console-6658876476-n7n2x\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") " pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.457869 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.457851    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-trusted-ca-bundle\") pod \"console-6658876476-n7n2x\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") " pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.459379 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.459357    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6dfee45-42ef-4854-8cc7-6df6f54b0993-console-oauth-config\") pod \"console-6658876476-n7n2x\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") " pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.459602 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.459583    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6dfee45-42ef-4854-8cc7-6df6f54b0993-console-serving-cert\") pod \"console-6658876476-n7n2x\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") " pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.465098 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.465071    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8jch\" (UniqueName: \"kubernetes.io/projected/e6dfee45-42ef-4854-8cc7-6df6f54b0993-kube-api-access-c8jch\") pod \"console-6658876476-n7n2x\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") " pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.529558 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.529503    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:42.800474 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:42.800448    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6658876476-n7n2x"]
Sep 15 07:07:42.802257 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:07:42.802227    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6dfee45_42ef_4854_8cc7_6df6f54b0993.slice/crio-b31d3e172fc9f64d4136832ab7e6ff9f1646317e466cf6ad54aab7c04e7feade WatchSource:0}: Error finding container b31d3e172fc9f64d4136832ab7e6ff9f1646317e466cf6ad54aab7c04e7feade: Status 404 returned error can't find the container with id b31d3e172fc9f64d4136832ab7e6ff9f1646317e466cf6ad54aab7c04e7feade
Sep 15 07:07:43.121979 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:43.121886    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6658876476-n7n2x" event={"ID":"e6dfee45-42ef-4854-8cc7-6df6f54b0993","Type":"ContainerStarted","Data":"4dfb9e7447d538cca6106f2a54ed9eb0893a2fc5f16737789ac89345c078e292"}
Sep 15 07:07:43.121979 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:43.121946    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6658876476-n7n2x" event={"ID":"e6dfee45-42ef-4854-8cc7-6df6f54b0993","Type":"ContainerStarted","Data":"b31d3e172fc9f64d4136832ab7e6ff9f1646317e466cf6ad54aab7c04e7feade"}
Sep 15 07:07:43.138628 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:43.138579    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6658876476-n7n2x" podStartSLOduration=1.138564386 podStartE2EDuration="1.138564386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:07:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:07:43.137806507 +0000 UTC m=+402.928724330" watchObservedRunningTime="2026-09-15 07:07:43.138564386 +0000 UTC m=+402.929482188"
Sep 15 07:07:44.530290 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:07:44.530234    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528" podUID="16f5f861-0b53-462e-bb9b-4727524236ba"
Sep 15 07:07:45.130443 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:45.130412    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"
Sep 15 07:07:46.692804 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:46.692750    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bz528\" (UID: \"16f5f861-0b53-462e-bb9b-4727524236ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"
Sep 15 07:07:46.695157 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:46.695133    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/16f5f861-0b53-462e-bb9b-4727524236ba-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-bz528\" (UID: \"16f5f861-0b53-462e-bb9b-4727524236ba\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"
Sep 15 07:07:46.933378 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:46.933349    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-l7nqg\""
Sep 15 07:07:46.941185 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:46.941167    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"
Sep 15 07:07:47.211819 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:47.211790    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528"]
Sep 15 07:07:47.214284 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:07:47.214251    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16f5f861_0b53_462e_bb9b_4727524236ba.slice/crio-552257cad48f56726412bac6362b152bc23649330227f99fbf31986db2a79cc4 WatchSource:0}: Error finding container 552257cad48f56726412bac6362b152bc23649330227f99fbf31986db2a79cc4: Status 404 returned error can't find the container with id 552257cad48f56726412bac6362b152bc23649330227f99fbf31986db2a79cc4
Sep 15 07:07:48.147656 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:48.147619    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528" event={"ID":"16f5f861-0b53-462e-bb9b-4727524236ba","Type":"ContainerStarted","Data":"552257cad48f56726412bac6362b152bc23649330227f99fbf31986db2a79cc4"}
Sep 15 07:07:49.154416 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:49.154326    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528" event={"ID":"16f5f861-0b53-462e-bb9b-4727524236ba","Type":"ContainerStarted","Data":"b61c19ab8049a89b1b9daf8bc4fc31246dc1c73e360c50d9ca0ccb5868673cbf"}
Sep 15 07:07:49.170493 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:49.170447    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-bz528" podStartSLOduration=379.484709326 podStartE2EDuration="6m21.170431826s" totalImagesPullingTime="1.6857225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:07:49.168761084 +0000 UTC m=+408.959678904" watchObservedRunningTime="2026-09-15 07:07:49.170431826 +0000 UTC m=+408.961349646"
Sep 15 07:07:52.529858 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:52.529763    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:52.530308 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:52.529933    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:52.534835 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:52.534812    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:53.175179 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:53.175145    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:07:53.219222 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:07:53.219189    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66d455df47-mx8t7"]
Sep 15 07:08:18.239766 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.239700    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66d455df47-mx8t7" podUID="0c23b48d-a009-47b2-a462-4e4fadb6cb87" containerName="console" containerID="cri-o://bc3a05e04b3eb07d109895d8f731c3a4fe5bcbb93ddce80b065b7246d181b288" gracePeriod=15
Sep 15 07:08:18.482321 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.482295    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:08:18.554600 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.554525    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-console-config\") pod \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") "
Sep 15 07:08:18.554600 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.554557    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-service-ca\") pod \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") "
Sep 15 07:08:18.554600 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.554577    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-trusted-ca-bundle\") pod \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") "
Sep 15 07:08:18.554879 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.554606    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pt74\" (UniqueName: \"kubernetes.io/projected/0c23b48d-a009-47b2-a462-4e4fadb6cb87-kube-api-access-8pt74\") pod \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") "
Sep 15 07:08:18.554879 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.554673    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c23b48d-a009-47b2-a462-4e4fadb6cb87-console-oauth-config\") pod \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") "
Sep 15 07:08:18.554879 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.554693    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c23b48d-a009-47b2-a462-4e4fadb6cb87-console-serving-cert\") pod \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") "
Sep 15 07:08:18.554879 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.554732    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-oauth-serving-cert\") pod \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\" (UID: \"0c23b48d-a009-47b2-a462-4e4fadb6cb87\") "
Sep 15 07:08:18.555096 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.554949    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-service-ca" (OuterVolumeSpecName: "service-ca") pod "0c23b48d-a009-47b2-a462-4e4fadb6cb87" (UID: "0c23b48d-a009-47b2-a462-4e4fadb6cb87"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 07:08:18.555153 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.555112    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0c23b48d-a009-47b2-a462-4e4fadb6cb87" (UID: "0c23b48d-a009-47b2-a462-4e4fadb6cb87"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 07:08:18.555251 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.555225    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-console-config" (OuterVolumeSpecName: "console-config") pod "0c23b48d-a009-47b2-a462-4e4fadb6cb87" (UID: "0c23b48d-a009-47b2-a462-4e4fadb6cb87"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 07:08:18.555318 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.555238    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0c23b48d-a009-47b2-a462-4e4fadb6cb87" (UID: "0c23b48d-a009-47b2-a462-4e4fadb6cb87"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 07:08:18.557129 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.557102    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c23b48d-a009-47b2-a462-4e4fadb6cb87-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0c23b48d-a009-47b2-a462-4e4fadb6cb87" (UID: "0c23b48d-a009-47b2-a462-4e4fadb6cb87"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:08:18.557220 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.557136    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c23b48d-a009-47b2-a462-4e4fadb6cb87-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0c23b48d-a009-47b2-a462-4e4fadb6cb87" (UID: "0c23b48d-a009-47b2-a462-4e4fadb6cb87"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:08:18.557220 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.557167    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c23b48d-a009-47b2-a462-4e4fadb6cb87-kube-api-access-8pt74" (OuterVolumeSpecName: "kube-api-access-8pt74") pod "0c23b48d-a009-47b2-a462-4e4fadb6cb87" (UID: "0c23b48d-a009-47b2-a462-4e4fadb6cb87"). InnerVolumeSpecName "kube-api-access-8pt74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:08:18.655825 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.655777    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c23b48d-a009-47b2-a462-4e4fadb6cb87-console-oauth-config\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:08:18.655825 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.655817    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c23b48d-a009-47b2-a462-4e4fadb6cb87-console-serving-cert\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:08:18.655825 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.655827    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-oauth-serving-cert\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:08:18.655825 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.655836    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-console-config\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:08:18.655825 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.655845    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-service-ca\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:08:18.656099 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.655853    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c23b48d-a009-47b2-a462-4e4fadb6cb87-trusted-ca-bundle\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:08:18.656099 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:18.655861    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pt74\" (UniqueName: \"kubernetes.io/projected/0c23b48d-a009-47b2-a462-4e4fadb6cb87-kube-api-access-8pt74\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:08:19.291024 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:19.290990    2568 generic.go:356] "Generic (PLEG): container finished" podID="0c23b48d-a009-47b2-a462-4e4fadb6cb87" containerID="bc3a05e04b3eb07d109895d8f731c3a4fe5bcbb93ddce80b065b7246d181b288" exitCode=0
Sep 15 07:08:19.291415 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:19.291035    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d455df47-mx8t7"
Sep 15 07:08:19.291415 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:19.291071    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d455df47-mx8t7" event={"ID":"0c23b48d-a009-47b2-a462-4e4fadb6cb87","Type":"ContainerDied","Data":"bc3a05e04b3eb07d109895d8f731c3a4fe5bcbb93ddce80b065b7246d181b288"}
Sep 15 07:08:19.291415 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:19.291119    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d455df47-mx8t7" event={"ID":"0c23b48d-a009-47b2-a462-4e4fadb6cb87","Type":"ContainerDied","Data":"bfc31a27ae59de485afc66fa95554e7800b5370b63a53ff2542d9fe25b4bcbb5"}
Sep 15 07:08:19.291415 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:19.291142    2568 scope.go:117] "RemoveContainer" containerID="bc3a05e04b3eb07d109895d8f731c3a4fe5bcbb93ddce80b065b7246d181b288"
Sep 15 07:08:19.299736 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:19.299705    2568 scope.go:117] "RemoveContainer" containerID="bc3a05e04b3eb07d109895d8f731c3a4fe5bcbb93ddce80b065b7246d181b288"
Sep 15 07:08:19.300027 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:08:19.300007    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc3a05e04b3eb07d109895d8f731c3a4fe5bcbb93ddce80b065b7246d181b288\": container with ID starting with bc3a05e04b3eb07d109895d8f731c3a4fe5bcbb93ddce80b065b7246d181b288 not found: ID does not exist" containerID="bc3a05e04b3eb07d109895d8f731c3a4fe5bcbb93ddce80b065b7246d181b288"
Sep 15 07:08:19.300097 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:19.300034    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc3a05e04b3eb07d109895d8f731c3a4fe5bcbb93ddce80b065b7246d181b288"} err="failed to get container status \"bc3a05e04b3eb07d109895d8f731c3a4fe5bcbb93ddce80b065b7246d181b288\": rpc error: code = NotFound desc = could not find container \"bc3a05e04b3eb07d109895d8f731c3a4fe5bcbb93ddce80b065b7246d181b288\": container with ID starting with bc3a05e04b3eb07d109895d8f731c3a4fe5bcbb93ddce80b065b7246d181b288 not found: ID does not exist"
Sep 15 07:08:19.306508 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:19.306486    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66d455df47-mx8t7"]
Sep 15 07:08:19.310518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:19.310499    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66d455df47-mx8t7"]
Sep 15 07:08:20.741530 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:20.741487    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c23b48d-a009-47b2-a462-4e4fadb6cb87" path="/var/lib/kubelet/pods/0c23b48d-a009-47b2-a462-4e4fadb6cb87/volumes"
Sep 15 07:08:54.776554 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.776522    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5ffc455dc4-7gpzx"]
Sep 15 07:08:54.777076 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.777015    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c23b48d-a009-47b2-a462-4e4fadb6cb87" containerName="console"
Sep 15 07:08:54.777076 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.777034    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c23b48d-a009-47b2-a462-4e4fadb6cb87" containerName="console"
Sep 15 07:08:54.777203 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.777105    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c23b48d-a009-47b2-a462-4e4fadb6cb87" containerName="console"
Sep 15 07:08:54.780030 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.780011    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:54.791605 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.791582    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ffc455dc4-7gpzx"]
Sep 15 07:08:54.825642 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.825610    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-console-config\") pod \"console-5ffc455dc4-7gpzx\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") " pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:54.825757 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.825650    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvjbm\" (UniqueName: \"kubernetes.io/projected/4e00e987-d25b-4c1d-8728-435c8d673fe5-kube-api-access-zvjbm\") pod \"console-5ffc455dc4-7gpzx\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") " pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:54.825757 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.825681    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e00e987-d25b-4c1d-8728-435c8d673fe5-console-oauth-config\") pod \"console-5ffc455dc4-7gpzx\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") " pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:54.825757 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.825727    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e00e987-d25b-4c1d-8728-435c8d673fe5-console-serving-cert\") pod \"console-5ffc455dc4-7gpzx\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") " pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:54.825886 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.825774    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-oauth-serving-cert\") pod \"console-5ffc455dc4-7gpzx\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") " pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:54.825886 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.825799    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-service-ca\") pod \"console-5ffc455dc4-7gpzx\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") " pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:54.825886 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.825822    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-trusted-ca-bundle\") pod \"console-5ffc455dc4-7gpzx\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") " pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:54.927162 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.927132    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-oauth-serving-cert\") pod \"console-5ffc455dc4-7gpzx\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") " pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:54.927162 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.927166    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-service-ca\") pod \"console-5ffc455dc4-7gpzx\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") " pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:54.927387 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.927196    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-trusted-ca-bundle\") pod \"console-5ffc455dc4-7gpzx\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") " pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:54.927387 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.927236    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-console-config\") pod \"console-5ffc455dc4-7gpzx\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") " pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:54.927387 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.927342    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvjbm\" (UniqueName: \"kubernetes.io/projected/4e00e987-d25b-4c1d-8728-435c8d673fe5-kube-api-access-zvjbm\") pod \"console-5ffc455dc4-7gpzx\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") " pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:54.927548 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.927416    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e00e987-d25b-4c1d-8728-435c8d673fe5-console-oauth-config\") pod \"console-5ffc455dc4-7gpzx\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") " pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:54.927601 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.927582    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e00e987-d25b-4c1d-8728-435c8d673fe5-console-serving-cert\") pod \"console-5ffc455dc4-7gpzx\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") " pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:54.927952 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.927923    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-console-config\") pod \"console-5ffc455dc4-7gpzx\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") " pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:54.927952 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.927946    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-oauth-serving-cert\") pod \"console-5ffc455dc4-7gpzx\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") " pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:54.928097 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.927967    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-service-ca\") pod \"console-5ffc455dc4-7gpzx\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") " pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:54.928193 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.928175    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-trusted-ca-bundle\") pod \"console-5ffc455dc4-7gpzx\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") " pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:54.929827 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.929811    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e00e987-d25b-4c1d-8728-435c8d673fe5-console-oauth-config\") pod \"console-5ffc455dc4-7gpzx\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") " pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:54.929938 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.929922    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e00e987-d25b-4c1d-8728-435c8d673fe5-console-serving-cert\") pod \"console-5ffc455dc4-7gpzx\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") " pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:54.936577 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:54.936553    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvjbm\" (UniqueName: \"kubernetes.io/projected/4e00e987-d25b-4c1d-8728-435c8d673fe5-kube-api-access-zvjbm\") pod \"console-5ffc455dc4-7gpzx\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") " pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:55.089678 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:55.089609    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:08:55.359365 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:55.359342    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ffc455dc4-7gpzx"]
Sep 15 07:08:55.362004 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:08:55.361977    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e00e987_d25b_4c1d_8728_435c8d673fe5.slice/crio-6d268b6c3ae09c54dc43b6f867033cedc6e79c4d44a66866ca2e267a1466a0ea WatchSource:0}: Error finding container 6d268b6c3ae09c54dc43b6f867033cedc6e79c4d44a66866ca2e267a1466a0ea: Status 404 returned error can't find the container with id 6d268b6c3ae09c54dc43b6f867033cedc6e79c4d44a66866ca2e267a1466a0ea
Sep 15 07:08:55.436747 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:55.436696    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ffc455dc4-7gpzx" event={"ID":"4e00e987-d25b-4c1d-8728-435c8d673fe5","Type":"ContainerStarted","Data":"b029df4e53eec9f3049b9ebe0a7ac6afd811c5cfe45092e3d8890f090c0e8698"}
Sep 15 07:08:55.436851 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:55.436778    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ffc455dc4-7gpzx" event={"ID":"4e00e987-d25b-4c1d-8728-435c8d673fe5","Type":"ContainerStarted","Data":"6d268b6c3ae09c54dc43b6f867033cedc6e79c4d44a66866ca2e267a1466a0ea"}
Sep 15 07:08:55.453893 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:08:55.453854    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5ffc455dc4-7gpzx" podStartSLOduration=1.453840007 podStartE2EDuration="1.453840007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:08:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:08:55.451957249 +0000 UTC m=+475.242875072" watchObservedRunningTime="2026-09-15 07:08:55.453840007 +0000 UTC m=+475.244757829"
Sep 15 07:09:05.090091 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:05.090055    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:09:05.090500 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:05.090118    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:09:05.094883 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:05.094854    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:09:05.483269 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:05.483239    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:09:05.525515 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:05.525481    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6658876476-n7n2x"]
Sep 15 07:09:30.548396 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:30.548337    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6658876476-n7n2x" podUID="e6dfee45-42ef-4854-8cc7-6df6f54b0993" containerName="console" containerID="cri-o://4dfb9e7447d538cca6106f2a54ed9eb0893a2fc5f16737789ac89345c078e292" gracePeriod=15
Sep 15 07:09:30.790827 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:30.790805    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:09:30.924235 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:30.924212    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-console-config\") pod \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") "
Sep 15 07:09:30.924384 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:30.924246    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6dfee45-42ef-4854-8cc7-6df6f54b0993-console-oauth-config\") pod \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") "
Sep 15 07:09:30.924384 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:30.924275    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6dfee45-42ef-4854-8cc7-6df6f54b0993-console-serving-cert\") pod \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") "
Sep 15 07:09:30.924384 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:30.924303    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-oauth-serving-cert\") pod \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") "
Sep 15 07:09:30.924384 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:30.924372    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8jch\" (UniqueName: \"kubernetes.io/projected/e6dfee45-42ef-4854-8cc7-6df6f54b0993-kube-api-access-c8jch\") pod \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") "
Sep 15 07:09:30.924547 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:30.924404    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-trusted-ca-bundle\") pod \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") "
Sep 15 07:09:30.924547 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:30.924464    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-service-ca\") pod \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\" (UID: \"e6dfee45-42ef-4854-8cc7-6df6f54b0993\") "
Sep 15 07:09:30.924771 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:30.924745    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-console-config" (OuterVolumeSpecName: "console-config") pod "e6dfee45-42ef-4854-8cc7-6df6f54b0993" (UID: "e6dfee45-42ef-4854-8cc7-6df6f54b0993"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 07:09:30.924881 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:30.924857    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e6dfee45-42ef-4854-8cc7-6df6f54b0993" (UID: "e6dfee45-42ef-4854-8cc7-6df6f54b0993"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 07:09:30.924942 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:30.924880    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e6dfee45-42ef-4854-8cc7-6df6f54b0993" (UID: "e6dfee45-42ef-4854-8cc7-6df6f54b0993"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 07:09:30.924942 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:30.924893    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-service-ca" (OuterVolumeSpecName: "service-ca") pod "e6dfee45-42ef-4854-8cc7-6df6f54b0993" (UID: "e6dfee45-42ef-4854-8cc7-6df6f54b0993"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 07:09:30.926557 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:30.926536    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6dfee45-42ef-4854-8cc7-6df6f54b0993-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e6dfee45-42ef-4854-8cc7-6df6f54b0993" (UID: "e6dfee45-42ef-4854-8cc7-6df6f54b0993"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:09:30.926931 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:30.926909    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6dfee45-42ef-4854-8cc7-6df6f54b0993-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e6dfee45-42ef-4854-8cc7-6df6f54b0993" (UID: "e6dfee45-42ef-4854-8cc7-6df6f54b0993"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:09:30.927012 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:30.926931    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6dfee45-42ef-4854-8cc7-6df6f54b0993-kube-api-access-c8jch" (OuterVolumeSpecName: "kube-api-access-c8jch") pod "e6dfee45-42ef-4854-8cc7-6df6f54b0993" (UID: "e6dfee45-42ef-4854-8cc7-6df6f54b0993"). InnerVolumeSpecName "kube-api-access-c8jch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:09:31.025648 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:31.025609    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-console-config\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:09:31.025648 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:31.025644    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6dfee45-42ef-4854-8cc7-6df6f54b0993-console-oauth-config\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:09:31.025648 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:31.025654    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6dfee45-42ef-4854-8cc7-6df6f54b0993-console-serving-cert\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:09:31.025905 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:31.025664    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-oauth-serving-cert\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:09:31.025905 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:31.025673    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8jch\" (UniqueName: \"kubernetes.io/projected/e6dfee45-42ef-4854-8cc7-6df6f54b0993-kube-api-access-c8jch\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:09:31.025905 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:31.025682    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-trusted-ca-bundle\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:09:31.025905 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:31.025694    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6dfee45-42ef-4854-8cc7-6df6f54b0993-service-ca\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:09:31.597636 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:31.597602    2568 generic.go:356] "Generic (PLEG): container finished" podID="e6dfee45-42ef-4854-8cc7-6df6f54b0993" containerID="4dfb9e7447d538cca6106f2a54ed9eb0893a2fc5f16737789ac89345c078e292" exitCode=0
Sep 15 07:09:31.598128 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:31.597652    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6658876476-n7n2x"
Sep 15 07:09:31.598128 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:31.597662    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6658876476-n7n2x" event={"ID":"e6dfee45-42ef-4854-8cc7-6df6f54b0993","Type":"ContainerDied","Data":"4dfb9e7447d538cca6106f2a54ed9eb0893a2fc5f16737789ac89345c078e292"}
Sep 15 07:09:31.598128 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:31.597701    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6658876476-n7n2x" event={"ID":"e6dfee45-42ef-4854-8cc7-6df6f54b0993","Type":"ContainerDied","Data":"b31d3e172fc9f64d4136832ab7e6ff9f1646317e466cf6ad54aab7c04e7feade"}
Sep 15 07:09:31.598128 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:31.597744    2568 scope.go:117] "RemoveContainer" containerID="4dfb9e7447d538cca6106f2a54ed9eb0893a2fc5f16737789ac89345c078e292"
Sep 15 07:09:31.606348 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:31.606323    2568 scope.go:117] "RemoveContainer" containerID="4dfb9e7447d538cca6106f2a54ed9eb0893a2fc5f16737789ac89345c078e292"
Sep 15 07:09:31.606616 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:09:31.606597    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dfb9e7447d538cca6106f2a54ed9eb0893a2fc5f16737789ac89345c078e292\": container with ID starting with 4dfb9e7447d538cca6106f2a54ed9eb0893a2fc5f16737789ac89345c078e292 not found: ID does not exist" containerID="4dfb9e7447d538cca6106f2a54ed9eb0893a2fc5f16737789ac89345c078e292"
Sep 15 07:09:31.606683 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:31.606626    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dfb9e7447d538cca6106f2a54ed9eb0893a2fc5f16737789ac89345c078e292"} err="failed to get container status \"4dfb9e7447d538cca6106f2a54ed9eb0893a2fc5f16737789ac89345c078e292\": rpc error: code = NotFound desc = could not find container \"4dfb9e7447d538cca6106f2a54ed9eb0893a2fc5f16737789ac89345c078e292\": container with ID starting with 4dfb9e7447d538cca6106f2a54ed9eb0893a2fc5f16737789ac89345c078e292 not found: ID does not exist"
Sep 15 07:09:31.618115 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:31.618083    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6658876476-n7n2x"]
Sep 15 07:09:31.621231 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:31.621210    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6658876476-n7n2x"]
Sep 15 07:09:32.742206 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:09:32.742171    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6dfee45-42ef-4854-8cc7-6df6f54b0993" path="/var/lib/kubelet/pods/e6dfee45-42ef-4854-8cc7-6df6f54b0993/volumes"
Sep 15 07:11:25.211928 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:25.211850    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ffc455dc4-7gpzx"]
Sep 15 07:11:32.072885 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:32.072841    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6f97788895-9c89q"]
Sep 15 07:11:32.073257 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:32.073220    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6dfee45-42ef-4854-8cc7-6df6f54b0993" containerName="console"
Sep 15 07:11:32.073257 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:32.073233    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6dfee45-42ef-4854-8cc7-6df6f54b0993" containerName="console"
Sep 15 07:11:32.073326 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:32.073292    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6dfee45-42ef-4854-8cc7-6df6f54b0993" containerName="console"
Sep 15 07:11:32.076292 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:32.076275    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6f97788895-9c89q"
Sep 15 07:11:32.078824 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:32.078795    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Sep 15 07:11:32.079599 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:32.079579    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Sep 15 07:11:32.079721 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:32.079585    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-mvsjc\""
Sep 15 07:11:32.083287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:32.083265    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6f97788895-9c89q"]
Sep 15 07:11:32.212321 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:32.212286    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q756\" (UniqueName: \"kubernetes.io/projected/db18bd9d-e768-4553-a866-6772df980865-kube-api-access-5q756\") pod \"feast-operator-controller-manager-6f97788895-9c89q\" (UID: \"db18bd9d-e768-4553-a866-6772df980865\") " pod="feast-operator-system/feast-operator-controller-manager-6f97788895-9c89q"
Sep 15 07:11:32.313537 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:32.313495    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q756\" (UniqueName: \"kubernetes.io/projected/db18bd9d-e768-4553-a866-6772df980865-kube-api-access-5q756\") pod \"feast-operator-controller-manager-6f97788895-9c89q\" (UID: \"db18bd9d-e768-4553-a866-6772df980865\") " pod="feast-operator-system/feast-operator-controller-manager-6f97788895-9c89q"
Sep 15 07:11:32.323364 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:32.323298    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q756\" (UniqueName: \"kubernetes.io/projected/db18bd9d-e768-4553-a866-6772df980865-kube-api-access-5q756\") pod \"feast-operator-controller-manager-6f97788895-9c89q\" (UID: \"db18bd9d-e768-4553-a866-6772df980865\") " pod="feast-operator-system/feast-operator-controller-manager-6f97788895-9c89q"
Sep 15 07:11:32.388254 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:32.388219    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6f97788895-9c89q"
Sep 15 07:11:32.657227 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:32.657124    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6f97788895-9c89q"]
Sep 15 07:11:32.660040 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:11:32.660010    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb18bd9d_e768_4553_a866_6772df980865.slice/crio-d6b2a36798fd35bfe12398a716eba7423a46ee2341d27efc97472e79b14d3c60 WatchSource:0}: Error finding container d6b2a36798fd35bfe12398a716eba7423a46ee2341d27efc97472e79b14d3c60: Status 404 returned error can't find the container with id d6b2a36798fd35bfe12398a716eba7423a46ee2341d27efc97472e79b14d3c60
Sep 15 07:11:32.662061 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:32.662045    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 07:11:33.086345 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:33.086261    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6f97788895-9c89q" event={"ID":"db18bd9d-e768-4553-a866-6772df980865","Type":"ContainerStarted","Data":"d6b2a36798fd35bfe12398a716eba7423a46ee2341d27efc97472e79b14d3c60"}
Sep 15 07:11:35.096958 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:35.096910    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6f97788895-9c89q" event={"ID":"db18bd9d-e768-4553-a866-6772df980865","Type":"ContainerStarted","Data":"b7bee8e22112f4e580e8748673dc251f5487c32d9f2f4ba3da634e08fe7bb59d"}
Sep 15 07:11:35.097402 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:35.097017    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-6f97788895-9c89q"
Sep 15 07:11:35.113005 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:35.112960    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-6f97788895-9c89q" podStartSLOduration=0.904743792 podStartE2EDuration="3.112944454s" totalImagesPullingTime="2.208200662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:11:35.111776807 +0000 UTC m=+634.902694628" watchObservedRunningTime="2026-09-15 07:11:35.112944454 +0000 UTC m=+634.903862275"
Sep 15 07:11:46.104473 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:46.104433    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-6f97788895-9c89q"
Sep 15 07:11:50.231375 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.231310    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5ffc455dc4-7gpzx" podUID="4e00e987-d25b-4c1d-8728-435c8d673fe5" containerName="console" containerID="cri-o://b029df4e53eec9f3049b9ebe0a7ac6afd811c5cfe45092e3d8890f090c0e8698" gracePeriod=15
Sep 15 07:11:50.470977 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.470953    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:11:50.569015 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.568951    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvjbm\" (UniqueName: \"kubernetes.io/projected/4e00e987-d25b-4c1d-8728-435c8d673fe5-kube-api-access-zvjbm\") pod \"4e00e987-d25b-4c1d-8728-435c8d673fe5\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") "
Sep 15 07:11:50.569015 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.568980    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-trusted-ca-bundle\") pod \"4e00e987-d25b-4c1d-8728-435c8d673fe5\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") "
Sep 15 07:11:50.569209 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.569020    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-service-ca\") pod \"4e00e987-d25b-4c1d-8728-435c8d673fe5\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") "
Sep 15 07:11:50.569209 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.569094    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-oauth-serving-cert\") pod \"4e00e987-d25b-4c1d-8728-435c8d673fe5\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") "
Sep 15 07:11:50.569209 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.569127    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-console-config\") pod \"4e00e987-d25b-4c1d-8728-435c8d673fe5\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") "
Sep 15 07:11:50.569209 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.569151    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e00e987-d25b-4c1d-8728-435c8d673fe5-console-serving-cert\") pod \"4e00e987-d25b-4c1d-8728-435c8d673fe5\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") "
Sep 15 07:11:50.569209 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.569182    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e00e987-d25b-4c1d-8728-435c8d673fe5-console-oauth-config\") pod \"4e00e987-d25b-4c1d-8728-435c8d673fe5\" (UID: \"4e00e987-d25b-4c1d-8728-435c8d673fe5\") "
Sep 15 07:11:50.569469 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.569443    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4e00e987-d25b-4c1d-8728-435c8d673fe5" (UID: "4e00e987-d25b-4c1d-8728-435c8d673fe5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 07:11:50.569528 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.569500    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-console-config" (OuterVolumeSpecName: "console-config") pod "4e00e987-d25b-4c1d-8728-435c8d673fe5" (UID: "4e00e987-d25b-4c1d-8728-435c8d673fe5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 07:11:50.569584 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.569535    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-service-ca" (OuterVolumeSpecName: "service-ca") pod "4e00e987-d25b-4c1d-8728-435c8d673fe5" (UID: "4e00e987-d25b-4c1d-8728-435c8d673fe5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 07:11:50.569621 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.569575    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4e00e987-d25b-4c1d-8728-435c8d673fe5" (UID: "4e00e987-d25b-4c1d-8728-435c8d673fe5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 07:11:50.571156 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.571131    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e00e987-d25b-4c1d-8728-435c8d673fe5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4e00e987-d25b-4c1d-8728-435c8d673fe5" (UID: "4e00e987-d25b-4c1d-8728-435c8d673fe5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:11:50.571282 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.571264    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e00e987-d25b-4c1d-8728-435c8d673fe5-kube-api-access-zvjbm" (OuterVolumeSpecName: "kube-api-access-zvjbm") pod "4e00e987-d25b-4c1d-8728-435c8d673fe5" (UID: "4e00e987-d25b-4c1d-8728-435c8d673fe5"). InnerVolumeSpecName "kube-api-access-zvjbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:11:50.571365 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.571348    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e00e987-d25b-4c1d-8728-435c8d673fe5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4e00e987-d25b-4c1d-8728-435c8d673fe5" (UID: "4e00e987-d25b-4c1d-8728-435c8d673fe5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:11:50.670264 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.670239    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvjbm\" (UniqueName: \"kubernetes.io/projected/4e00e987-d25b-4c1d-8728-435c8d673fe5-kube-api-access-zvjbm\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:11:50.670264 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.670260    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-trusted-ca-bundle\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:11:50.670387 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.670269    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-service-ca\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:11:50.670387 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.670278    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-oauth-serving-cert\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:11:50.670387 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.670287    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e00e987-d25b-4c1d-8728-435c8d673fe5-console-config\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:11:50.670387 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.670295    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e00e987-d25b-4c1d-8728-435c8d673fe5-console-serving-cert\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:11:50.670387 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:50.670303    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e00e987-d25b-4c1d-8728-435c8d673fe5-console-oauth-config\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:11:51.165634 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:51.165604    2568 generic.go:356] "Generic (PLEG): container finished" podID="4e00e987-d25b-4c1d-8728-435c8d673fe5" containerID="b029df4e53eec9f3049b9ebe0a7ac6afd811c5cfe45092e3d8890f090c0e8698" exitCode=0
Sep 15 07:11:51.165809 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:51.165644    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ffc455dc4-7gpzx" event={"ID":"4e00e987-d25b-4c1d-8728-435c8d673fe5","Type":"ContainerDied","Data":"b029df4e53eec9f3049b9ebe0a7ac6afd811c5cfe45092e3d8890f090c0e8698"}
Sep 15 07:11:51.165809 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:51.165650    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ffc455dc4-7gpzx"
Sep 15 07:11:51.165809 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:51.165683    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ffc455dc4-7gpzx" event={"ID":"4e00e987-d25b-4c1d-8728-435c8d673fe5","Type":"ContainerDied","Data":"6d268b6c3ae09c54dc43b6f867033cedc6e79c4d44a66866ca2e267a1466a0ea"}
Sep 15 07:11:51.165809 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:51.165702    2568 scope.go:117] "RemoveContainer" containerID="b029df4e53eec9f3049b9ebe0a7ac6afd811c5cfe45092e3d8890f090c0e8698"
Sep 15 07:11:51.173857 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:51.173838    2568 scope.go:117] "RemoveContainer" containerID="b029df4e53eec9f3049b9ebe0a7ac6afd811c5cfe45092e3d8890f090c0e8698"
Sep 15 07:11:51.174125 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:11:51.174107    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b029df4e53eec9f3049b9ebe0a7ac6afd811c5cfe45092e3d8890f090c0e8698\": container with ID starting with b029df4e53eec9f3049b9ebe0a7ac6afd811c5cfe45092e3d8890f090c0e8698 not found: ID does not exist" containerID="b029df4e53eec9f3049b9ebe0a7ac6afd811c5cfe45092e3d8890f090c0e8698"
Sep 15 07:11:51.174190 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:51.174134    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b029df4e53eec9f3049b9ebe0a7ac6afd811c5cfe45092e3d8890f090c0e8698"} err="failed to get container status \"b029df4e53eec9f3049b9ebe0a7ac6afd811c5cfe45092e3d8890f090c0e8698\": rpc error: code = NotFound desc = could not find container \"b029df4e53eec9f3049b9ebe0a7ac6afd811c5cfe45092e3d8890f090c0e8698\": container with ID starting with b029df4e53eec9f3049b9ebe0a7ac6afd811c5cfe45092e3d8890f090c0e8698 not found: ID does not exist"
Sep 15 07:11:51.182368 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:51.182344    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ffc455dc4-7gpzx"]
Sep 15 07:11:51.186126 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:51.186108    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5ffc455dc4-7gpzx"]
Sep 15 07:11:52.741632 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:11:52.741598    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e00e987-d25b-4c1d-8728-435c8d673fe5" path="/var/lib/kubelet/pods/4e00e987-d25b-4c1d-8728-435c8d673fe5/volumes"
Sep 15 07:12:08.853700 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:08.853660    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"]
Sep 15 07:12:08.854163 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:08.854010    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e00e987-d25b-4c1d-8728-435c8d673fe5" containerName="console"
Sep 15 07:12:08.854163 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:08.854022    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e00e987-d25b-4c1d-8728-435c8d673fe5" containerName="console"
Sep 15 07:12:08.854163 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:08.854090    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e00e987-d25b-4c1d-8728-435c8d673fe5" containerName="console"
Sep 15 07:12:08.862448 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:08.862418    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:08.865261 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:08.865235    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 15 07:12:08.865895 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:08.865674    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 15 07:12:08.865895 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:08.865734    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-g7mnj\""
Sep 15 07:12:08.865895 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:08.865740    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Sep 15 07:12:08.865895 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:08.865787    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 15 07:12:08.865895 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:08.865740    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 15 07:12:08.865895 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:08.865811    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 15 07:12:08.865895 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:08.865824    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 15 07:12:08.878365 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:08.878344    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"]
Sep 15 07:12:08.908964 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:08.908936    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-offline-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-hq9m8\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:08.909092 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:08.908978    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-online-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-hq9m8\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:08.909092 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:08.909003    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96c4363f-df06-4025-a4ab-24542ee9606e-feast-data\") pod \"feast-simple-feast-setup-77fbccbbbf-hq9m8\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:08.909199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:08.909088    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-registry-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-hq9m8\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:08.909199 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:08.909140    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz8xx\" (UniqueName: \"kubernetes.io/projected/96c4363f-df06-4025-a4ab-24542ee9606e-kube-api-access-sz8xx\") pod \"feast-simple-feast-setup-77fbccbbbf-hq9m8\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:08.909297 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:08.909205    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-ui-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-hq9m8\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:09.010503 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:09.010471    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-registry-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-hq9m8\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:09.010632 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:09.010520    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz8xx\" (UniqueName: \"kubernetes.io/projected/96c4363f-df06-4025-a4ab-24542ee9606e-kube-api-access-sz8xx\") pod \"feast-simple-feast-setup-77fbccbbbf-hq9m8\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:09.010632 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:09.010574    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-ui-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-hq9m8\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:09.010632 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:09.010606    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-offline-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-hq9m8\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:09.010816 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:09.010641    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-online-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-hq9m8\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:09.010816 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:09.010671    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96c4363f-df06-4025-a4ab-24542ee9606e-feast-data\") pod \"feast-simple-feast-setup-77fbccbbbf-hq9m8\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:09.010920 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:12:09.010892    2568 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Sep 15 07:12:09.010974 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:12:09.010934    2568 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Sep 15 07:12:09.010974 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:12:09.010959    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-offline-tls podName:96c4363f-df06-4025-a4ab-24542ee9606e nodeName:}" failed. No retries permitted until 2026-09-15 07:12:09.510936581 +0000 UTC m=+669.301854394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-offline-tls") pod "feast-simple-feast-setup-77fbccbbbf-hq9m8" (UID: "96c4363f-df06-4025-a4ab-24542ee9606e") : secret "feast-simple-feast-setup-offline-tls" not found
Sep 15 07:12:09.011083 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:12:09.011010    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-online-tls podName:96c4363f-df06-4025-a4ab-24542ee9606e nodeName:}" failed. No retries permitted until 2026-09-15 07:12:09.510986553 +0000 UTC m=+669.301904368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-online-tls") pod "feast-simple-feast-setup-77fbccbbbf-hq9m8" (UID: "96c4363f-df06-4025-a4ab-24542ee9606e") : secret "feast-simple-feast-setup-online-tls" not found
Sep 15 07:12:09.011083 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:09.011030    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96c4363f-df06-4025-a4ab-24542ee9606e-feast-data\") pod \"feast-simple-feast-setup-77fbccbbbf-hq9m8\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:09.013200 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:09.013178    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-registry-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-hq9m8\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:09.013313 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:09.013184    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-ui-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-hq9m8\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:09.021553 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:09.021532    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz8xx\" (UniqueName: \"kubernetes.io/projected/96c4363f-df06-4025-a4ab-24542ee9606e-kube-api-access-sz8xx\") pod \"feast-simple-feast-setup-77fbccbbbf-hq9m8\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:09.515867 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:09.515833    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-offline-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-hq9m8\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:09.516041 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:09.515879    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-online-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-hq9m8\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:09.518209 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:09.518180    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-online-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-hq9m8\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:09.518359 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:09.518336    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-offline-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-hq9m8\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:09.787130 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:09.787058    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:10.071814 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:10.071786    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"]
Sep 15 07:12:10.072180 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:12:10.071970    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96c4363f_df06_4025_a4ab_24542ee9606e.slice/crio-9fdf412d9818d65e21da222609160c47cab61bba2844474012fda93132d71557 WatchSource:0}: Error finding container 9fdf412d9818d65e21da222609160c47cab61bba2844474012fda93132d71557: Status 404 returned error can't find the container with id 9fdf412d9818d65e21da222609160c47cab61bba2844474012fda93132d71557
Sep 15 07:12:10.245776 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:10.245740    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" event={"ID":"96c4363f-df06-4025-a4ab-24542ee9606e","Type":"ContainerStarted","Data":"9fdf412d9818d65e21da222609160c47cab61bba2844474012fda93132d71557"}
Sep 15 07:12:35.363828 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:35.363781    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" event={"ID":"96c4363f-df06-4025-a4ab-24542ee9606e","Type":"ContainerStarted","Data":"b2a059325174ea23d11a15a887f69e05437f1112b0174bc4e490341a12886fa4"}
Sep 15 07:12:39.382096 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:39.382065    2568 generic.go:356] "Generic (PLEG): container finished" podID="96c4363f-df06-4025-a4ab-24542ee9606e" containerID="b2a059325174ea23d11a15a887f69e05437f1112b0174bc4e490341a12886fa4" exitCode=0
Sep 15 07:12:39.382436 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:39.382116    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" event={"ID":"96c4363f-df06-4025-a4ab-24542ee9606e","Type":"ContainerDied","Data":"b2a059325174ea23d11a15a887f69e05437f1112b0174bc4e490341a12886fa4"}
Sep 15 07:12:40.388501 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:40.388467    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" event={"ID":"96c4363f-df06-4025-a4ab-24542ee9606e","Type":"ContainerStarted","Data":"0911dc5073a33f79869dce5828d8f8059eafccbe1834b35a63dadaa575ff57f7"}
Sep 15 07:12:45.411086 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:45.411054    2568 generic.go:356] "Generic (PLEG): container finished" podID="96c4363f-df06-4025-a4ab-24542ee9606e" containerID="0911dc5073a33f79869dce5828d8f8059eafccbe1834b35a63dadaa575ff57f7" exitCode=0
Sep 15 07:12:45.411458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:45.411104    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" event={"ID":"96c4363f-df06-4025-a4ab-24542ee9606e","Type":"ContainerDied","Data":"0911dc5073a33f79869dce5828d8f8059eafccbe1834b35a63dadaa575ff57f7"}
Sep 15 07:12:46.422183 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:46.422140    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" event={"ID":"96c4363f-df06-4025-a4ab-24542ee9606e","Type":"ContainerStarted","Data":"eb2b17e6d6de3600b68c287652397b4ba3e917ddb52965433c0a40fec0b04d75"}
Sep 15 07:12:46.422646 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:46.422206    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" event={"ID":"96c4363f-df06-4025-a4ab-24542ee9606e","Type":"ContainerStarted","Data":"19ef917336e72238084c96c3866f7f53748f6be12a062619fc133020636328d7"}
Sep 15 07:12:46.422646 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:46.422228    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" event={"ID":"96c4363f-df06-4025-a4ab-24542ee9606e","Type":"ContainerStarted","Data":"fcb77dd3b8aaee5c281332531de47da96fd8258fbf2445269f8aee73670e4444"}
Sep 15 07:12:46.422646 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:46.422247    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" event={"ID":"96c4363f-df06-4025-a4ab-24542ee9606e","Type":"ContainerStarted","Data":"07a69178f7fd7c2b29470d686bd13897f4003fab030aa04bea58e4e688ba4670"}
Sep 15 07:12:46.450303 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:46.450236    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" podStartSLOduration=14.119907988 podStartE2EDuration="38.450213613s" totalImagesPullingTime="24.330305625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:12:46.448153804 +0000 UTC m=+706.239071632" watchObservedRunningTime="2026-09-15 07:12:46.450213613 +0000 UTC m=+706.241131434"
Sep 15 07:12:48.787880 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:48.787838    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:48.788493 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:48.788462    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:48.788493 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:48.788495    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:48.788680 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:48.788517    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:48.790214 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:48.790137    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused"
Sep 15 07:12:48.790214 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:48.790163    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.29:8816: connect: connection refused"
Sep 15 07:12:48.790395 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:48.790162    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused"
Sep 15 07:12:48.790395 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:48.790170    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Sep 15 07:12:49.787646 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:49.787588    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:49.787869 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:49.787668    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:49.787869 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:49.787692    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:49.787869 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:49.787726    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:51.787559 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:51.787508    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused"
Sep 15 07:12:51.787559 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:51.787544    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.29:8816: connect: connection refused"
Sep 15 07:12:51.788114 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:51.787562    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Sep 15 07:12:51.788114 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:51.787566    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused"
Sep 15 07:12:54.788083 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:54.787978    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:54.788439 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:54.788159    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:54.788439 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:54.788413    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:54.788862 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:54.788838    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:54.789007 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:54.788969    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:54.789067 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:54.789026    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:54.793430 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:54.793412    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:12:55.482835 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:12:55.482799    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:13:57.065873 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.065838    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"]
Sep 15 07:13:57.066877 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.066736    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="registry" containerID="cri-o://07a69178f7fd7c2b29470d686bd13897f4003fab030aa04bea58e4e688ba4670" gracePeriod=30
Sep 15 07:13:57.066877 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.066764    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="offline" containerID="cri-o://19ef917336e72238084c96c3866f7f53748f6be12a062619fc133020636328d7" gracePeriod=30
Sep 15 07:13:57.066877 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.066797    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="online" containerID="cri-o://fcb77dd3b8aaee5c281332531de47da96fd8258fbf2445269f8aee73670e4444" gracePeriod=30
Sep 15 07:13:57.067106 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.066779    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="ui" containerID="cri-o://eb2b17e6d6de3600b68c287652397b4ba3e917ddb52965433c0a40fec0b04d75" gracePeriod=30
Sep 15 07:13:57.473381 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.473344    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"]
Sep 15 07:13:57.478506 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.478484    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:13:57.482527 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.482502    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-ccntp\""
Sep 15 07:13:57.492330 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.492192    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"]
Sep 15 07:13:57.618885 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.618844    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-offline-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-sf4wl\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:13:57.619076 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.618910    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-registry-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-sf4wl\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:13:57.619076 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.618945    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cc6927a3-5e5f-4225-8f28-27220c9b1d29-feast-data\") pod \"feast-simple-feast-setup-77fbccbbbf-sf4wl\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:13:57.619195 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.619110    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-online-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-sf4wl\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:13:57.619195 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.619173    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-ui-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-sf4wl\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:13:57.619276 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.619205    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmghf\" (UniqueName: \"kubernetes.io/projected/cc6927a3-5e5f-4225-8f28-27220c9b1d29-kube-api-access-tmghf\") pod \"feast-simple-feast-setup-77fbccbbbf-sf4wl\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:13:57.720261 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.720216    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-online-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-sf4wl\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:13:57.720261 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.720259    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-ui-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-sf4wl\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:13:57.720487 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.720282    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmghf\" (UniqueName: \"kubernetes.io/projected/cc6927a3-5e5f-4225-8f28-27220c9b1d29-kube-api-access-tmghf\") pod \"feast-simple-feast-setup-77fbccbbbf-sf4wl\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:13:57.720487 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.720316    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-offline-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-sf4wl\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:13:57.720487 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.720355    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-registry-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-sf4wl\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:13:57.720487 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.720388    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cc6927a3-5e5f-4225-8f28-27220c9b1d29-feast-data\") pod \"feast-simple-feast-setup-77fbccbbbf-sf4wl\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:13:57.720487 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:13:57.720390    2568 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Sep 15 07:13:57.720487 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:13:57.720464    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-ui-tls podName:cc6927a3-5e5f-4225-8f28-27220c9b1d29 nodeName:}" failed. No retries permitted until 2026-09-15 07:13:58.220438809 +0000 UTC m=+778.011356615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-ui-tls") pod "feast-simple-feast-setup-77fbccbbbf-sf4wl" (UID: "cc6927a3-5e5f-4225-8f28-27220c9b1d29") : secret "feast-simple-feast-setup-ui-tls" not found
Sep 15 07:13:57.720817 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.720795    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cc6927a3-5e5f-4225-8f28-27220c9b1d29-feast-data\") pod \"feast-simple-feast-setup-77fbccbbbf-sf4wl\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:13:57.723187 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.723154    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-online-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-sf4wl\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:13:57.723464 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.723406    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-offline-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-sf4wl\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:13:57.723464 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.723406    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-registry-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-sf4wl\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:13:57.728845 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:57.728816    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmghf\" (UniqueName: \"kubernetes.io/projected/cc6927a3-5e5f-4225-8f28-27220c9b1d29-kube-api-access-tmghf\") pod \"feast-simple-feast-setup-77fbccbbbf-sf4wl\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:13:58.225458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:58.225421    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-ui-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-sf4wl\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:13:58.227780 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:58.227761    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-ui-tls\") pod \"feast-simple-feast-setup-77fbccbbbf-sf4wl\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") " pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:13:58.392866 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:58.392825    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:13:58.671334 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:58.670461    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"]
Sep 15 07:13:58.750262 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:58.750229    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" event={"ID":"cc6927a3-5e5f-4225-8f28-27220c9b1d29","Type":"ContainerStarted","Data":"77e76c3ac7fee45e8198b3ac466e45505565dce68c5cd30e112b77b97dc25458"}
Sep 15 07:13:58.750432 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:58.750285    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" event={"ID":"cc6927a3-5e5f-4225-8f28-27220c9b1d29","Type":"ContainerStarted","Data":"4a8b7b176d1e0eaa0bf8e83bf44a557d773f19aaaf05578c7cd8ba3461318191"}
Sep 15 07:13:58.753396 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:58.753374    2568 generic.go:356] "Generic (PLEG): container finished" podID="96c4363f-df06-4025-a4ab-24542ee9606e" containerID="eb2b17e6d6de3600b68c287652397b4ba3e917ddb52965433c0a40fec0b04d75" exitCode=0
Sep 15 07:13:58.753396 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:58.753394    2568 generic.go:356] "Generic (PLEG): container finished" podID="96c4363f-df06-4025-a4ab-24542ee9606e" containerID="fcb77dd3b8aaee5c281332531de47da96fd8258fbf2445269f8aee73670e4444" exitCode=0
Sep 15 07:13:58.753559 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:58.753439    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" event={"ID":"96c4363f-df06-4025-a4ab-24542ee9606e","Type":"ContainerDied","Data":"eb2b17e6d6de3600b68c287652397b4ba3e917ddb52965433c0a40fec0b04d75"}
Sep 15 07:13:58.753559 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:13:58.753470    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" event={"ID":"96c4363f-df06-4025-a4ab-24542ee9606e","Type":"ContainerDied","Data":"fcb77dd3b8aaee5c281332531de47da96fd8258fbf2445269f8aee73670e4444"}
Sep 15 07:14:03.775258 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:03.775172    2568 generic.go:356] "Generic (PLEG): container finished" podID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerID="77e76c3ac7fee45e8198b3ac466e45505565dce68c5cd30e112b77b97dc25458" exitCode=0
Sep 15 07:14:03.775258 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:03.775243    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" event={"ID":"cc6927a3-5e5f-4225-8f28-27220c9b1d29","Type":"ContainerDied","Data":"77e76c3ac7fee45e8198b3ac466e45505565dce68c5cd30e112b77b97dc25458"}
Sep 15 07:14:04.782659 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:04.782623    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" event={"ID":"cc6927a3-5e5f-4225-8f28-27220c9b1d29","Type":"ContainerStarted","Data":"e67ab8855acb0e60b951945d17118a456ac6379e4c65f1264bad05d9f60f7e48"}
Sep 15 07:14:04.789302 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:04.789267    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused"
Sep 15 07:14:05.479816 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:05.479768    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Sep 15 07:14:09.806949 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:09.806870    2568 generic.go:356] "Generic (PLEG): container finished" podID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerID="e67ab8855acb0e60b951945d17118a456ac6379e4c65f1264bad05d9f60f7e48" exitCode=0
Sep 15 07:14:09.807310 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:09.806944    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" event={"ID":"cc6927a3-5e5f-4225-8f28-27220c9b1d29","Type":"ContainerDied","Data":"e67ab8855acb0e60b951945d17118a456ac6379e4c65f1264bad05d9f60f7e48"}
Sep 15 07:14:10.817474 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:10.817430    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" event={"ID":"cc6927a3-5e5f-4225-8f28-27220c9b1d29","Type":"ContainerStarted","Data":"fec85a9182d824cc03eda4762df38934ff324aae00311673b9dfe27fea098e1c"}
Sep 15 07:14:10.818047 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:10.817493    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" event={"ID":"cc6927a3-5e5f-4225-8f28-27220c9b1d29","Type":"ContainerStarted","Data":"b4d598b1e41495abf28ac51606c59d0f76c14ab1d79c5e8e0dfafa1a992ceb79"}
Sep 15 07:14:10.818047 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:10.817516    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" event={"ID":"cc6927a3-5e5f-4225-8f28-27220c9b1d29","Type":"ContainerStarted","Data":"d333791fc7e56e9c21f51dcdaeb6d146d95362d3337a6c6d1707715b57cea286"}
Sep 15 07:14:10.818047 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:10.817536    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" event={"ID":"cc6927a3-5e5f-4225-8f28-27220c9b1d29","Type":"ContainerStarted","Data":"4c1e6acef6f9e2835152c33a4edf1b4b68227689b566d154950b181fc9e3cbc6"}
Sep 15 07:14:10.843919 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:10.843854    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" podStartSLOduration=13.84383257 podStartE2EDuration="13.84383257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:13:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:14:10.842038759 +0000 UTC m=+790.632956582" watchObservedRunningTime="2026-09-15 07:14:10.84383257 +0000 UTC m=+790.634750395"
Sep 15 07:14:13.393931 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:13.393835    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:14:13.393931 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:13.393906    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:14:13.393931 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:13.393925    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:14:13.394531 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:13.394069    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:14:13.396231 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:13.396061    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
Sep 15 07:14:13.396231 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:13.396088    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.30:8816: connect: connection refused"
Sep 15 07:14:13.396231 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:13.396103    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Sep 15 07:14:13.396231 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:13.396168    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused"
Sep 15 07:14:14.789678 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:14.789614    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused"
Sep 15 07:14:15.480132 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:15.480081    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Sep 15 07:14:16.393176 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:16.393129    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused"
Sep 15 07:14:16.393753 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:16.393138    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
Sep 15 07:14:16.393955 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:16.393172    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Sep 15 07:14:16.394094 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:16.393395    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.30:8816: connect: connection refused"
Sep 15 07:14:18.393791 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:18.393747    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:14:18.393791 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:18.393803    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:14:18.394329 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:18.393817    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:14:18.394329 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:18.393828    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:14:19.394482 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:19.394450    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:14:19.394960 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:19.394576    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:14:19.394960 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:19.394747    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:14:19.399610 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:19.399584    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:14:19.873565 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:19.873535    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:14:19.873728 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:19.873617    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:14:19.873802 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:19.873774    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:14:19.876240 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:19.876148    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:14:24.789241 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:24.789152    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused"
Sep 15 07:14:24.789653 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:24.789290    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:14:25.480126 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:25.480087    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Sep 15 07:14:25.480275 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:25.480198    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:14:27.714379 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.714351    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:14:27.791544 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.791514    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sz8xx\" (UniqueName: \"kubernetes.io/projected/96c4363f-df06-4025-a4ab-24542ee9606e-kube-api-access-sz8xx\") pod \"96c4363f-df06-4025-a4ab-24542ee9606e\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") "
Sep 15 07:14:27.791825 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.791553    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-ui-tls\") pod \"96c4363f-df06-4025-a4ab-24542ee9606e\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") "
Sep 15 07:14:27.791825 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.791593    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-offline-tls\") pod \"96c4363f-df06-4025-a4ab-24542ee9606e\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") "
Sep 15 07:14:27.791825 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.791618    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-registry-tls\") pod \"96c4363f-df06-4025-a4ab-24542ee9606e\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") "
Sep 15 07:14:27.791825 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.791743    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-online-tls\") pod \"96c4363f-df06-4025-a4ab-24542ee9606e\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") "
Sep 15 07:14:27.791825 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.791769    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96c4363f-df06-4025-a4ab-24542ee9606e-feast-data\") pod \"96c4363f-df06-4025-a4ab-24542ee9606e\" (UID: \"96c4363f-df06-4025-a4ab-24542ee9606e\") "
Sep 15 07:14:27.792491 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.792452    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96c4363f-df06-4025-a4ab-24542ee9606e-feast-data" (OuterVolumeSpecName: "feast-data") pod "96c4363f-df06-4025-a4ab-24542ee9606e" (UID: "96c4363f-df06-4025-a4ab-24542ee9606e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 07:14:27.794050 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.794024    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "96c4363f-df06-4025-a4ab-24542ee9606e" (UID: "96c4363f-df06-4025-a4ab-24542ee9606e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:14:27.794248 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.794210    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-online-tls" (OuterVolumeSpecName: "online-tls") pod "96c4363f-df06-4025-a4ab-24542ee9606e" (UID: "96c4363f-df06-4025-a4ab-24542ee9606e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:14:27.794339 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.794245    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "96c4363f-df06-4025-a4ab-24542ee9606e" (UID: "96c4363f-df06-4025-a4ab-24542ee9606e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:14:27.794339 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.794218    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96c4363f-df06-4025-a4ab-24542ee9606e-kube-api-access-sz8xx" (OuterVolumeSpecName: "kube-api-access-sz8xx") pod "96c4363f-df06-4025-a4ab-24542ee9606e" (UID: "96c4363f-df06-4025-a4ab-24542ee9606e"). InnerVolumeSpecName "kube-api-access-sz8xx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:14:27.794339 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.794262    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "96c4363f-df06-4025-a4ab-24542ee9606e" (UID: "96c4363f-df06-4025-a4ab-24542ee9606e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:14:27.893186 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.893113    2568 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-online-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:14:27.893186 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.893139    2568 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96c4363f-df06-4025-a4ab-24542ee9606e-feast-data\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:14:27.893186 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.893148    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sz8xx\" (UniqueName: \"kubernetes.io/projected/96c4363f-df06-4025-a4ab-24542ee9606e-kube-api-access-sz8xx\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:14:27.893186 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.893159    2568 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-ui-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:14:27.893186 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.893169    2568 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-offline-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:14:27.893186 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.893178    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96c4363f-df06-4025-a4ab-24542ee9606e-registry-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:14:27.908469 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.908442    2568 generic.go:356] "Generic (PLEG): container finished" podID="96c4363f-df06-4025-a4ab-24542ee9606e" containerID="19ef917336e72238084c96c3866f7f53748f6be12a062619fc133020636328d7" exitCode=137
Sep 15 07:14:27.908469 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.908463    2568 generic.go:356] "Generic (PLEG): container finished" podID="96c4363f-df06-4025-a4ab-24542ee9606e" containerID="07a69178f7fd7c2b29470d686bd13897f4003fab030aa04bea58e4e688ba4670" exitCode=137
Sep 15 07:14:27.908665 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.908491    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" event={"ID":"96c4363f-df06-4025-a4ab-24542ee9606e","Type":"ContainerDied","Data":"19ef917336e72238084c96c3866f7f53748f6be12a062619fc133020636328d7"}
Sep 15 07:14:27.908665 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.908504    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"
Sep 15 07:14:27.908665 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.908526    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" event={"ID":"96c4363f-df06-4025-a4ab-24542ee9606e","Type":"ContainerDied","Data":"07a69178f7fd7c2b29470d686bd13897f4003fab030aa04bea58e4e688ba4670"}
Sep 15 07:14:27.908665 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.908541    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8" event={"ID":"96c4363f-df06-4025-a4ab-24542ee9606e","Type":"ContainerDied","Data":"9fdf412d9818d65e21da222609160c47cab61bba2844474012fda93132d71557"}
Sep 15 07:14:27.908665 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.908558    2568 scope.go:117] "RemoveContainer" containerID="eb2b17e6d6de3600b68c287652397b4ba3e917ddb52965433c0a40fec0b04d75"
Sep 15 07:14:27.917688 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.917670    2568 scope.go:117] "RemoveContainer" containerID="19ef917336e72238084c96c3866f7f53748f6be12a062619fc133020636328d7"
Sep 15 07:14:27.925441 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.925423    2568 scope.go:117] "RemoveContainer" containerID="fcb77dd3b8aaee5c281332531de47da96fd8258fbf2445269f8aee73670e4444"
Sep 15 07:14:27.932090 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.932064    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"]
Sep 15 07:14:27.933559 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.933497    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-77fbccbbbf-hq9m8"]
Sep 15 07:14:27.933618 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.933604    2568 scope.go:117] "RemoveContainer" containerID="07a69178f7fd7c2b29470d686bd13897f4003fab030aa04bea58e4e688ba4670"
Sep 15 07:14:27.941141 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.941126    2568 scope.go:117] "RemoveContainer" containerID="0911dc5073a33f79869dce5828d8f8059eafccbe1834b35a63dadaa575ff57f7"
Sep 15 07:14:27.948217 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.948202    2568 scope.go:117] "RemoveContainer" containerID="b2a059325174ea23d11a15a887f69e05437f1112b0174bc4e490341a12886fa4"
Sep 15 07:14:27.955486 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.955470    2568 scope.go:117] "RemoveContainer" containerID="eb2b17e6d6de3600b68c287652397b4ba3e917ddb52965433c0a40fec0b04d75"
Sep 15 07:14:27.955743 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:14:27.955702    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb2b17e6d6de3600b68c287652397b4ba3e917ddb52965433c0a40fec0b04d75\": container with ID starting with eb2b17e6d6de3600b68c287652397b4ba3e917ddb52965433c0a40fec0b04d75 not found: ID does not exist" containerID="eb2b17e6d6de3600b68c287652397b4ba3e917ddb52965433c0a40fec0b04d75"
Sep 15 07:14:27.955813 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.955750    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb2b17e6d6de3600b68c287652397b4ba3e917ddb52965433c0a40fec0b04d75"} err="failed to get container status \"eb2b17e6d6de3600b68c287652397b4ba3e917ddb52965433c0a40fec0b04d75\": rpc error: code = NotFound desc = could not find container \"eb2b17e6d6de3600b68c287652397b4ba3e917ddb52965433c0a40fec0b04d75\": container with ID starting with eb2b17e6d6de3600b68c287652397b4ba3e917ddb52965433c0a40fec0b04d75 not found: ID does not exist"
Sep 15 07:14:27.955813 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.955767    2568 scope.go:117] "RemoveContainer" containerID="19ef917336e72238084c96c3866f7f53748f6be12a062619fc133020636328d7"
Sep 15 07:14:27.956028 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:14:27.956008    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19ef917336e72238084c96c3866f7f53748f6be12a062619fc133020636328d7\": container with ID starting with 19ef917336e72238084c96c3866f7f53748f6be12a062619fc133020636328d7 not found: ID does not exist" containerID="19ef917336e72238084c96c3866f7f53748f6be12a062619fc133020636328d7"
Sep 15 07:14:27.956106 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.956037    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19ef917336e72238084c96c3866f7f53748f6be12a062619fc133020636328d7"} err="failed to get container status \"19ef917336e72238084c96c3866f7f53748f6be12a062619fc133020636328d7\": rpc error: code = NotFound desc = could not find container \"19ef917336e72238084c96c3866f7f53748f6be12a062619fc133020636328d7\": container with ID starting with 19ef917336e72238084c96c3866f7f53748f6be12a062619fc133020636328d7 not found: ID does not exist"
Sep 15 07:14:27.956106 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.956059    2568 scope.go:117] "RemoveContainer" containerID="fcb77dd3b8aaee5c281332531de47da96fd8258fbf2445269f8aee73670e4444"
Sep 15 07:14:27.956302 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:14:27.956285    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcb77dd3b8aaee5c281332531de47da96fd8258fbf2445269f8aee73670e4444\": container with ID starting with fcb77dd3b8aaee5c281332531de47da96fd8258fbf2445269f8aee73670e4444 not found: ID does not exist" containerID="fcb77dd3b8aaee5c281332531de47da96fd8258fbf2445269f8aee73670e4444"
Sep 15 07:14:27.956341 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.956307    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcb77dd3b8aaee5c281332531de47da96fd8258fbf2445269f8aee73670e4444"} err="failed to get container status \"fcb77dd3b8aaee5c281332531de47da96fd8258fbf2445269f8aee73670e4444\": rpc error: code = NotFound desc = could not find container \"fcb77dd3b8aaee5c281332531de47da96fd8258fbf2445269f8aee73670e4444\": container with ID starting with fcb77dd3b8aaee5c281332531de47da96fd8258fbf2445269f8aee73670e4444 not found: ID does not exist"
Sep 15 07:14:27.956341 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.956322    2568 scope.go:117] "RemoveContainer" containerID="07a69178f7fd7c2b29470d686bd13897f4003fab030aa04bea58e4e688ba4670"
Sep 15 07:14:27.956532 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:14:27.956517    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07a69178f7fd7c2b29470d686bd13897f4003fab030aa04bea58e4e688ba4670\": container with ID starting with 07a69178f7fd7c2b29470d686bd13897f4003fab030aa04bea58e4e688ba4670 not found: ID does not exist" containerID="07a69178f7fd7c2b29470d686bd13897f4003fab030aa04bea58e4e688ba4670"
Sep 15 07:14:27.956580 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.956535    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07a69178f7fd7c2b29470d686bd13897f4003fab030aa04bea58e4e688ba4670"} err="failed to get container status \"07a69178f7fd7c2b29470d686bd13897f4003fab030aa04bea58e4e688ba4670\": rpc error: code = NotFound desc = could not find container \"07a69178f7fd7c2b29470d686bd13897f4003fab030aa04bea58e4e688ba4670\": container with ID starting with 07a69178f7fd7c2b29470d686bd13897f4003fab030aa04bea58e4e688ba4670 not found: ID does not exist"
Sep 15 07:14:27.956580 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.956547    2568 scope.go:117] "RemoveContainer" containerID="0911dc5073a33f79869dce5828d8f8059eafccbe1834b35a63dadaa575ff57f7"
Sep 15 07:14:27.956778 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:14:27.956762    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0911dc5073a33f79869dce5828d8f8059eafccbe1834b35a63dadaa575ff57f7\": container with ID starting with 0911dc5073a33f79869dce5828d8f8059eafccbe1834b35a63dadaa575ff57f7 not found: ID does not exist" containerID="0911dc5073a33f79869dce5828d8f8059eafccbe1834b35a63dadaa575ff57f7"
Sep 15 07:14:27.956818 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.956780    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0911dc5073a33f79869dce5828d8f8059eafccbe1834b35a63dadaa575ff57f7"} err="failed to get container status \"0911dc5073a33f79869dce5828d8f8059eafccbe1834b35a63dadaa575ff57f7\": rpc error: code = NotFound desc = could not find container \"0911dc5073a33f79869dce5828d8f8059eafccbe1834b35a63dadaa575ff57f7\": container with ID starting with 0911dc5073a33f79869dce5828d8f8059eafccbe1834b35a63dadaa575ff57f7 not found: ID does not exist"
Sep 15 07:14:27.956818 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.956794    2568 scope.go:117] "RemoveContainer" containerID="b2a059325174ea23d11a15a887f69e05437f1112b0174bc4e490341a12886fa4"
Sep 15 07:14:27.956994 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:14:27.956977    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2a059325174ea23d11a15a887f69e05437f1112b0174bc4e490341a12886fa4\": container with ID starting with b2a059325174ea23d11a15a887f69e05437f1112b0174bc4e490341a12886fa4 not found: ID does not exist" containerID="b2a059325174ea23d11a15a887f69e05437f1112b0174bc4e490341a12886fa4"
Sep 15 07:14:27.957038 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.956997    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2a059325174ea23d11a15a887f69e05437f1112b0174bc4e490341a12886fa4"} err="failed to get container status \"b2a059325174ea23d11a15a887f69e05437f1112b0174bc4e490341a12886fa4\": rpc error: code = NotFound desc = could not find container \"b2a059325174ea23d11a15a887f69e05437f1112b0174bc4e490341a12886fa4\": container with ID starting with b2a059325174ea23d11a15a887f69e05437f1112b0174bc4e490341a12886fa4 not found: ID does not exist"
Sep 15 07:14:27.957038 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.957011    2568 scope.go:117] "RemoveContainer" containerID="eb2b17e6d6de3600b68c287652397b4ba3e917ddb52965433c0a40fec0b04d75"
Sep 15 07:14:27.957237 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.957220    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb2b17e6d6de3600b68c287652397b4ba3e917ddb52965433c0a40fec0b04d75"} err="failed to get container status \"eb2b17e6d6de3600b68c287652397b4ba3e917ddb52965433c0a40fec0b04d75\": rpc error: code = NotFound desc = could not find container \"eb2b17e6d6de3600b68c287652397b4ba3e917ddb52965433c0a40fec0b04d75\": container with ID starting with eb2b17e6d6de3600b68c287652397b4ba3e917ddb52965433c0a40fec0b04d75 not found: ID does not exist"
Sep 15 07:14:27.957275 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.957238    2568 scope.go:117] "RemoveContainer" containerID="19ef917336e72238084c96c3866f7f53748f6be12a062619fc133020636328d7"
Sep 15 07:14:27.957436 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.957420    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19ef917336e72238084c96c3866f7f53748f6be12a062619fc133020636328d7"} err="failed to get container status \"19ef917336e72238084c96c3866f7f53748f6be12a062619fc133020636328d7\": rpc error: code = NotFound desc = could not find container \"19ef917336e72238084c96c3866f7f53748f6be12a062619fc133020636328d7\": container with ID starting with 19ef917336e72238084c96c3866f7f53748f6be12a062619fc133020636328d7 not found: ID does not exist"
Sep 15 07:14:27.957475 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.957437    2568 scope.go:117] "RemoveContainer" containerID="fcb77dd3b8aaee5c281332531de47da96fd8258fbf2445269f8aee73670e4444"
Sep 15 07:14:27.957637 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.957618    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcb77dd3b8aaee5c281332531de47da96fd8258fbf2445269f8aee73670e4444"} err="failed to get container status \"fcb77dd3b8aaee5c281332531de47da96fd8258fbf2445269f8aee73670e4444\": rpc error: code = NotFound desc = could not find container \"fcb77dd3b8aaee5c281332531de47da96fd8258fbf2445269f8aee73670e4444\": container with ID starting with fcb77dd3b8aaee5c281332531de47da96fd8258fbf2445269f8aee73670e4444 not found: ID does not exist"
Sep 15 07:14:27.957680 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.957636    2568 scope.go:117] "RemoveContainer" containerID="07a69178f7fd7c2b29470d686bd13897f4003fab030aa04bea58e4e688ba4670"
Sep 15 07:14:27.957863 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.957844    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07a69178f7fd7c2b29470d686bd13897f4003fab030aa04bea58e4e688ba4670"} err="failed to get container status \"07a69178f7fd7c2b29470d686bd13897f4003fab030aa04bea58e4e688ba4670\": rpc error: code = NotFound desc = could not find container \"07a69178f7fd7c2b29470d686bd13897f4003fab030aa04bea58e4e688ba4670\": container with ID starting with 07a69178f7fd7c2b29470d686bd13897f4003fab030aa04bea58e4e688ba4670 not found: ID does not exist"
Sep 15 07:14:27.957921 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.957863    2568 scope.go:117] "RemoveContainer" containerID="0911dc5073a33f79869dce5828d8f8059eafccbe1834b35a63dadaa575ff57f7"
Sep 15 07:14:27.958062 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.958046    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0911dc5073a33f79869dce5828d8f8059eafccbe1834b35a63dadaa575ff57f7"} err="failed to get container status \"0911dc5073a33f79869dce5828d8f8059eafccbe1834b35a63dadaa575ff57f7\": rpc error: code = NotFound desc = could not find container \"0911dc5073a33f79869dce5828d8f8059eafccbe1834b35a63dadaa575ff57f7\": container with ID starting with 0911dc5073a33f79869dce5828d8f8059eafccbe1834b35a63dadaa575ff57f7 not found: ID does not exist"
Sep 15 07:14:27.958105 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.958061    2568 scope.go:117] "RemoveContainer" containerID="b2a059325174ea23d11a15a887f69e05437f1112b0174bc4e490341a12886fa4"
Sep 15 07:14:27.958261 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:27.958242    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2a059325174ea23d11a15a887f69e05437f1112b0174bc4e490341a12886fa4"} err="failed to get container status \"b2a059325174ea23d11a15a887f69e05437f1112b0174bc4e490341a12886fa4\": rpc error: code = NotFound desc = could not find container \"b2a059325174ea23d11a15a887f69e05437f1112b0174bc4e490341a12886fa4\": container with ID starting with b2a059325174ea23d11a15a887f69e05437f1112b0174bc4e490341a12886fa4 not found: ID does not exist"
Sep 15 07:14:28.741604 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:14:28.741574    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" path="/var/lib/kubelet/pods/96c4363f-df06-4025-a4ab-24542ee9606e/volumes"
Sep 15 07:15:22.557147 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.557110    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"]
Sep 15 07:15:22.557643 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.557586    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="ui"
Sep 15 07:15:22.557643 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.557600    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="ui"
Sep 15 07:15:22.557643 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.557622    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="offline"
Sep 15 07:15:22.557643 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.557630    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="offline"
Sep 15 07:15:22.557643 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.557640    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="registry"
Sep 15 07:15:22.557933 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.557649    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="registry"
Sep 15 07:15:22.557933 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.557662    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="feast-init"
Sep 15 07:15:22.557933 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.557670    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="feast-init"
Sep 15 07:15:22.557933 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.557732    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="feast-apply"
Sep 15 07:15:22.557933 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.557742    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="feast-apply"
Sep 15 07:15:22.557933 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.557754    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="online"
Sep 15 07:15:22.557933 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.557762    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="online"
Sep 15 07:15:22.557933 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.557845    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="online"
Sep 15 07:15:22.557933 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.557856    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="registry"
Sep 15 07:15:22.557933 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.557864    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="offline"
Sep 15 07:15:22.557933 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.557874    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="96c4363f-df06-4025-a4ab-24542ee9606e" containerName="ui"
Sep 15 07:15:22.563107 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.563080    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:22.568012 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.567988    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 15 07:15:22.568240 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.568016    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-sbzlf\""
Sep 15 07:15:22.568240 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.568020    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 15 07:15:22.568398 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.568054    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 15 07:15:22.568398 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.568107    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 15 07:15:22.568398 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.568125    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Sep 15 07:15:22.568773 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.568758    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 15 07:15:22.568841 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.568799    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 15 07:15:22.577498 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.577479    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"]
Sep 15 07:15:22.731373 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.731341    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-offline-tls\") pod \"feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:22.731515 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.731394    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr6lf\" (UniqueName: \"kubernetes.io/projected/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-kube-api-access-zr6lf\") pod \"feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:22.731515 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.731422    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-feast-data\") pod \"feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:22.731515 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.731466    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-ui-tls\") pod \"feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:22.731620 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.731533    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-registry-tls\") pod \"feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:22.731620 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.731585    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-online-tls\") pod \"feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:22.832903 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.832821    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-offline-tls\") pod \"feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:22.832903 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.832879    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr6lf\" (UniqueName: \"kubernetes.io/projected/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-kube-api-access-zr6lf\") pod \"feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:22.833114 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.832905    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-feast-data\") pod \"feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:22.833114 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.832951    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-ui-tls\") pod \"feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:22.833114 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.832992    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-registry-tls\") pod \"feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:22.833114 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.833027    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-online-tls\") pod \"feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:22.833331 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:15:22.833112    2568 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 15 07:15:22.833331 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:15:22.833191    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-ui-tls podName:94cb7f48-5fda-4c0a-9c4d-570cd04f26ff nodeName:}" failed. No retries permitted until 2026-09-15 07:15:23.33316842 +0000 UTC m=+863.124086243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-ui-tls") pod "feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" (UID: "94cb7f48-5fda-4c0a-9c4d-570cd04f26ff") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 15 07:15:22.833331 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.833306    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-feast-data\") pod \"feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:22.833723 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.833689    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-registry-tls\") pod \"feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:22.835279 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.835254    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-offline-tls\") pod \"feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:22.835366 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.835315    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-online-tls\") pod \"feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:22.840758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:22.840740    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr6lf\" (UniqueName: \"kubernetes.io/projected/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-kube-api-access-zr6lf\") pod \"feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:23.337888 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:23.337854    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-ui-tls\") pod \"feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:23.340235 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:23.340209    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-ui-tls\") pod \"feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:23.473504 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:23.473467    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:23.747008 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:23.746980    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"]
Sep 15 07:15:23.748623 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:15:23.748594    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94cb7f48_5fda_4c0a_9c4d_570cd04f26ff.slice/crio-13fb7e3229818eedd5bf30537742073dd80f881e71e88875452c3e222868c976 WatchSource:0}: Error finding container 13fb7e3229818eedd5bf30537742073dd80f881e71e88875452c3e222868c976: Status 404 returned error can't find the container with id 13fb7e3229818eedd5bf30537742073dd80f881e71e88875452c3e222868c976
Sep 15 07:15:24.141357 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:24.141267    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" event={"ID":"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff","Type":"ContainerStarted","Data":"f4b1a77abd2d1dc3717c16f8db3e130557de024ee673f9564e9fdb7c546e2f52"}
Sep 15 07:15:24.141357 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:24.141315    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" event={"ID":"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff","Type":"ContainerStarted","Data":"13fb7e3229818eedd5bf30537742073dd80f881e71e88875452c3e222868c976"}
Sep 15 07:15:29.164800 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:29.164768    2568 generic.go:356] "Generic (PLEG): container finished" podID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerID="f4b1a77abd2d1dc3717c16f8db3e130557de024ee673f9564e9fdb7c546e2f52" exitCode=0
Sep 15 07:15:29.165228 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:29.164848    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" event={"ID":"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff","Type":"ContainerDied","Data":"f4b1a77abd2d1dc3717c16f8db3e130557de024ee673f9564e9fdb7c546e2f52"}
Sep 15 07:15:30.171271 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:30.171235    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" event={"ID":"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff","Type":"ContainerStarted","Data":"5b68bf0ea896cc697c9d893fc251bc4edfc239f2707b9cd6b1dbf8d86edf87d4"}
Sep 15 07:15:52.269092 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:52.269058    2568 generic.go:356] "Generic (PLEG): container finished" podID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerID="5b68bf0ea896cc697c9d893fc251bc4edfc239f2707b9cd6b1dbf8d86edf87d4" exitCode=0
Sep 15 07:15:52.269533 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:52.269111    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" event={"ID":"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff","Type":"ContainerDied","Data":"5b68bf0ea896cc697c9d893fc251bc4edfc239f2707b9cd6b1dbf8d86edf87d4"}
Sep 15 07:15:53.279406 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:53.279323    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" event={"ID":"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff","Type":"ContainerStarted","Data":"0a3c160aa7af1cc2ab8ccea99d11fce7f85d13c9cddc512413c4084d8e35b622"}
Sep 15 07:15:53.279406 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:53.279372    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" event={"ID":"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff","Type":"ContainerStarted","Data":"b785e3d87eba6154afbf454d174e6483b6e6a9ac01e2a335275bbe617b395465"}
Sep 15 07:15:53.279406 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:53.279390    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" event={"ID":"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff","Type":"ContainerStarted","Data":"9981613b071585f4cbeee6bc43bad0efe154a17ab2f9b76fa44ea80609e05931"}
Sep 15 07:15:53.304742 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:53.304674    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" podStartSLOduration=31.304657856 podStartE2EDuration="31.304657856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:15:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:15:53.302141246 +0000 UTC m=+893.093059066" watchObservedRunningTime="2026-09-15 07:15:53.304657856 +0000 UTC m=+893.095575677"
Sep 15 07:15:53.474646 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:53.474604    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:53.474961 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:53.474926    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:53.474961 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:53.474960    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:53.475129 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:53.474982    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:53.475129 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:53.474999    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:53.475129 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:53.475015    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:15:53.476444 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:53.476409    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.31:8816: connect: connection refused"
Sep 15 07:15:53.476444 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:53.476427    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Sep 15 07:15:53.476610 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:53.476438    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Sep 15 07:15:56.474306 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:56.474249    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.31:8816: connect: connection refused"
Sep 15 07:15:56.474788 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:56.474253    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Sep 15 07:15:56.474788 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:56.474248    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Sep 15 07:15:59.474422 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:59.474369    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Sep 15 07:15:59.474947 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:59.474379    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Sep 15 07:15:59.474947 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:15:59.474369    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.31:8816: connect: connection refused"
Sep 15 07:16:02.474971 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:16:02.474942    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:16:02.475374 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:16:02.475054    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:16:02.475837 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:16:02.475815    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:16:02.475920 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:16:02.475868    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:16:02.495427 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:16:02.495405    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:16:03.348469 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:16:03.348431    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:17:05.004195 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:05.004162    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"]
Sep 15 07:17:05.004730 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:05.004392    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="online" containerID="cri-o://9981613b071585f4cbeee6bc43bad0efe154a17ab2f9b76fa44ea80609e05931" gracePeriod=30
Sep 15 07:17:05.004730 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:05.004553    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="offline" containerID="cri-o://b785e3d87eba6154afbf454d174e6483b6e6a9ac01e2a335275bbe617b395465" gracePeriod=30
Sep 15 07:17:05.004730 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:05.004553    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="ui" containerID="cri-o://0a3c160aa7af1cc2ab8ccea99d11fce7f85d13c9cddc512413c4084d8e35b622" gracePeriod=30
Sep 15 07:17:05.107944 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:05.107908    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"]
Sep 15 07:17:05.108192 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:05.108163    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="registry" containerID="cri-o://4c1e6acef6f9e2835152c33a4edf1b4b68227689b566d154950b181fc9e3cbc6" gracePeriod=30
Sep 15 07:17:05.108192 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:05.108190    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="offline" containerID="cri-o://b4d598b1e41495abf28ac51606c59d0f76c14ab1d79c5e8e0dfafa1a992ceb79" gracePeriod=30
Sep 15 07:17:05.108343 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:05.108245    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="ui" containerID="cri-o://fec85a9182d824cc03eda4762df38934ff324aae00311673b9dfe27fea098e1c" gracePeriod=30
Sep 15 07:17:05.108402 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:05.108343    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="online" containerID="cri-o://d333791fc7e56e9c21f51dcdaeb6d146d95362d3337a6c6d1707715b57cea286" gracePeriod=30
Sep 15 07:17:06.603696 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:06.603658    2568 generic.go:356] "Generic (PLEG): container finished" podID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerID="fec85a9182d824cc03eda4762df38934ff324aae00311673b9dfe27fea098e1c" exitCode=0
Sep 15 07:17:06.603696 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:06.603682    2568 generic.go:356] "Generic (PLEG): container finished" podID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerID="d333791fc7e56e9c21f51dcdaeb6d146d95362d3337a6c6d1707715b57cea286" exitCode=0
Sep 15 07:17:06.604166 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:06.603756    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" event={"ID":"cc6927a3-5e5f-4225-8f28-27220c9b1d29","Type":"ContainerDied","Data":"fec85a9182d824cc03eda4762df38934ff324aae00311673b9dfe27fea098e1c"}
Sep 15 07:17:06.604166 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:06.603803    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" event={"ID":"cc6927a3-5e5f-4225-8f28-27220c9b1d29","Type":"ContainerDied","Data":"d333791fc7e56e9c21f51dcdaeb6d146d95362d3337a6c6d1707715b57cea286"}
Sep 15 07:17:06.606353 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:06.606329    2568 generic.go:356] "Generic (PLEG): container finished" podID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerID="0a3c160aa7af1cc2ab8ccea99d11fce7f85d13c9cddc512413c4084d8e35b622" exitCode=0
Sep 15 07:17:06.606353 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:06.606349    2568 generic.go:356] "Generic (PLEG): container finished" podID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerID="9981613b071585f4cbeee6bc43bad0efe154a17ab2f9b76fa44ea80609e05931" exitCode=0
Sep 15 07:17:06.606503 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:06.606398    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" event={"ID":"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff","Type":"ContainerDied","Data":"0a3c160aa7af1cc2ab8ccea99d11fce7f85d13c9cddc512413c4084d8e35b622"}
Sep 15 07:17:06.606503 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:06.606438    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" event={"ID":"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff","Type":"ContainerDied","Data":"9981613b071585f4cbeee6bc43bad0efe154a17ab2f9b76fa44ea80609e05931"}
Sep 15 07:17:09.873890 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:09.873849    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Sep 15 07:17:09.874323 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:09.873840    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused"
Sep 15 07:17:12.475596 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:12.475550    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Sep 15 07:17:13.330692 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:13.330652    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Sep 15 07:17:19.873728 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:19.873675    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused"
Sep 15 07:17:19.874176 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:19.873763    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Sep 15 07:17:22.476443 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:22.476403    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Sep 15 07:17:23.330512 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:23.330430    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Sep 15 07:17:29.873952 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:29.873910    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Sep 15 07:17:29.874422 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:29.873906    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused"
Sep 15 07:17:29.874422 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:29.874048    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:17:29.874422 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:29.874325    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:17:32.475811 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:32.475762    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Sep 15 07:17:32.476247 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:32.475906    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:17:33.330431 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:33.330396    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Sep 15 07:17:33.330593 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:33.330500    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:17:35.246206 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.246177    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:17:35.356250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.356166    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-ui-tls\") pod \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") "
Sep 15 07:17:35.356250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.356199    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-registry-tls\") pod \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") "
Sep 15 07:17:35.356250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.356222    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-online-tls\") pod \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") "
Sep 15 07:17:35.356541 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.356265    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zr6lf\" (UniqueName: \"kubernetes.io/projected/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-kube-api-access-zr6lf\") pod \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") "
Sep 15 07:17:35.356541 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.356461    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-feast-data\") pod \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") "
Sep 15 07:17:35.356541 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.356532    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-offline-tls\") pod \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\" (UID: \"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff\") "
Sep 15 07:17:35.356697 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.356591    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" (UID: "94cb7f48-5fda-4c0a-9c4d-570cd04f26ff"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 07:17:35.356832 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.356813    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-registry-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:17:35.357056 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.357027    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-feast-data" (OuterVolumeSpecName: "feast-data") pod "94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" (UID: "94cb7f48-5fda-4c0a-9c4d-570cd04f26ff"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 07:17:35.358456 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.358427    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" (UID: "94cb7f48-5fda-4c0a-9c4d-570cd04f26ff"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:17:35.358564 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.358511    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-kube-api-access-zr6lf" (OuterVolumeSpecName: "kube-api-access-zr6lf") pod "94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" (UID: "94cb7f48-5fda-4c0a-9c4d-570cd04f26ff"). InnerVolumeSpecName "kube-api-access-zr6lf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:17:35.358564 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.358539    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" (UID: "94cb7f48-5fda-4c0a-9c4d-570cd04f26ff"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:17:35.358660 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.358580    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-online-tls" (OuterVolumeSpecName: "online-tls") pod "94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" (UID: "94cb7f48-5fda-4c0a-9c4d-570cd04f26ff"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:17:35.457877 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.457830    2568 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-ui-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:17:35.457877 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.457872    2568 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-online-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:17:35.457877 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.457887    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zr6lf\" (UniqueName: \"kubernetes.io/projected/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-kube-api-access-zr6lf\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:17:35.458108 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.457901    2568 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-feast-data\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:17:35.458108 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.457911    2568 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff-offline-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:17:35.730757 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.730697    2568 generic.go:356] "Generic (PLEG): container finished" podID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerID="b785e3d87eba6154afbf454d174e6483b6e6a9ac01e2a335275bbe617b395465" exitCode=137
Sep 15 07:17:35.730757 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.730741    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" event={"ID":"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff","Type":"ContainerDied","Data":"b785e3d87eba6154afbf454d174e6483b6e6a9ac01e2a335275bbe617b395465"}
Sep 15 07:17:35.730992 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.730785    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"
Sep 15 07:17:35.730992 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.730801    2568 scope.go:117] "RemoveContainer" containerID="0a3c160aa7af1cc2ab8ccea99d11fce7f85d13c9cddc512413c4084d8e35b622"
Sep 15 07:17:35.730992 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.730790    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6" event={"ID":"94cb7f48-5fda-4c0a-9c4d-570cd04f26ff","Type":"ContainerDied","Data":"13fb7e3229818eedd5bf30537742073dd80f881e71e88875452c3e222868c976"}
Sep 15 07:17:35.734964 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.734940    2568 generic.go:356] "Generic (PLEG): container finished" podID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerID="b4d598b1e41495abf28ac51606c59d0f76c14ab1d79c5e8e0dfafa1a992ceb79" exitCode=137
Sep 15 07:17:35.734964 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.734961    2568 generic.go:356] "Generic (PLEG): container finished" podID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerID="4c1e6acef6f9e2835152c33a4edf1b4b68227689b566d154950b181fc9e3cbc6" exitCode=137
Sep 15 07:17:35.735136 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.734993    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" event={"ID":"cc6927a3-5e5f-4225-8f28-27220c9b1d29","Type":"ContainerDied","Data":"b4d598b1e41495abf28ac51606c59d0f76c14ab1d79c5e8e0dfafa1a992ceb79"}
Sep 15 07:17:35.735136 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.735046    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" event={"ID":"cc6927a3-5e5f-4225-8f28-27220c9b1d29","Type":"ContainerDied","Data":"4c1e6acef6f9e2835152c33a4edf1b4b68227689b566d154950b181fc9e3cbc6"}
Sep 15 07:17:35.742970 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.742954    2568 scope.go:117] "RemoveContainer" containerID="b785e3d87eba6154afbf454d174e6483b6e6a9ac01e2a335275bbe617b395465"
Sep 15 07:17:35.751172 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.751144    2568 scope.go:117] "RemoveContainer" containerID="9981613b071585f4cbeee6bc43bad0efe154a17ab2f9b76fa44ea80609e05931"
Sep 15 07:17:35.754039 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.754019    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"]
Sep 15 07:17:35.757313 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.757291    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-66fbbbb4cd-qjbm6"]
Sep 15 07:17:35.765879 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.765863    2568 scope.go:117] "RemoveContainer" containerID="5b68bf0ea896cc697c9d893fc251bc4edfc239f2707b9cd6b1dbf8d86edf87d4"
Sep 15 07:17:35.772839 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.772820    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:17:35.773549 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.773536    2568 scope.go:117] "RemoveContainer" containerID="f4b1a77abd2d1dc3717c16f8db3e130557de024ee673f9564e9fdb7c546e2f52"
Sep 15 07:17:35.780638 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.780622    2568 scope.go:117] "RemoveContainer" containerID="0a3c160aa7af1cc2ab8ccea99d11fce7f85d13c9cddc512413c4084d8e35b622"
Sep 15 07:17:35.780927 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:17:35.780909    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a3c160aa7af1cc2ab8ccea99d11fce7f85d13c9cddc512413c4084d8e35b622\": container with ID starting with 0a3c160aa7af1cc2ab8ccea99d11fce7f85d13c9cddc512413c4084d8e35b622 not found: ID does not exist" containerID="0a3c160aa7af1cc2ab8ccea99d11fce7f85d13c9cddc512413c4084d8e35b622"
Sep 15 07:17:35.780980 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.780939    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a3c160aa7af1cc2ab8ccea99d11fce7f85d13c9cddc512413c4084d8e35b622"} err="failed to get container status \"0a3c160aa7af1cc2ab8ccea99d11fce7f85d13c9cddc512413c4084d8e35b622\": rpc error: code = NotFound desc = could not find container \"0a3c160aa7af1cc2ab8ccea99d11fce7f85d13c9cddc512413c4084d8e35b622\": container with ID starting with 0a3c160aa7af1cc2ab8ccea99d11fce7f85d13c9cddc512413c4084d8e35b622 not found: ID does not exist"
Sep 15 07:17:35.780980 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.780957    2568 scope.go:117] "RemoveContainer" containerID="b785e3d87eba6154afbf454d174e6483b6e6a9ac01e2a335275bbe617b395465"
Sep 15 07:17:35.781234 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:17:35.781217    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b785e3d87eba6154afbf454d174e6483b6e6a9ac01e2a335275bbe617b395465\": container with ID starting with b785e3d87eba6154afbf454d174e6483b6e6a9ac01e2a335275bbe617b395465 not found: ID does not exist" containerID="b785e3d87eba6154afbf454d174e6483b6e6a9ac01e2a335275bbe617b395465"
Sep 15 07:17:35.781352 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.781238    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b785e3d87eba6154afbf454d174e6483b6e6a9ac01e2a335275bbe617b395465"} err="failed to get container status \"b785e3d87eba6154afbf454d174e6483b6e6a9ac01e2a335275bbe617b395465\": rpc error: code = NotFound desc = could not find container \"b785e3d87eba6154afbf454d174e6483b6e6a9ac01e2a335275bbe617b395465\": container with ID starting with b785e3d87eba6154afbf454d174e6483b6e6a9ac01e2a335275bbe617b395465 not found: ID does not exist"
Sep 15 07:17:35.781352 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.781253    2568 scope.go:117] "RemoveContainer" containerID="9981613b071585f4cbeee6bc43bad0efe154a17ab2f9b76fa44ea80609e05931"
Sep 15 07:17:35.781484 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:17:35.781468    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9981613b071585f4cbeee6bc43bad0efe154a17ab2f9b76fa44ea80609e05931\": container with ID starting with 9981613b071585f4cbeee6bc43bad0efe154a17ab2f9b76fa44ea80609e05931 not found: ID does not exist" containerID="9981613b071585f4cbeee6bc43bad0efe154a17ab2f9b76fa44ea80609e05931"
Sep 15 07:17:35.781518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.781489    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9981613b071585f4cbeee6bc43bad0efe154a17ab2f9b76fa44ea80609e05931"} err="failed to get container status \"9981613b071585f4cbeee6bc43bad0efe154a17ab2f9b76fa44ea80609e05931\": rpc error: code = NotFound desc = could not find container \"9981613b071585f4cbeee6bc43bad0efe154a17ab2f9b76fa44ea80609e05931\": container with ID starting with 9981613b071585f4cbeee6bc43bad0efe154a17ab2f9b76fa44ea80609e05931 not found: ID does not exist"
Sep 15 07:17:35.781518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.781504    2568 scope.go:117] "RemoveContainer" containerID="5b68bf0ea896cc697c9d893fc251bc4edfc239f2707b9cd6b1dbf8d86edf87d4"
Sep 15 07:17:35.781748 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:17:35.781733    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b68bf0ea896cc697c9d893fc251bc4edfc239f2707b9cd6b1dbf8d86edf87d4\": container with ID starting with 5b68bf0ea896cc697c9d893fc251bc4edfc239f2707b9cd6b1dbf8d86edf87d4 not found: ID does not exist" containerID="5b68bf0ea896cc697c9d893fc251bc4edfc239f2707b9cd6b1dbf8d86edf87d4"
Sep 15 07:17:35.781801 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.781752    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b68bf0ea896cc697c9d893fc251bc4edfc239f2707b9cd6b1dbf8d86edf87d4"} err="failed to get container status \"5b68bf0ea896cc697c9d893fc251bc4edfc239f2707b9cd6b1dbf8d86edf87d4\": rpc error: code = NotFound desc = could not find container \"5b68bf0ea896cc697c9d893fc251bc4edfc239f2707b9cd6b1dbf8d86edf87d4\": container with ID starting with 5b68bf0ea896cc697c9d893fc251bc4edfc239f2707b9cd6b1dbf8d86edf87d4 not found: ID does not exist"
Sep 15 07:17:35.781801 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.781765    2568 scope.go:117] "RemoveContainer" containerID="f4b1a77abd2d1dc3717c16f8db3e130557de024ee673f9564e9fdb7c546e2f52"
Sep 15 07:17:35.782022 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:17:35.782005    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4b1a77abd2d1dc3717c16f8db3e130557de024ee673f9564e9fdb7c546e2f52\": container with ID starting with f4b1a77abd2d1dc3717c16f8db3e130557de024ee673f9564e9fdb7c546e2f52 not found: ID does not exist" containerID="f4b1a77abd2d1dc3717c16f8db3e130557de024ee673f9564e9fdb7c546e2f52"
Sep 15 07:17:35.782073 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.782027    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4b1a77abd2d1dc3717c16f8db3e130557de024ee673f9564e9fdb7c546e2f52"} err="failed to get container status \"f4b1a77abd2d1dc3717c16f8db3e130557de024ee673f9564e9fdb7c546e2f52\": rpc error: code = NotFound desc = could not find container \"f4b1a77abd2d1dc3717c16f8db3e130557de024ee673f9564e9fdb7c546e2f52\": container with ID starting with f4b1a77abd2d1dc3717c16f8db3e130557de024ee673f9564e9fdb7c546e2f52 not found: ID does not exist"
Sep 15 07:17:35.860431 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.860405    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cc6927a3-5e5f-4225-8f28-27220c9b1d29-feast-data\") pod \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") "
Sep 15 07:17:35.860623 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.860456    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmghf\" (UniqueName: \"kubernetes.io/projected/cc6927a3-5e5f-4225-8f28-27220c9b1d29-kube-api-access-tmghf\") pod \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") "
Sep 15 07:17:35.860623 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.860491    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-registry-tls\") pod \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") "
Sep 15 07:17:35.860623 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.860524    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-online-tls\") pod \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") "
Sep 15 07:17:35.860623 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.860547    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-ui-tls\") pod \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") "
Sep 15 07:17:35.860623 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.860575    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-offline-tls\") pod \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\" (UID: \"cc6927a3-5e5f-4225-8f28-27220c9b1d29\") "
Sep 15 07:17:35.861015 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.860987    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc6927a3-5e5f-4225-8f28-27220c9b1d29-feast-data" (OuterVolumeSpecName: "feast-data") pod "cc6927a3-5e5f-4225-8f28-27220c9b1d29" (UID: "cc6927a3-5e5f-4225-8f28-27220c9b1d29"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 07:17:35.862927 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.862903    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "cc6927a3-5e5f-4225-8f28-27220c9b1d29" (UID: "cc6927a3-5e5f-4225-8f28-27220c9b1d29"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:17:35.863206 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.863189    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-online-tls" (OuterVolumeSpecName: "online-tls") pod "cc6927a3-5e5f-4225-8f28-27220c9b1d29" (UID: "cc6927a3-5e5f-4225-8f28-27220c9b1d29"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:17:35.863285 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.863212    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "cc6927a3-5e5f-4225-8f28-27220c9b1d29" (UID: "cc6927a3-5e5f-4225-8f28-27220c9b1d29"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:17:35.863346 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.863317    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cc6927a3-5e5f-4225-8f28-27220c9b1d29" (UID: "cc6927a3-5e5f-4225-8f28-27220c9b1d29"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:17:35.863346 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.863325    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc6927a3-5e5f-4225-8f28-27220c9b1d29-kube-api-access-tmghf" (OuterVolumeSpecName: "kube-api-access-tmghf") pod "cc6927a3-5e5f-4225-8f28-27220c9b1d29" (UID: "cc6927a3-5e5f-4225-8f28-27220c9b1d29"). InnerVolumeSpecName "kube-api-access-tmghf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:17:35.961922 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.961886    2568 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cc6927a3-5e5f-4225-8f28-27220c9b1d29-feast-data\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:17:35.961922 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.961917    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmghf\" (UniqueName: \"kubernetes.io/projected/cc6927a3-5e5f-4225-8f28-27220c9b1d29-kube-api-access-tmghf\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:17:35.962115 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.961931    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-registry-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:17:35.962115 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.961943    2568 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-online-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:17:35.962115 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.961953    2568 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-ui-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:17:35.962115 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:35.961963    2568 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cc6927a3-5e5f-4225-8f28-27220c9b1d29-offline-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:17:36.742025 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:36.741986    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" path="/var/lib/kubelet/pods/94cb7f48-5fda-4c0a-9c4d-570cd04f26ff/volumes"
Sep 15 07:17:36.743350 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:36.743326    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl" event={"ID":"cc6927a3-5e5f-4225-8f28-27220c9b1d29","Type":"ContainerDied","Data":"4a8b7b176d1e0eaa0bf8e83bf44a557d773f19aaaf05578c7cd8ba3461318191"}
Sep 15 07:17:36.743479 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:36.743368    2568 scope.go:117] "RemoveContainer" containerID="fec85a9182d824cc03eda4762df38934ff324aae00311673b9dfe27fea098e1c"
Sep 15 07:17:36.743479 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:36.743370    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"
Sep 15 07:17:36.752729 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:36.752696    2568 scope.go:117] "RemoveContainer" containerID="b4d598b1e41495abf28ac51606c59d0f76c14ab1d79c5e8e0dfafa1a992ceb79"
Sep 15 07:17:36.760566 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:36.760548    2568 scope.go:117] "RemoveContainer" containerID="d333791fc7e56e9c21f51dcdaeb6d146d95362d3337a6c6d1707715b57cea286"
Sep 15 07:17:36.767470 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:36.767444    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"]
Sep 15 07:17:36.769187 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:36.769167    2568 scope.go:117] "RemoveContainer" containerID="4c1e6acef6f9e2835152c33a4edf1b4b68227689b566d154950b181fc9e3cbc6"
Sep 15 07:17:36.770684 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:36.770666    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-77fbccbbbf-sf4wl"]
Sep 15 07:17:36.776560 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:36.776544    2568 scope.go:117] "RemoveContainer" containerID="e67ab8855acb0e60b951945d17118a456ac6379e4c65f1264bad05d9f60f7e48"
Sep 15 07:17:36.783557 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:36.783540    2568 scope.go:117] "RemoveContainer" containerID="77e76c3ac7fee45e8198b3ac466e45505565dce68c5cd30e112b77b97dc25458"
Sep 15 07:17:38.745904 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:38.742364    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" path="/var/lib/kubelet/pods/cc6927a3-5e5f-4225-8f28-27220c9b1d29/volumes"
Sep 15 07:17:47.965795 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.965755    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-mj7bl"]
Sep 15 07:17:47.966261 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966245    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="ui"
Sep 15 07:17:47.966428 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966265    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="ui"
Sep 15 07:17:47.966428 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966283    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="offline"
Sep 15 07:17:47.966428 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966292    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="offline"
Sep 15 07:17:47.966428 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966307    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="feast-apply"
Sep 15 07:17:47.966428 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966316    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="feast-apply"
Sep 15 07:17:47.966428 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966326    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="registry"
Sep 15 07:17:47.966428 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966334    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="registry"
Sep 15 07:17:47.966428 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966344    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="feast-init"
Sep 15 07:17:47.966428 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966353    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="feast-init"
Sep 15 07:17:47.966428 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966366    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="offline"
Sep 15 07:17:47.966428 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966374    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="offline"
Sep 15 07:17:47.966428 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966386    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="feast-apply"
Sep 15 07:17:47.966428 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966394    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="feast-apply"
Sep 15 07:17:47.966428 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966410    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="feast-init"
Sep 15 07:17:47.966428 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966419    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="feast-init"
Sep 15 07:17:47.966428 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966428    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="ui"
Sep 15 07:17:47.966428 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966437    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="ui"
Sep 15 07:17:47.967178 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966449    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="online"
Sep 15 07:17:47.967178 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966457    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="online"
Sep 15 07:17:47.967178 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966468    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="online"
Sep 15 07:17:47.967178 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966477    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="online"
Sep 15 07:17:47.967178 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966552    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="registry"
Sep 15 07:17:47.967178 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966565    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="online"
Sep 15 07:17:47.967178 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966577    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="offline"
Sep 15 07:17:47.967178 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966588    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="online"
Sep 15 07:17:47.967178 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966597    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="ui"
Sep 15 07:17:47.967178 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966606    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="94cb7f48-5fda-4c0a-9c4d-570cd04f26ff" containerName="ui"
Sep 15 07:17:47.967178 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.966615    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc6927a3-5e5f-4225-8f28-27220c9b1d29" containerName="offline"
Sep 15 07:17:47.971459 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.971442    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-mj7bl"
Sep 15 07:17:47.973602 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.973578    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Sep 15 07:17:47.973748 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.973604    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-csx9j\""
Sep 15 07:17:47.973748 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.973580    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 15 07:17:47.974489 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.974466    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 15 07:17:47.977094 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.977073    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-mj7bl"]
Sep 15 07:17:47.998427 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:47.998397    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-5bn56"]
Sep 15 07:17:48.002237 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:48.002215    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-5bn56"
Sep 15 07:17:48.004433 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:48.004410    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-5bn56"]
Sep 15 07:17:48.060385 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:48.060354    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flsrq\" (UniqueName: \"kubernetes.io/projected/5979d84c-b5bb-4cdd-9147-53d02d6d9012-kube-api-access-flsrq\") pod \"postgres-864846d4f5-mj7bl\" (UID: \"5979d84c-b5bb-4cdd-9147-53d02d6d9012\") " pod="test-ns-feast/postgres-864846d4f5-mj7bl"
Sep 15 07:17:48.060550 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:48.060393    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/5979d84c-b5bb-4cdd-9147-53d02d6d9012-postgresdata\") pod \"postgres-864846d4f5-mj7bl\" (UID: \"5979d84c-b5bb-4cdd-9147-53d02d6d9012\") " pod="test-ns-feast/postgres-864846d4f5-mj7bl"
Sep 15 07:17:48.161379 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:48.161347    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv7hj\" (UniqueName: \"kubernetes.io/projected/df1c51d5-d5b5-4037-abbf-29d186656a24-kube-api-access-gv7hj\") pod \"redis-69bbd798b6-5bn56\" (UID: \"df1c51d5-d5b5-4037-abbf-29d186656a24\") " pod="test-ns-feast/redis-69bbd798b6-5bn56"
Sep 15 07:17:48.161533 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:48.161402    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flsrq\" (UniqueName: \"kubernetes.io/projected/5979d84c-b5bb-4cdd-9147-53d02d6d9012-kube-api-access-flsrq\") pod \"postgres-864846d4f5-mj7bl\" (UID: \"5979d84c-b5bb-4cdd-9147-53d02d6d9012\") " pod="test-ns-feast/postgres-864846d4f5-mj7bl"
Sep 15 07:17:48.161533 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:48.161425    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/5979d84c-b5bb-4cdd-9147-53d02d6d9012-postgresdata\") pod \"postgres-864846d4f5-mj7bl\" (UID: \"5979d84c-b5bb-4cdd-9147-53d02d6d9012\") " pod="test-ns-feast/postgres-864846d4f5-mj7bl"
Sep 15 07:17:48.161749 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:48.161706    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/5979d84c-b5bb-4cdd-9147-53d02d6d9012-postgresdata\") pod \"postgres-864846d4f5-mj7bl\" (UID: \"5979d84c-b5bb-4cdd-9147-53d02d6d9012\") " pod="test-ns-feast/postgres-864846d4f5-mj7bl"
Sep 15 07:17:48.169463 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:48.169430    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flsrq\" (UniqueName: \"kubernetes.io/projected/5979d84c-b5bb-4cdd-9147-53d02d6d9012-kube-api-access-flsrq\") pod \"postgres-864846d4f5-mj7bl\" (UID: \"5979d84c-b5bb-4cdd-9147-53d02d6d9012\") " pod="test-ns-feast/postgres-864846d4f5-mj7bl"
Sep 15 07:17:48.262124 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:48.262034    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv7hj\" (UniqueName: \"kubernetes.io/projected/df1c51d5-d5b5-4037-abbf-29d186656a24-kube-api-access-gv7hj\") pod \"redis-69bbd798b6-5bn56\" (UID: \"df1c51d5-d5b5-4037-abbf-29d186656a24\") " pod="test-ns-feast/redis-69bbd798b6-5bn56"
Sep 15 07:17:48.269932 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:48.269901    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv7hj\" (UniqueName: \"kubernetes.io/projected/df1c51d5-d5b5-4037-abbf-29d186656a24-kube-api-access-gv7hj\") pod \"redis-69bbd798b6-5bn56\" (UID: \"df1c51d5-d5b5-4037-abbf-29d186656a24\") " pod="test-ns-feast/redis-69bbd798b6-5bn56"
Sep 15 07:17:48.291481 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:48.291448    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-mj7bl"
Sep 15 07:17:48.311834 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:48.311792    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-5bn56"
Sep 15 07:17:48.563423 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:48.563397    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-mj7bl"]
Sep 15 07:17:48.565300 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:17:48.565275    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5979d84c_b5bb_4cdd_9147_53d02d6d9012.slice/crio-d29a2c822d5bcb18810bee035730e569a0db6c593d72b93e126024dbf934256d WatchSource:0}: Error finding container d29a2c822d5bcb18810bee035730e569a0db6c593d72b93e126024dbf934256d: Status 404 returned error can't find the container with id d29a2c822d5bcb18810bee035730e569a0db6c593d72b93e126024dbf934256d
Sep 15 07:17:48.567209 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:48.567194    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 07:17:48.588601 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:48.588572    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-5bn56"]
Sep 15 07:17:48.590924 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:17:48.590900    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf1c51d5_d5b5_4037_abbf_29d186656a24.slice/crio-b03b4c3ec57b13b885286a67717997386d56e90ef40d4fa267a2c5383737b302 WatchSource:0}: Error finding container b03b4c3ec57b13b885286a67717997386d56e90ef40d4fa267a2c5383737b302: Status 404 returned error can't find the container with id b03b4c3ec57b13b885286a67717997386d56e90ef40d4fa267a2c5383737b302
Sep 15 07:17:48.795006 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:48.794972    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-mj7bl" event={"ID":"5979d84c-b5bb-4cdd-9147-53d02d6d9012","Type":"ContainerStarted","Data":"d29a2c822d5bcb18810bee035730e569a0db6c593d72b93e126024dbf934256d"}
Sep 15 07:17:48.796121 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:48.796094    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-5bn56" event={"ID":"df1c51d5-d5b5-4037-abbf-29d186656a24","Type":"ContainerStarted","Data":"b03b4c3ec57b13b885286a67717997386d56e90ef40d4fa267a2c5383737b302"}
Sep 15 07:17:50.808106 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:50.808063    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-5bn56" event={"ID":"df1c51d5-d5b5-4037-abbf-29d186656a24","Type":"ContainerStarted","Data":"638b0b68273941be947d3f1d6cdc7a485cea142458540971cbb385c92806b134"}
Sep 15 07:17:50.823737 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:50.823592    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-5bn56" podStartSLOduration=2.151598491 podStartE2EDuration="3.823572904s" totalImagesPullingTime="1.671974413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:17:50.821611112 +0000 UTC m=+1010.612528929" watchObservedRunningTime="2026-09-15 07:17:50.823572904 +0000 UTC m=+1010.614490727"
Sep 15 07:17:53.823353 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:53.823313    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-mj7bl" event={"ID":"5979d84c-b5bb-4cdd-9147-53d02d6d9012","Type":"ContainerStarted","Data":"635eb00f06755ea010ac7ab6a226d3300814c85f8f50788083e38cfd8a740833"}
Sep 15 07:17:56.784657 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:56.784598    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-mj7bl" podStartSLOduration=4.773481753 podStartE2EDuration="9.784577435s" totalImagesPullingTime="5.011095682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:17:53.83712709 +0000 UTC m=+1013.628044912" watchObservedRunningTime="2026-09-15 07:17:56.784577435 +0000 UTC m=+1016.575495254"
Sep 15 07:17:56.786908 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:56.786881    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"]
Sep 15 07:17:56.791326 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:56.791307    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:17:56.793881 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:56.793735    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Sep 15 07:17:56.793881 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:56.793756    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Sep 15 07:17:56.793881 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:56.793863    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-tcdm6\""
Sep 15 07:17:56.794154 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:56.794016    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Sep 15 07:17:56.794238 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:56.794219    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Sep 15 07:17:56.801431 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:56.801404    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"]
Sep 15 07:17:56.940104 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:56.940073    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e23968b7-4472-4d80-8f4a-1e27afabe09b-offline-tls\") pod \"feast-credit-scoring-5d868bff95-29zqp\" (UID: \"e23968b7-4472-4d80-8f4a-1e27afabe09b\") " pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:17:56.940104 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:56.940104    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e23968b7-4472-4d80-8f4a-1e27afabe09b-online-tls\") pod \"feast-credit-scoring-5d868bff95-29zqp\" (UID: \"e23968b7-4472-4d80-8f4a-1e27afabe09b\") " pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:17:56.940309 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:56.940182    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e23968b7-4472-4d80-8f4a-1e27afabe09b-feast-data\") pod \"feast-credit-scoring-5d868bff95-29zqp\" (UID: \"e23968b7-4472-4d80-8f4a-1e27afabe09b\") " pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:17:56.940309 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:56.940204    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e23968b7-4472-4d80-8f4a-1e27afabe09b-registry-tls\") pod \"feast-credit-scoring-5d868bff95-29zqp\" (UID: \"e23968b7-4472-4d80-8f4a-1e27afabe09b\") " pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:17:56.940309 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:56.940288    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmfhf\" (UniqueName: \"kubernetes.io/projected/e23968b7-4472-4d80-8f4a-1e27afabe09b-kube-api-access-tmfhf\") pod \"feast-credit-scoring-5d868bff95-29zqp\" (UID: \"e23968b7-4472-4d80-8f4a-1e27afabe09b\") " pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:17:57.040848 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:57.040762    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmfhf\" (UniqueName: \"kubernetes.io/projected/e23968b7-4472-4d80-8f4a-1e27afabe09b-kube-api-access-tmfhf\") pod \"feast-credit-scoring-5d868bff95-29zqp\" (UID: \"e23968b7-4472-4d80-8f4a-1e27afabe09b\") " pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:17:57.041008 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:57.040847    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e23968b7-4472-4d80-8f4a-1e27afabe09b-offline-tls\") pod \"feast-credit-scoring-5d868bff95-29zqp\" (UID: \"e23968b7-4472-4d80-8f4a-1e27afabe09b\") " pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:17:57.041008 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:57.040874    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e23968b7-4472-4d80-8f4a-1e27afabe09b-online-tls\") pod \"feast-credit-scoring-5d868bff95-29zqp\" (UID: \"e23968b7-4472-4d80-8f4a-1e27afabe09b\") " pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:17:57.041008 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:57.040928    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e23968b7-4472-4d80-8f4a-1e27afabe09b-feast-data\") pod \"feast-credit-scoring-5d868bff95-29zqp\" (UID: \"e23968b7-4472-4d80-8f4a-1e27afabe09b\") " pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:17:57.041008 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:57.040960    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e23968b7-4472-4d80-8f4a-1e27afabe09b-registry-tls\") pod \"feast-credit-scoring-5d868bff95-29zqp\" (UID: \"e23968b7-4472-4d80-8f4a-1e27afabe09b\") " pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:17:57.041221 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:17:57.041090    2568 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-registry-tls: secret "feast-credit-scoring-registry-tls" not found
Sep 15 07:17:57.041221 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:17:57.041168    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e23968b7-4472-4d80-8f4a-1e27afabe09b-registry-tls podName:e23968b7-4472-4d80-8f4a-1e27afabe09b nodeName:}" failed. No retries permitted until 2026-09-15 07:17:57.541148868 +0000 UTC m=+1017.332066670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/e23968b7-4472-4d80-8f4a-1e27afabe09b-registry-tls") pod "feast-credit-scoring-5d868bff95-29zqp" (UID: "e23968b7-4472-4d80-8f4a-1e27afabe09b") : secret "feast-credit-scoring-registry-tls" not found
Sep 15 07:17:57.041525 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:57.041503    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e23968b7-4472-4d80-8f4a-1e27afabe09b-feast-data\") pod \"feast-credit-scoring-5d868bff95-29zqp\" (UID: \"e23968b7-4472-4d80-8f4a-1e27afabe09b\") " pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:17:57.043819 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:57.043793    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e23968b7-4472-4d80-8f4a-1e27afabe09b-online-tls\") pod \"feast-credit-scoring-5d868bff95-29zqp\" (UID: \"e23968b7-4472-4d80-8f4a-1e27afabe09b\") " pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:17:57.043938 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:57.043919    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e23968b7-4472-4d80-8f4a-1e27afabe09b-offline-tls\") pod \"feast-credit-scoring-5d868bff95-29zqp\" (UID: \"e23968b7-4472-4d80-8f4a-1e27afabe09b\") " pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:17:57.049115 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:57.049094    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmfhf\" (UniqueName: \"kubernetes.io/projected/e23968b7-4472-4d80-8f4a-1e27afabe09b-kube-api-access-tmfhf\") pod \"feast-credit-scoring-5d868bff95-29zqp\" (UID: \"e23968b7-4472-4d80-8f4a-1e27afabe09b\") " pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:17:57.547191 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:57.547143    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e23968b7-4472-4d80-8f4a-1e27afabe09b-registry-tls\") pod \"feast-credit-scoring-5d868bff95-29zqp\" (UID: \"e23968b7-4472-4d80-8f4a-1e27afabe09b\") " pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:17:57.549638 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:57.549603    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e23968b7-4472-4d80-8f4a-1e27afabe09b-registry-tls\") pod \"feast-credit-scoring-5d868bff95-29zqp\" (UID: \"e23968b7-4472-4d80-8f4a-1e27afabe09b\") " pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:17:57.702692 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:57.702653    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:17:57.978594 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:57.978565    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"]
Sep 15 07:17:57.979639 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:17:57.979614    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode23968b7_4472_4d80_8f4a_1e27afabe09b.slice/crio-252e7e560a64ae0f3305a2d5ab390ecdb000c49466bf9d2e156e1e7c1dbf43d5 WatchSource:0}: Error finding container 252e7e560a64ae0f3305a2d5ab390ecdb000c49466bf9d2e156e1e7c1dbf43d5: Status 404 returned error can't find the container with id 252e7e560a64ae0f3305a2d5ab390ecdb000c49466bf9d2e156e1e7c1dbf43d5
Sep 15 07:17:58.846857 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:58.846809    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" event={"ID":"e23968b7-4472-4d80-8f4a-1e27afabe09b","Type":"ContainerStarted","Data":"f0dd125270fe3dfc998233797d3cc9759c41d8b1a01731cdd94d0dbd913aaec2"}
Sep 15 07:17:58.847028 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:58.846878    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" event={"ID":"e23968b7-4472-4d80-8f4a-1e27afabe09b","Type":"ContainerStarted","Data":"252e7e560a64ae0f3305a2d5ab390ecdb000c49466bf9d2e156e1e7c1dbf43d5"}
Sep 15 07:17:59.852592 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:59.852554    2568 generic.go:356] "Generic (PLEG): container finished" podID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerID="f0dd125270fe3dfc998233797d3cc9759c41d8b1a01731cdd94d0dbd913aaec2" exitCode=0
Sep 15 07:17:59.853046 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:17:59.852641    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" event={"ID":"e23968b7-4472-4d80-8f4a-1e27afabe09b","Type":"ContainerDied","Data":"f0dd125270fe3dfc998233797d3cc9759c41d8b1a01731cdd94d0dbd913aaec2"}
Sep 15 07:18:00.858307 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:00.858263    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" event={"ID":"e23968b7-4472-4d80-8f4a-1e27afabe09b","Type":"ContainerStarted","Data":"ed62224151042555e4c455b928e31f2716afa005b9bbb87d1caacdd3ecf0ac21"}
Sep 15 07:18:06.885829 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:06.885787    2568 generic.go:356] "Generic (PLEG): container finished" podID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerID="ed62224151042555e4c455b928e31f2716afa005b9bbb87d1caacdd3ecf0ac21" exitCode=0
Sep 15 07:18:06.886265 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:06.885871    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" event={"ID":"e23968b7-4472-4d80-8f4a-1e27afabe09b","Type":"ContainerDied","Data":"ed62224151042555e4c455b928e31f2716afa005b9bbb87d1caacdd3ecf0ac21"}
Sep 15 07:18:06.890139 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:06.890111    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Sep 15 07:18:07.895090 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:07.895052    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" event={"ID":"e23968b7-4472-4d80-8f4a-1e27afabe09b","Type":"ContainerStarted","Data":"eb80631665f27ca2d99d057b301cc349e93a014e7e33db7ff5703546695d7375"}
Sep 15 07:18:07.895579 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:07.895107    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" event={"ID":"e23968b7-4472-4d80-8f4a-1e27afabe09b","Type":"ContainerStarted","Data":"73849ee3fdb693395aa4bf5525e68e093561bc81ea48a7688106f00e5059aebe"}
Sep 15 07:18:07.895579 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:07.895123    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" event={"ID":"e23968b7-4472-4d80-8f4a-1e27afabe09b","Type":"ContainerStarted","Data":"09cb39abe9f6c712d90e8d86a292da6ba4ce2f4f13abd24f63c2fc5d4338f705"}
Sep 15 07:18:07.924737 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:07.919499    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" podStartSLOduration=11.919473028 podStartE2EDuration="11.919473028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:17:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:18:07.915123659 +0000 UTC m=+1027.706041480" watchObservedRunningTime="2026-09-15 07:18:07.919473028 +0000 UTC m=+1027.710390841"
Sep 15 07:18:09.703374 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:09.703333    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:18:09.704011 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:09.703985    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:18:09.704145 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:09.704029    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:18:09.705218 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:09.705187    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.34:8816: connect: connection refused"
Sep 15 07:18:09.705314 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:09.705206    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Sep 15 07:18:09.705314 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:09.705250    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Sep 15 07:18:12.703077 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:12.702971    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Sep 15 07:18:12.703077 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:12.702967    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Sep 15 07:18:12.703077 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:12.702972    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.34:8816: connect: connection refused"
Sep 15 07:18:15.703635 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:15.703573    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Sep 15 07:18:15.704608 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:15.704578    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:18:15.705161 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:15.705137    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:18:15.705537 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:15.705518    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:18:15.709752 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:15.709705    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:18:15.939861 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:15.939823    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:18:15.943205 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:15.943177    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:18:17.703004 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:17.702964    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:18:18.703235 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:18.703195    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Sep 15 07:18:21.703625 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:21.703595    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:18:21.704513 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:18:21.704491    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:19:27.310017 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:27.309980    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"]
Sep 15 07:19:27.310562 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:27.310337    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="registry" containerID="cri-o://09cb39abe9f6c712d90e8d86a292da6ba4ce2f4f13abd24f63c2fc5d4338f705" gracePeriod=30
Sep 15 07:19:27.310562 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:27.310356    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="online" containerID="cri-o://73849ee3fdb693395aa4bf5525e68e093561bc81ea48a7688106f00e5059aebe" gracePeriod=30
Sep 15 07:19:27.310562 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:27.310401    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="offline" containerID="cri-o://eb80631665f27ca2d99d057b301cc349e93a014e7e33db7ff5703546695d7375" gracePeriod=30
Sep 15 07:19:27.326817 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:27.326793    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-mj7bl"]
Sep 15 07:19:27.326951 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:27.326935    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-mj7bl" podUID="5979d84c-b5bb-4cdd-9147-53d02d6d9012" containerName="postgres" containerID="cri-o://635eb00f06755ea010ac7ab6a226d3300814c85f8f50788083e38cfd8a740833" gracePeriod=30
Sep 15 07:19:27.336086 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:27.336057    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-5bn56"]
Sep 15 07:19:27.336251 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:27.336217    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-5bn56" podUID="df1c51d5-d5b5-4037-abbf-29d186656a24" containerName="redis" containerID="cri-o://638b0b68273941be947d3f1d6cdc7a485cea142458540971cbb385c92806b134" gracePeriod=30
Sep 15 07:19:27.589445 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:27.589418    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-mj7bl"
Sep 15 07:19:27.618417 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:27.618388    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-5bn56"
Sep 15 07:19:27.706858 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:27.706823    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flsrq\" (UniqueName: \"kubernetes.io/projected/5979d84c-b5bb-4cdd-9147-53d02d6d9012-kube-api-access-flsrq\") pod \"5979d84c-b5bb-4cdd-9147-53d02d6d9012\" (UID: \"5979d84c-b5bb-4cdd-9147-53d02d6d9012\") "
Sep 15 07:19:27.707020 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:27.706889    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/5979d84c-b5bb-4cdd-9147-53d02d6d9012-postgresdata\") pod \"5979d84c-b5bb-4cdd-9147-53d02d6d9012\" (UID: \"5979d84c-b5bb-4cdd-9147-53d02d6d9012\") "
Sep 15 07:19:27.707020 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:27.706962    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gv7hj\" (UniqueName: \"kubernetes.io/projected/df1c51d5-d5b5-4037-abbf-29d186656a24-kube-api-access-gv7hj\") pod \"df1c51d5-d5b5-4037-abbf-29d186656a24\" (UID: \"df1c51d5-d5b5-4037-abbf-29d186656a24\") "
Sep 15 07:19:27.709011 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:27.708975    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5979d84c-b5bb-4cdd-9147-53d02d6d9012-kube-api-access-flsrq" (OuterVolumeSpecName: "kube-api-access-flsrq") pod "5979d84c-b5bb-4cdd-9147-53d02d6d9012" (UID: "5979d84c-b5bb-4cdd-9147-53d02d6d9012"). InnerVolumeSpecName "kube-api-access-flsrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:19:27.709134 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:27.709065    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df1c51d5-d5b5-4037-abbf-29d186656a24-kube-api-access-gv7hj" (OuterVolumeSpecName: "kube-api-access-gv7hj") pod "df1c51d5-d5b5-4037-abbf-29d186656a24" (UID: "df1c51d5-d5b5-4037-abbf-29d186656a24"). InnerVolumeSpecName "kube-api-access-gv7hj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:19:27.736231 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:27.736182    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5979d84c-b5bb-4cdd-9147-53d02d6d9012-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "5979d84c-b5bb-4cdd-9147-53d02d6d9012" (UID: "5979d84c-b5bb-4cdd-9147-53d02d6d9012"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 07:19:27.807592 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:27.807558    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gv7hj\" (UniqueName: \"kubernetes.io/projected/df1c51d5-d5b5-4037-abbf-29d186656a24-kube-api-access-gv7hj\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:19:27.807592 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:27.807589    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flsrq\" (UniqueName: \"kubernetes.io/projected/5979d84c-b5bb-4cdd-9147-53d02d6d9012-kube-api-access-flsrq\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:19:27.807592 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:27.807601    2568 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/5979d84c-b5bb-4cdd-9147-53d02d6d9012-postgresdata\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:19:28.266730 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.266686    2568 generic.go:356] "Generic (PLEG): container finished" podID="df1c51d5-d5b5-4037-abbf-29d186656a24" containerID="638b0b68273941be947d3f1d6cdc7a485cea142458540971cbb385c92806b134" exitCode=0
Sep 15 07:19:28.266947 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.266745    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-5bn56"
Sep 15 07:19:28.266947 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.266776    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-5bn56" event={"ID":"df1c51d5-d5b5-4037-abbf-29d186656a24","Type":"ContainerDied","Data":"638b0b68273941be947d3f1d6cdc7a485cea142458540971cbb385c92806b134"}
Sep 15 07:19:28.266947 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.266816    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-5bn56" event={"ID":"df1c51d5-d5b5-4037-abbf-29d186656a24","Type":"ContainerDied","Data":"b03b4c3ec57b13b885286a67717997386d56e90ef40d4fa267a2c5383737b302"}
Sep 15 07:19:28.266947 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.266837    2568 scope.go:117] "RemoveContainer" containerID="638b0b68273941be947d3f1d6cdc7a485cea142458540971cbb385c92806b134"
Sep 15 07:19:28.269854 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.269834    2568 generic.go:356] "Generic (PLEG): container finished" podID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerID="73849ee3fdb693395aa4bf5525e68e093561bc81ea48a7688106f00e5059aebe" exitCode=0
Sep 15 07:19:28.269972 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.269904    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" event={"ID":"e23968b7-4472-4d80-8f4a-1e27afabe09b","Type":"ContainerDied","Data":"73849ee3fdb693395aa4bf5525e68e093561bc81ea48a7688106f00e5059aebe"}
Sep 15 07:19:28.271271 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.271253    2568 generic.go:356] "Generic (PLEG): container finished" podID="5979d84c-b5bb-4cdd-9147-53d02d6d9012" containerID="635eb00f06755ea010ac7ab6a226d3300814c85f8f50788083e38cfd8a740833" exitCode=0
Sep 15 07:19:28.271379 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.271287    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-mj7bl"
Sep 15 07:19:28.271379 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.271333    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-mj7bl" event={"ID":"5979d84c-b5bb-4cdd-9147-53d02d6d9012","Type":"ContainerDied","Data":"635eb00f06755ea010ac7ab6a226d3300814c85f8f50788083e38cfd8a740833"}
Sep 15 07:19:28.271379 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.271353    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-mj7bl" event={"ID":"5979d84c-b5bb-4cdd-9147-53d02d6d9012","Type":"ContainerDied","Data":"d29a2c822d5bcb18810bee035730e569a0db6c593d72b93e126024dbf934256d"}
Sep 15 07:19:28.278290 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.278274    2568 scope.go:117] "RemoveContainer" containerID="638b0b68273941be947d3f1d6cdc7a485cea142458540971cbb385c92806b134"
Sep 15 07:19:28.278553 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:19:28.278534    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"638b0b68273941be947d3f1d6cdc7a485cea142458540971cbb385c92806b134\": container with ID starting with 638b0b68273941be947d3f1d6cdc7a485cea142458540971cbb385c92806b134 not found: ID does not exist" containerID="638b0b68273941be947d3f1d6cdc7a485cea142458540971cbb385c92806b134"
Sep 15 07:19:28.278600 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.278562    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"638b0b68273941be947d3f1d6cdc7a485cea142458540971cbb385c92806b134"} err="failed to get container status \"638b0b68273941be947d3f1d6cdc7a485cea142458540971cbb385c92806b134\": rpc error: code = NotFound desc = could not find container \"638b0b68273941be947d3f1d6cdc7a485cea142458540971cbb385c92806b134\": container with ID starting with 638b0b68273941be947d3f1d6cdc7a485cea142458540971cbb385c92806b134 not found: ID does not exist"
Sep 15 07:19:28.278600 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.278578    2568 scope.go:117] "RemoveContainer" containerID="635eb00f06755ea010ac7ab6a226d3300814c85f8f50788083e38cfd8a740833"
Sep 15 07:19:28.285798 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.285752    2568 scope.go:117] "RemoveContainer" containerID="635eb00f06755ea010ac7ab6a226d3300814c85f8f50788083e38cfd8a740833"
Sep 15 07:19:28.286024 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:19:28.286008    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"635eb00f06755ea010ac7ab6a226d3300814c85f8f50788083e38cfd8a740833\": container with ID starting with 635eb00f06755ea010ac7ab6a226d3300814c85f8f50788083e38cfd8a740833 not found: ID does not exist" containerID="635eb00f06755ea010ac7ab6a226d3300814c85f8f50788083e38cfd8a740833"
Sep 15 07:19:28.286066 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.286030    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"635eb00f06755ea010ac7ab6a226d3300814c85f8f50788083e38cfd8a740833"} err="failed to get container status \"635eb00f06755ea010ac7ab6a226d3300814c85f8f50788083e38cfd8a740833\": rpc error: code = NotFound desc = could not find container \"635eb00f06755ea010ac7ab6a226d3300814c85f8f50788083e38cfd8a740833\": container with ID starting with 635eb00f06755ea010ac7ab6a226d3300814c85f8f50788083e38cfd8a740833 not found: ID does not exist"
Sep 15 07:19:28.289175 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.289156    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-5bn56"]
Sep 15 07:19:28.293423 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.293404    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-5bn56"]
Sep 15 07:19:28.303575 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.303549    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-mj7bl"]
Sep 15 07:19:28.309593 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.309572    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-mj7bl"]
Sep 15 07:19:28.742527 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.742496    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5979d84c-b5bb-4cdd-9147-53d02d6d9012" path="/var/lib/kubelet/pods/5979d84c-b5bb-4cdd-9147-53d02d6d9012/volumes"
Sep 15 07:19:28.742915 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:28.742831    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df1c51d5-d5b5-4037-abbf-29d186656a24" path="/var/lib/kubelet/pods/df1c51d5-d5b5-4037-abbf-29d186656a24/volumes"
Sep 15 07:19:35.940501 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:35.940457    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Sep 15 07:19:45.940448 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:45.940402    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Sep 15 07:19:55.940795 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:55.940748    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Sep 15 07:19:55.941316 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:55.940944    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:19:57.396559 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:57.396533    2568 generic.go:356] "Generic (PLEG): container finished" podID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerID="eb80631665f27ca2d99d057b301cc349e93a014e7e33db7ff5703546695d7375" exitCode=137
Sep 15 07:19:57.396559 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:57.396558    2568 generic.go:356] "Generic (PLEG): container finished" podID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerID="09cb39abe9f6c712d90e8d86a292da6ba4ce2f4f13abd24f63c2fc5d4338f705" exitCode=137
Sep 15 07:19:57.396972 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:57.396609    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" event={"ID":"e23968b7-4472-4d80-8f4a-1e27afabe09b","Type":"ContainerDied","Data":"eb80631665f27ca2d99d057b301cc349e93a014e7e33db7ff5703546695d7375"}
Sep 15 07:19:57.396972 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:57.396667    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" event={"ID":"e23968b7-4472-4d80-8f4a-1e27afabe09b","Type":"ContainerDied","Data":"09cb39abe9f6c712d90e8d86a292da6ba4ce2f4f13abd24f63c2fc5d4338f705"}
Sep 15 07:19:57.959171 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:57.959145    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:19:57.960142 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:57.960124    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e23968b7-4472-4d80-8f4a-1e27afabe09b-offline-tls\") pod \"e23968b7-4472-4d80-8f4a-1e27afabe09b\" (UID: \"e23968b7-4472-4d80-8f4a-1e27afabe09b\") "
Sep 15 07:19:57.960250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:57.960163    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e23968b7-4472-4d80-8f4a-1e27afabe09b-feast-data\") pod \"e23968b7-4472-4d80-8f4a-1e27afabe09b\" (UID: \"e23968b7-4472-4d80-8f4a-1e27afabe09b\") "
Sep 15 07:19:57.960250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:57.960200    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e23968b7-4472-4d80-8f4a-1e27afabe09b-registry-tls\") pod \"e23968b7-4472-4d80-8f4a-1e27afabe09b\" (UID: \"e23968b7-4472-4d80-8f4a-1e27afabe09b\") "
Sep 15 07:19:57.960250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:57.960227    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmfhf\" (UniqueName: \"kubernetes.io/projected/e23968b7-4472-4d80-8f4a-1e27afabe09b-kube-api-access-tmfhf\") pod \"e23968b7-4472-4d80-8f4a-1e27afabe09b\" (UID: \"e23968b7-4472-4d80-8f4a-1e27afabe09b\") "
Sep 15 07:19:57.960393 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:57.960252    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e23968b7-4472-4d80-8f4a-1e27afabe09b-online-tls\") pod \"e23968b7-4472-4d80-8f4a-1e27afabe09b\" (UID: \"e23968b7-4472-4d80-8f4a-1e27afabe09b\") "
Sep 15 07:19:57.962213 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:57.962189    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e23968b7-4472-4d80-8f4a-1e27afabe09b-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "e23968b7-4472-4d80-8f4a-1e27afabe09b" (UID: "e23968b7-4472-4d80-8f4a-1e27afabe09b"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:19:57.962350 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:57.962311    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e23968b7-4472-4d80-8f4a-1e27afabe09b-kube-api-access-tmfhf" (OuterVolumeSpecName: "kube-api-access-tmfhf") pod "e23968b7-4472-4d80-8f4a-1e27afabe09b" (UID: "e23968b7-4472-4d80-8f4a-1e27afabe09b"). InnerVolumeSpecName "kube-api-access-tmfhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:19:57.962420 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:57.962370    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e23968b7-4472-4d80-8f4a-1e27afabe09b-online-tls" (OuterVolumeSpecName: "online-tls") pod "e23968b7-4472-4d80-8f4a-1e27afabe09b" (UID: "e23968b7-4472-4d80-8f4a-1e27afabe09b"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:19:57.962588 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:57.962572    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e23968b7-4472-4d80-8f4a-1e27afabe09b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e23968b7-4472-4d80-8f4a-1e27afabe09b" (UID: "e23968b7-4472-4d80-8f4a-1e27afabe09b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:19:57.968690 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:57.968662    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e23968b7-4472-4d80-8f4a-1e27afabe09b-feast-data" (OuterVolumeSpecName: "feast-data") pod "e23968b7-4472-4d80-8f4a-1e27afabe09b" (UID: "e23968b7-4472-4d80-8f4a-1e27afabe09b"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 07:19:58.060957 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:58.060926    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e23968b7-4472-4d80-8f4a-1e27afabe09b-registry-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:19:58.060957 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:58.060953    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmfhf\" (UniqueName: \"kubernetes.io/projected/e23968b7-4472-4d80-8f4a-1e27afabe09b-kube-api-access-tmfhf\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:19:58.060957 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:58.060964    2568 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e23968b7-4472-4d80-8f4a-1e27afabe09b-online-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:19:58.061163 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:58.060973    2568 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e23968b7-4472-4d80-8f4a-1e27afabe09b-offline-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:19:58.061163 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:58.060982    2568 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e23968b7-4472-4d80-8f4a-1e27afabe09b-feast-data\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:19:58.403914 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:58.403881    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp" event={"ID":"e23968b7-4472-4d80-8f4a-1e27afabe09b","Type":"ContainerDied","Data":"252e7e560a64ae0f3305a2d5ab390ecdb000c49466bf9d2e156e1e7c1dbf43d5"}
Sep 15 07:19:58.404302 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:58.403932    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"
Sep 15 07:19:58.404302 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:58.403946    2568 scope.go:117] "RemoveContainer" containerID="eb80631665f27ca2d99d057b301cc349e93a014e7e33db7ff5703546695d7375"
Sep 15 07:19:58.413058 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:58.413037    2568 scope.go:117] "RemoveContainer" containerID="73849ee3fdb693395aa4bf5525e68e093561bc81ea48a7688106f00e5059aebe"
Sep 15 07:19:58.423262 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:58.423239    2568 scope.go:117] "RemoveContainer" containerID="09cb39abe9f6c712d90e8d86a292da6ba4ce2f4f13abd24f63c2fc5d4338f705"
Sep 15 07:19:58.427136 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:58.427104    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"]
Sep 15 07:19:58.430882 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:58.430858    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-5d868bff95-29zqp"]
Sep 15 07:19:58.432147 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:58.432127    2568 scope.go:117] "RemoveContainer" containerID="ed62224151042555e4c455b928e31f2716afa005b9bbb87d1caacdd3ecf0ac21"
Sep 15 07:19:58.439518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:58.439502    2568 scope.go:117] "RemoveContainer" containerID="f0dd125270fe3dfc998233797d3cc9759c41d8b1a01731cdd94d0dbd913aaec2"
Sep 15 07:19:58.741406 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:19:58.741377    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" path="/var/lib/kubelet/pods/e23968b7-4472-4d80-8f4a-1e27afabe09b/volumes"
Sep 15 07:22:33.012874 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.012786    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-frhpv"]
Sep 15 07:22:33.015250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.013304    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="feast-init"
Sep 15 07:22:33.015250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.013324    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="feast-init"
Sep 15 07:22:33.015250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.013352    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="online"
Sep 15 07:22:33.015250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.013362    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="online"
Sep 15 07:22:33.015250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.013382    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="registry"
Sep 15 07:22:33.015250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.013391    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="registry"
Sep 15 07:22:33.015250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.013401    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="offline"
Sep 15 07:22:33.015250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.013409    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="offline"
Sep 15 07:22:33.015250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.013430    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5979d84c-b5bb-4cdd-9147-53d02d6d9012" containerName="postgres"
Sep 15 07:22:33.015250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.013438    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5979d84c-b5bb-4cdd-9147-53d02d6d9012" containerName="postgres"
Sep 15 07:22:33.015250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.013449    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="feast-apply"
Sep 15 07:22:33.015250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.013458    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="feast-apply"
Sep 15 07:22:33.015250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.013473    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df1c51d5-d5b5-4037-abbf-29d186656a24" containerName="redis"
Sep 15 07:22:33.015250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.013481    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="df1c51d5-d5b5-4037-abbf-29d186656a24" containerName="redis"
Sep 15 07:22:33.015250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.013567    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="offline"
Sep 15 07:22:33.015250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.013580    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="registry"
Sep 15 07:22:33.015250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.013589    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="df1c51d5-d5b5-4037-abbf-29d186656a24" containerName="redis"
Sep 15 07:22:33.015250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.013597    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e23968b7-4472-4d80-8f4a-1e27afabe09b" containerName="online"
Sep 15 07:22:33.015250 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.013606    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5979d84c-b5bb-4cdd-9147-53d02d6d9012" containerName="postgres"
Sep 15 07:22:33.016558 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.016534    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-frhpv"
Sep 15 07:22:33.019041 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.019018    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Sep 15 07:22:33.019041 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.019025    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-4ghjq\""
Sep 15 07:22:33.019747 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.019725    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Sep 15 07:22:33.030810 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.030787    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-frhpv"]
Sep 15 07:22:33.073289 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.073254    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpxg5\" (UniqueName: \"kubernetes.io/projected/2d395a65-6b29-48b2-a11a-6ba2830d5a8a-kube-api-access-bpxg5\") pod \"redis-69bbd798b6-frhpv\" (UID: \"2d395a65-6b29-48b2-a11a-6ba2830d5a8a\") " pod="test-ns-feast-rest/redis-69bbd798b6-frhpv"
Sep 15 07:22:33.174267 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.174227    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpxg5\" (UniqueName: \"kubernetes.io/projected/2d395a65-6b29-48b2-a11a-6ba2830d5a8a-kube-api-access-bpxg5\") pod \"redis-69bbd798b6-frhpv\" (UID: \"2d395a65-6b29-48b2-a11a-6ba2830d5a8a\") " pod="test-ns-feast-rest/redis-69bbd798b6-frhpv"
Sep 15 07:22:33.182443 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.182407    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpxg5\" (UniqueName: \"kubernetes.io/projected/2d395a65-6b29-48b2-a11a-6ba2830d5a8a-kube-api-access-bpxg5\") pod \"redis-69bbd798b6-frhpv\" (UID: \"2d395a65-6b29-48b2-a11a-6ba2830d5a8a\") " pod="test-ns-feast-rest/redis-69bbd798b6-frhpv"
Sep 15 07:22:33.335226 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.335134    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-frhpv"
Sep 15 07:22:33.605069 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:33.604991    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-frhpv"]
Sep 15 07:22:33.608051 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:22:33.608015    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d395a65_6b29_48b2_a11a_6ba2830d5a8a.slice/crio-93bf8f4b5cf929320f40127589946fd60b884d8021acfdde7462a527aa1f544e WatchSource:0}: Error finding container 93bf8f4b5cf929320f40127589946fd60b884d8021acfdde7462a527aa1f544e: Status 404 returned error can't find the container with id 93bf8f4b5cf929320f40127589946fd60b884d8021acfdde7462a527aa1f544e
Sep 15 07:22:34.026039 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:34.025998    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-frhpv" event={"ID":"2d395a65-6b29-48b2-a11a-6ba2830d5a8a","Type":"ContainerStarted","Data":"1794febab3aaadd30a4582647bb4324cc592135733854ab3120f40eeef1946b4"}
Sep 15 07:22:34.026039 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:34.026040    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-frhpv" event={"ID":"2d395a65-6b29-48b2-a11a-6ba2830d5a8a","Type":"ContainerStarted","Data":"93bf8f4b5cf929320f40127589946fd60b884d8021acfdde7462a527aa1f544e"}
Sep 15 07:22:34.039555 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:34.039503    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-frhpv" podStartSLOduration=2.039485936 podStartE2EDuration="2.039485936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:22:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:22:34.038851627 +0000 UTC m=+1293.829769448" watchObservedRunningTime="2026-09-15 07:22:34.039485936 +0000 UTC m=+1293.830403757"
Sep 15 07:22:38.456926 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:38.456893    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-9rr4c"]
Sep 15 07:22:38.460214 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:38.460193    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-9rr4c"
Sep 15 07:22:38.462457 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:38.462443    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Sep 15 07:22:38.469972 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:38.469943    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-9rr4c"]
Sep 15 07:22:38.517527 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:38.517500    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgkmv\" (UniqueName: \"kubernetes.io/projected/e048b2be-ced7-420d-8247-7c79bea7c409-kube-api-access-kgkmv\") pod \"postgres-864846d4f5-9rr4c\" (UID: \"e048b2be-ced7-420d-8247-7c79bea7c409\") " pod="test-ns-feast-rest/postgres-864846d4f5-9rr4c"
Sep 15 07:22:38.517644 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:38.517531    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/e048b2be-ced7-420d-8247-7c79bea7c409-postgresdata\") pod \"postgres-864846d4f5-9rr4c\" (UID: \"e048b2be-ced7-420d-8247-7c79bea7c409\") " pod="test-ns-feast-rest/postgres-864846d4f5-9rr4c"
Sep 15 07:22:38.618547 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:38.618517    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgkmv\" (UniqueName: \"kubernetes.io/projected/e048b2be-ced7-420d-8247-7c79bea7c409-kube-api-access-kgkmv\") pod \"postgres-864846d4f5-9rr4c\" (UID: \"e048b2be-ced7-420d-8247-7c79bea7c409\") " pod="test-ns-feast-rest/postgres-864846d4f5-9rr4c"
Sep 15 07:22:38.618547 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:38.618548    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/e048b2be-ced7-420d-8247-7c79bea7c409-postgresdata\") pod \"postgres-864846d4f5-9rr4c\" (UID: \"e048b2be-ced7-420d-8247-7c79bea7c409\") " pod="test-ns-feast-rest/postgres-864846d4f5-9rr4c"
Sep 15 07:22:38.618892 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:38.618876    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/e048b2be-ced7-420d-8247-7c79bea7c409-postgresdata\") pod \"postgres-864846d4f5-9rr4c\" (UID: \"e048b2be-ced7-420d-8247-7c79bea7c409\") " pod="test-ns-feast-rest/postgres-864846d4f5-9rr4c"
Sep 15 07:22:38.626296 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:38.626263    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgkmv\" (UniqueName: \"kubernetes.io/projected/e048b2be-ced7-420d-8247-7c79bea7c409-kube-api-access-kgkmv\") pod \"postgres-864846d4f5-9rr4c\" (UID: \"e048b2be-ced7-420d-8247-7c79bea7c409\") " pod="test-ns-feast-rest/postgres-864846d4f5-9rr4c"
Sep 15 07:22:38.770665 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:38.770587    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-9rr4c"
Sep 15 07:22:39.035287 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:39.035261    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-9rr4c"]
Sep 15 07:22:39.037443 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:22:39.037418    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode048b2be_ced7_420d_8247_7c79bea7c409.slice/crio-6e31860f7053c4cab1c642bfa81e4867713b583783f7684382f1918765f8f35a WatchSource:0}: Error finding container 6e31860f7053c4cab1c642bfa81e4867713b583783f7684382f1918765f8f35a: Status 404 returned error can't find the container with id 6e31860f7053c4cab1c642bfa81e4867713b583783f7684382f1918765f8f35a
Sep 15 07:22:39.047348 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:39.047323    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-9rr4c" event={"ID":"e048b2be-ced7-420d-8247-7c79bea7c409","Type":"ContainerStarted","Data":"6e31860f7053c4cab1c642bfa81e4867713b583783f7684382f1918765f8f35a"}
Sep 15 07:22:40.053256 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:40.053214    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-9rr4c" event={"ID":"e048b2be-ced7-420d-8247-7c79bea7c409","Type":"ContainerStarted","Data":"6705da06414b0588fdb2a1e7422c64d711427db753020ed2a0a3e63f18453507"}
Sep 15 07:22:40.079161 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:40.079112    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-9rr4c" podStartSLOduration=2.079093898 podStartE2EDuration="2.079093898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:22:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:22:40.077774178 +0000 UTC m=+1299.868692000" watchObservedRunningTime="2026-09-15 07:22:40.079093898 +0000 UTC m=+1299.870011720"
Sep 15 07:22:44.063520 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:44.063481    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"]
Sep 15 07:22:44.067852 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:44.067830    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:22:44.070133 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:44.070114    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Sep 15 07:22:44.070245 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:44.070128    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Sep 15 07:22:44.070245 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:44.070153    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-plqmr\""
Sep 15 07:22:44.070555 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:44.070538    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Sep 15 07:22:44.077353 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:44.077332    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"]
Sep 15 07:22:44.164097 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:44.164054    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2df2c386-c643-4b8b-b30c-d5baeb271f0d-registry-tls\") pod \"feast-credit-scoring-69946b4bc7-6pj9q\" (UID: \"2df2c386-c643-4b8b-b30c-d5baeb271f0d\") " pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:22:44.164097 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:44.164103    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-545bz\" (UniqueName: \"kubernetes.io/projected/2df2c386-c643-4b8b-b30c-d5baeb271f0d-kube-api-access-545bz\") pod \"feast-credit-scoring-69946b4bc7-6pj9q\" (UID: \"2df2c386-c643-4b8b-b30c-d5baeb271f0d\") " pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:22:44.164308 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:44.164167    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2df2c386-c643-4b8b-b30c-d5baeb271f0d-online-tls\") pod \"feast-credit-scoring-69946b4bc7-6pj9q\" (UID: \"2df2c386-c643-4b8b-b30c-d5baeb271f0d\") " pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:22:44.164308 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:44.164218    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2df2c386-c643-4b8b-b30c-d5baeb271f0d-feast-data\") pod \"feast-credit-scoring-69946b4bc7-6pj9q\" (UID: \"2df2c386-c643-4b8b-b30c-d5baeb271f0d\") " pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:22:44.264617 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:44.264575    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2df2c386-c643-4b8b-b30c-d5baeb271f0d-registry-tls\") pod \"feast-credit-scoring-69946b4bc7-6pj9q\" (UID: \"2df2c386-c643-4b8b-b30c-d5baeb271f0d\") " pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:22:44.264617 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:44.264614    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-545bz\" (UniqueName: \"kubernetes.io/projected/2df2c386-c643-4b8b-b30c-d5baeb271f0d-kube-api-access-545bz\") pod \"feast-credit-scoring-69946b4bc7-6pj9q\" (UID: \"2df2c386-c643-4b8b-b30c-d5baeb271f0d\") " pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:22:44.264926 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:44.264635    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2df2c386-c643-4b8b-b30c-d5baeb271f0d-online-tls\") pod \"feast-credit-scoring-69946b4bc7-6pj9q\" (UID: \"2df2c386-c643-4b8b-b30c-d5baeb271f0d\") " pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:22:44.264926 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:44.264666    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2df2c386-c643-4b8b-b30c-d5baeb271f0d-feast-data\") pod \"feast-credit-scoring-69946b4bc7-6pj9q\" (UID: \"2df2c386-c643-4b8b-b30c-d5baeb271f0d\") " pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:22:44.264926 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:22:44.264812    2568 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
Sep 15 07:22:44.264926 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:22:44.264883    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2df2c386-c643-4b8b-b30c-d5baeb271f0d-online-tls podName:2df2c386-c643-4b8b-b30c-d5baeb271f0d nodeName:}" failed. No retries permitted until 2026-09-15 07:22:44.764862931 +0000 UTC m=+1304.555780738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/2df2c386-c643-4b8b-b30c-d5baeb271f0d-online-tls") pod "feast-credit-scoring-69946b4bc7-6pj9q" (UID: "2df2c386-c643-4b8b-b30c-d5baeb271f0d") : secret "feast-credit-scoring-online-tls" not found
Sep 15 07:22:44.265161 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:44.265150    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2df2c386-c643-4b8b-b30c-d5baeb271f0d-feast-data\") pod \"feast-credit-scoring-69946b4bc7-6pj9q\" (UID: \"2df2c386-c643-4b8b-b30c-d5baeb271f0d\") " pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:22:44.267301 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:44.267275    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2df2c386-c643-4b8b-b30c-d5baeb271f0d-registry-tls\") pod \"feast-credit-scoring-69946b4bc7-6pj9q\" (UID: \"2df2c386-c643-4b8b-b30c-d5baeb271f0d\") " pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:22:44.272525 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:44.272504    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-545bz\" (UniqueName: \"kubernetes.io/projected/2df2c386-c643-4b8b-b30c-d5baeb271f0d-kube-api-access-545bz\") pod \"feast-credit-scoring-69946b4bc7-6pj9q\" (UID: \"2df2c386-c643-4b8b-b30c-d5baeb271f0d\") " pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:22:44.769649 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:44.769621    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2df2c386-c643-4b8b-b30c-d5baeb271f0d-online-tls\") pod \"feast-credit-scoring-69946b4bc7-6pj9q\" (UID: \"2df2c386-c643-4b8b-b30c-d5baeb271f0d\") " pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:22:44.772004 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:44.771981    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2df2c386-c643-4b8b-b30c-d5baeb271f0d-online-tls\") pod \"feast-credit-scoring-69946b4bc7-6pj9q\" (UID: \"2df2c386-c643-4b8b-b30c-d5baeb271f0d\") " pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:22:44.978810 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:44.978775    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:22:45.254023 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:45.253991    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"]
Sep 15 07:22:45.256011 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:22:45.255985    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df2c386_c643_4b8b_b30c_d5baeb271f0d.slice/crio-9f4bd474cacbec44f1109318bd97563ac84bf8ffe6e7e9f0a5d44378386f7f89 WatchSource:0}: Error finding container 9f4bd474cacbec44f1109318bd97563ac84bf8ffe6e7e9f0a5d44378386f7f89: Status 404 returned error can't find the container with id 9f4bd474cacbec44f1109318bd97563ac84bf8ffe6e7e9f0a5d44378386f7f89
Sep 15 07:22:46.079340 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:46.079300    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" event={"ID":"2df2c386-c643-4b8b-b30c-d5baeb271f0d","Type":"ContainerStarted","Data":"0c93276898d363ea04b43045fe4c86f582b41e5343f21bc639535d151edbc493"}
Sep 15 07:22:46.079550 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:46.079362    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" event={"ID":"2df2c386-c643-4b8b-b30c-d5baeb271f0d","Type":"ContainerStarted","Data":"9f4bd474cacbec44f1109318bd97563ac84bf8ffe6e7e9f0a5d44378386f7f89"}
Sep 15 07:22:47.084886 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:47.084848    2568 generic.go:356] "Generic (PLEG): container finished" podID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerID="0c93276898d363ea04b43045fe4c86f582b41e5343f21bc639535d151edbc493" exitCode=0
Sep 15 07:22:47.085319 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:47.084925    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" event={"ID":"2df2c386-c643-4b8b-b30c-d5baeb271f0d","Type":"ContainerDied","Data":"0c93276898d363ea04b43045fe4c86f582b41e5343f21bc639535d151edbc493"}
Sep 15 07:22:48.091871 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:48.091834    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" event={"ID":"2df2c386-c643-4b8b-b30c-d5baeb271f0d","Type":"ContainerStarted","Data":"81092794a8ecf3e3bb75a5df0803095125adc6ae2fdd3791ca5c28d689ba47a7"}
Sep 15 07:22:55.126521 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:55.126488    2568 generic.go:356] "Generic (PLEG): container finished" podID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerID="81092794a8ecf3e3bb75a5df0803095125adc6ae2fdd3791ca5c28d689ba47a7" exitCode=0
Sep 15 07:22:55.126873 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:55.126551    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" event={"ID":"2df2c386-c643-4b8b-b30c-d5baeb271f0d","Type":"ContainerDied","Data":"81092794a8ecf3e3bb75a5df0803095125adc6ae2fdd3791ca5c28d689ba47a7"}
Sep 15 07:22:56.134689 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:56.134646    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" event={"ID":"2df2c386-c643-4b8b-b30c-d5baeb271f0d","Type":"ContainerStarted","Data":"4a7ef785ede5da0e0ad5afba8315c949ec6fa557c8e781966282ba40101a61bd"}
Sep 15 07:22:56.135074 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:56.134699    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" event={"ID":"2df2c386-c643-4b8b-b30c-d5baeb271f0d","Type":"ContainerStarted","Data":"0ad9be98aa637ec922a9dfb818c1ea110df76b53354033d3deca0989d40ca86a"}
Sep 15 07:22:56.157055 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:56.157006    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" podStartSLOduration=12.156988717 podStartE2EDuration="12.156988717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:22:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:22:56.155351377 +0000 UTC m=+1315.946269199" watchObservedRunningTime="2026-09-15 07:22:56.156988717 +0000 UTC m=+1315.947906538"
Sep 15 07:22:56.979810 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:56.979776    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:22:56.979966 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:56.979841    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:22:56.981155 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:56.981119    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.37:6571: connect: connection refused"
Sep 15 07:22:56.981279 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:56.981171    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Sep 15 07:22:59.979860 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:59.979814    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.37:6571: connect: connection refused"
Sep 15 07:22:59.980245 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:22:59.979813    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Sep 15 07:23:02.979262 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:02.979210    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.37:6571: connect: connection refused"
Sep 15 07:23:02.985152 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:02.985127    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:23:02.985601 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:02.985579    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:23:02.988489 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:02.988468    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:23:04.979834 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:04.979800    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:23:05.979213 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:05.979163    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.37:6571: connect: connection refused"
Sep 15 07:23:08.980348 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:08.980315    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:23:08.980981 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:08.980960    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:23:09.917741 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:09.917695    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"]
Sep 15 07:23:09.923253 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:09.923229    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:09.925518 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:09.925493    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Sep 15 07:23:09.925800 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:09.925754    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Sep 15 07:23:09.925800 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:09.925767    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-jbc2f\""
Sep 15 07:23:09.925971 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:09.925875    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Sep 15 07:23:09.933221 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:09.933198    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"]
Sep 15 07:23:09.984735 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:09.984699    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/377710cc-c353-40f1-a106-bcf2ede57917-feast-data\") pod \"feast-driver-ranking-cb5cf8b94-v4kdw\" (UID: \"377710cc-c353-40f1-a106-bcf2ede57917\") " pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:09.985079 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:09.984770    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/377710cc-c353-40f1-a106-bcf2ede57917-registry-tls\") pod \"feast-driver-ranking-cb5cf8b94-v4kdw\" (UID: \"377710cc-c353-40f1-a106-bcf2ede57917\") " pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:09.985079 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:09.984843    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzxcb\" (UniqueName: \"kubernetes.io/projected/377710cc-c353-40f1-a106-bcf2ede57917-kube-api-access-bzxcb\") pod \"feast-driver-ranking-cb5cf8b94-v4kdw\" (UID: \"377710cc-c353-40f1-a106-bcf2ede57917\") " pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:09.985079 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:09.984904    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/377710cc-c353-40f1-a106-bcf2ede57917-online-tls\") pod \"feast-driver-ranking-cb5cf8b94-v4kdw\" (UID: \"377710cc-c353-40f1-a106-bcf2ede57917\") " pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:10.085829 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:10.085799    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzxcb\" (UniqueName: \"kubernetes.io/projected/377710cc-c353-40f1-a106-bcf2ede57917-kube-api-access-bzxcb\") pod \"feast-driver-ranking-cb5cf8b94-v4kdw\" (UID: \"377710cc-c353-40f1-a106-bcf2ede57917\") " pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:10.085979 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:10.085853    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/377710cc-c353-40f1-a106-bcf2ede57917-online-tls\") pod \"feast-driver-ranking-cb5cf8b94-v4kdw\" (UID: \"377710cc-c353-40f1-a106-bcf2ede57917\") " pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:10.085979 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:10.085908    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/377710cc-c353-40f1-a106-bcf2ede57917-feast-data\") pod \"feast-driver-ranking-cb5cf8b94-v4kdw\" (UID: \"377710cc-c353-40f1-a106-bcf2ede57917\") " pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:10.085979 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:10.085968    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/377710cc-c353-40f1-a106-bcf2ede57917-registry-tls\") pod \"feast-driver-ranking-cb5cf8b94-v4kdw\" (UID: \"377710cc-c353-40f1-a106-bcf2ede57917\") " pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:10.086148 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:23:10.086045    2568 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-online-tls: secret "feast-driver-ranking-online-tls" not found
Sep 15 07:23:10.086148 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:23:10.086066    2568 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-registry-tls: secret "feast-driver-ranking-registry-tls" not found
Sep 15 07:23:10.086148 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:23:10.086132    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/377710cc-c353-40f1-a106-bcf2ede57917-online-tls podName:377710cc-c353-40f1-a106-bcf2ede57917 nodeName:}" failed. No retries permitted until 2026-09-15 07:23:10.586110831 +0000 UTC m=+1330.377028637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/377710cc-c353-40f1-a106-bcf2ede57917-online-tls") pod "feast-driver-ranking-cb5cf8b94-v4kdw" (UID: "377710cc-c353-40f1-a106-bcf2ede57917") : secret "feast-driver-ranking-online-tls" not found
Sep 15 07:23:10.086264 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:23:10.086151    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/377710cc-c353-40f1-a106-bcf2ede57917-registry-tls podName:377710cc-c353-40f1-a106-bcf2ede57917 nodeName:}" failed. No retries permitted until 2026-09-15 07:23:10.586142559 +0000 UTC m=+1330.377060360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/377710cc-c353-40f1-a106-bcf2ede57917-registry-tls") pod "feast-driver-ranking-cb5cf8b94-v4kdw" (UID: "377710cc-c353-40f1-a106-bcf2ede57917") : secret "feast-driver-ranking-registry-tls" not found
Sep 15 07:23:10.086365 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:10.086348    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/377710cc-c353-40f1-a106-bcf2ede57917-feast-data\") pod \"feast-driver-ranking-cb5cf8b94-v4kdw\" (UID: \"377710cc-c353-40f1-a106-bcf2ede57917\") " pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:10.095828 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:10.095800    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzxcb\" (UniqueName: \"kubernetes.io/projected/377710cc-c353-40f1-a106-bcf2ede57917-kube-api-access-bzxcb\") pod \"feast-driver-ranking-cb5cf8b94-v4kdw\" (UID: \"377710cc-c353-40f1-a106-bcf2ede57917\") " pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:10.590960 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:10.590929    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/377710cc-c353-40f1-a106-bcf2ede57917-registry-tls\") pod \"feast-driver-ranking-cb5cf8b94-v4kdw\" (UID: \"377710cc-c353-40f1-a106-bcf2ede57917\") " pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:10.591135 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:10.590981    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/377710cc-c353-40f1-a106-bcf2ede57917-online-tls\") pod \"feast-driver-ranking-cb5cf8b94-v4kdw\" (UID: \"377710cc-c353-40f1-a106-bcf2ede57917\") " pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:10.593455 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:10.593432    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/377710cc-c353-40f1-a106-bcf2ede57917-registry-tls\") pod \"feast-driver-ranking-cb5cf8b94-v4kdw\" (UID: \"377710cc-c353-40f1-a106-bcf2ede57917\") " pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:10.593565 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:10.593495    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/377710cc-c353-40f1-a106-bcf2ede57917-online-tls\") pod \"feast-driver-ranking-cb5cf8b94-v4kdw\" (UID: \"377710cc-c353-40f1-a106-bcf2ede57917\") " pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:10.834063 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:10.834017    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:11.114894 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:11.114864    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"]
Sep 15 07:23:11.116022 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:23:11.115997    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod377710cc_c353_40f1_a106_bcf2ede57917.slice/crio-468ed49f25ab1844c198e74f160e7e7f4e7d1b28f1bb711ddf68c3b1a1b6dbb1 WatchSource:0}: Error finding container 468ed49f25ab1844c198e74f160e7e7f4e7d1b28f1bb711ddf68c3b1a1b6dbb1: Status 404 returned error can't find the container with id 468ed49f25ab1844c198e74f160e7e7f4e7d1b28f1bb711ddf68c3b1a1b6dbb1
Sep 15 07:23:11.209070 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:11.209034    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" event={"ID":"377710cc-c353-40f1-a106-bcf2ede57917","Type":"ContainerStarted","Data":"2d9835b20d5c361523faa56fade478e6cc22b69541f13c0df01b4a8c378f4ada"}
Sep 15 07:23:11.209236 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:11.209088    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" event={"ID":"377710cc-c353-40f1-a106-bcf2ede57917","Type":"ContainerStarted","Data":"468ed49f25ab1844c198e74f160e7e7f4e7d1b28f1bb711ddf68c3b1a1b6dbb1"}
Sep 15 07:23:16.235616 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:16.235529    2568 generic.go:356] "Generic (PLEG): container finished" podID="377710cc-c353-40f1-a106-bcf2ede57917" containerID="2d9835b20d5c361523faa56fade478e6cc22b69541f13c0df01b4a8c378f4ada" exitCode=0
Sep 15 07:23:16.235616 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:16.235602    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" event={"ID":"377710cc-c353-40f1-a106-bcf2ede57917","Type":"ContainerDied","Data":"2d9835b20d5c361523faa56fade478e6cc22b69541f13c0df01b4a8c378f4ada"}
Sep 15 07:23:17.242561 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:17.242524    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" event={"ID":"377710cc-c353-40f1-a106-bcf2ede57917","Type":"ContainerStarted","Data":"e7dc176656e6d28a76728d565ea65bf13d456e5fae1266fc544d0317d3dbd5b3"}
Sep 15 07:23:23.273328 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:23.273293    2568 generic.go:356] "Generic (PLEG): container finished" podID="377710cc-c353-40f1-a106-bcf2ede57917" containerID="e7dc176656e6d28a76728d565ea65bf13d456e5fae1266fc544d0317d3dbd5b3" exitCode=0
Sep 15 07:23:23.273690 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:23.273363    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" event={"ID":"377710cc-c353-40f1-a106-bcf2ede57917","Type":"ContainerDied","Data":"e7dc176656e6d28a76728d565ea65bf13d456e5fae1266fc544d0317d3dbd5b3"}
Sep 15 07:23:24.280778 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:24.280743    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" event={"ID":"377710cc-c353-40f1-a106-bcf2ede57917","Type":"ContainerStarted","Data":"26d1c418895390fe7532b7ef34ae1b320b997088cc4895cfc63a176942c77de3"}
Sep 15 07:23:24.281137 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:24.280804    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" event={"ID":"377710cc-c353-40f1-a106-bcf2ede57917","Type":"ContainerStarted","Data":"8532789ee44f647a0df471b6a07b3cdecd5dac6430ad0936139d9cc32d8fa3d3"}
Sep 15 07:23:24.304514 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:24.304458    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" podStartSLOduration=15.304437672 podStartE2EDuration="15.304437672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:23:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:23:24.301232055 +0000 UTC m=+1344.092149876" watchObservedRunningTime="2026-09-15 07:23:24.304437672 +0000 UTC m=+1344.095355494"
Sep 15 07:23:25.834378 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:25.834331    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:25.834756 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:25.834418    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:25.835772 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:25.835732    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" podUID="377710cc-c353-40f1-a106-bcf2ede57917" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Sep 15 07:23:25.835916 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:25.835735    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" podUID="377710cc-c353-40f1-a106-bcf2ede57917" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.38:6571: connect: connection refused"
Sep 15 07:23:28.834543 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:28.834500    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" podUID="377710cc-c353-40f1-a106-bcf2ede57917" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Sep 15 07:23:28.834961 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:28.834498    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" podUID="377710cc-c353-40f1-a106-bcf2ede57917" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.38:6571: connect: connection refused"
Sep 15 07:23:30.834726 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:30.834683    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:30.835100 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:30.834754    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:31.835340 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:31.835294    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" podUID="377710cc-c353-40f1-a106-bcf2ede57917" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.38:6571: connect: connection refused"
Sep 15 07:23:31.841302 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:31.841273    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:31.844747 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:31.844704    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:34.834576 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:34.834524    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" podUID="377710cc-c353-40f1-a106-bcf2ede57917" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.38:6571: connect: connection refused"
Sep 15 07:23:37.835336 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:37.835307    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:23:37.836081 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:23:37.836060    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:24:58.183441 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.183362    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6f97788895-9c89q"]
Sep 15 07:24:58.183985 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.183594    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-6f97788895-9c89q" podUID="db18bd9d-e768-4553-a866-6772df980865" containerName="manager" containerID="cri-o://b7bee8e22112f4e580e8748673dc251f5487c32d9f2f4ba3da634e08fe7bb59d" gracePeriod=10
Sep 15 07:24:58.458135 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.458110    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6f97788895-9c89q"
Sep 15 07:24:58.502609 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.502571    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"]
Sep 15 07:24:58.502964 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.502887    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="registry" containerID="cri-o://0ad9be98aa637ec922a9dfb818c1ea110df76b53354033d3deca0989d40ca86a" gracePeriod=30
Sep 15 07:24:58.503085 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.502960    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="online" containerID="cri-o://4a7ef785ede5da0e0ad5afba8315c949ec6fa557c8e781966282ba40101a61bd" gracePeriod=30
Sep 15 07:24:58.507902 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.507871    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"]
Sep 15 07:24:58.508100 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.508069    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" podUID="377710cc-c353-40f1-a106-bcf2ede57917" containerName="registry" containerID="cri-o://8532789ee44f647a0df471b6a07b3cdecd5dac6430ad0936139d9cc32d8fa3d3" gracePeriod=30
Sep 15 07:24:58.508225 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.508113    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" podUID="377710cc-c353-40f1-a106-bcf2ede57917" containerName="online" containerID="cri-o://26d1c418895390fe7532b7ef34ae1b320b997088cc4895cfc63a176942c77de3" gracePeriod=30
Sep 15 07:24:58.607906 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.607868    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5q756\" (UniqueName: \"kubernetes.io/projected/db18bd9d-e768-4553-a866-6772df980865-kube-api-access-5q756\") pod \"db18bd9d-e768-4553-a866-6772df980865\" (UID: \"db18bd9d-e768-4553-a866-6772df980865\") "
Sep 15 07:24:58.610057 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.610030    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db18bd9d-e768-4553-a866-6772df980865-kube-api-access-5q756" (OuterVolumeSpecName: "kube-api-access-5q756") pod "db18bd9d-e768-4553-a866-6772df980865" (UID: "db18bd9d-e768-4553-a866-6772df980865"). InnerVolumeSpecName "kube-api-access-5q756". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:24:58.708575 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.708504    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5q756\" (UniqueName: \"kubernetes.io/projected/db18bd9d-e768-4553-a866-6772df980865-kube-api-access-5q756\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:24:58.711434 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.711402    2568 generic.go:356] "Generic (PLEG): container finished" podID="db18bd9d-e768-4553-a866-6772df980865" containerID="b7bee8e22112f4e580e8748673dc251f5487c32d9f2f4ba3da634e08fe7bb59d" exitCode=0
Sep 15 07:24:58.711593 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.711448    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6f97788895-9c89q"
Sep 15 07:24:58.711593 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.711486    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6f97788895-9c89q" event={"ID":"db18bd9d-e768-4553-a866-6772df980865","Type":"ContainerDied","Data":"b7bee8e22112f4e580e8748673dc251f5487c32d9f2f4ba3da634e08fe7bb59d"}
Sep 15 07:24:58.711593 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.711558    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6f97788895-9c89q" event={"ID":"db18bd9d-e768-4553-a866-6772df980865","Type":"ContainerDied","Data":"d6b2a36798fd35bfe12398a716eba7423a46ee2341d27efc97472e79b14d3c60"}
Sep 15 07:24:58.711593 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.711591    2568 scope.go:117] "RemoveContainer" containerID="b7bee8e22112f4e580e8748673dc251f5487c32d9f2f4ba3da634e08fe7bb59d"
Sep 15 07:24:58.720252 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.720234    2568 scope.go:117] "RemoveContainer" containerID="b7bee8e22112f4e580e8748673dc251f5487c32d9f2f4ba3da634e08fe7bb59d"
Sep 15 07:24:58.720501 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:24:58.720483    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7bee8e22112f4e580e8748673dc251f5487c32d9f2f4ba3da634e08fe7bb59d\": container with ID starting with b7bee8e22112f4e580e8748673dc251f5487c32d9f2f4ba3da634e08fe7bb59d not found: ID does not exist" containerID="b7bee8e22112f4e580e8748673dc251f5487c32d9f2f4ba3da634e08fe7bb59d"
Sep 15 07:24:58.720559 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.720510    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7bee8e22112f4e580e8748673dc251f5487c32d9f2f4ba3da634e08fe7bb59d"} err="failed to get container status \"b7bee8e22112f4e580e8748673dc251f5487c32d9f2f4ba3da634e08fe7bb59d\": rpc error: code = NotFound desc = could not find container \"b7bee8e22112f4e580e8748673dc251f5487c32d9f2f4ba3da634e08fe7bb59d\": container with ID starting with b7bee8e22112f4e580e8748673dc251f5487c32d9f2f4ba3da634e08fe7bb59d not found: ID does not exist"
Sep 15 07:24:58.731414 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.731389    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6f97788895-9c89q"]
Sep 15 07:24:58.734616 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.734596    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6f97788895-9c89q"]
Sep 15 07:24:58.741559 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:58.741534    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db18bd9d-e768-4553-a866-6772df980865" path="/var/lib/kubelet/pods/db18bd9d-e768-4553-a866-6772df980865/volumes"
Sep 15 07:24:59.718289 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:59.718262    2568 generic.go:356] "Generic (PLEG): container finished" podID="377710cc-c353-40f1-a106-bcf2ede57917" containerID="26d1c418895390fe7532b7ef34ae1b320b997088cc4895cfc63a176942c77de3" exitCode=0
Sep 15 07:24:59.718688 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:59.718337    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" event={"ID":"377710cc-c353-40f1-a106-bcf2ede57917","Type":"ContainerDied","Data":"26d1c418895390fe7532b7ef34ae1b320b997088cc4895cfc63a176942c77de3"}
Sep 15 07:24:59.721463 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:59.721440    2568 generic.go:356] "Generic (PLEG): container finished" podID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerID="4a7ef785ede5da0e0ad5afba8315c949ec6fa557c8e781966282ba40101a61bd" exitCode=0
Sep 15 07:24:59.721578 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:24:59.721486    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" event={"ID":"2df2c386-c643-4b8b-b30c-d5baeb271f0d","Type":"ContainerDied","Data":"4a7ef785ede5da0e0ad5afba8315c949ec6fa557c8e781966282ba40101a61bd"}
Sep 15 07:25:00.653194 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:00.653158    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-9rr4c"]
Sep 15 07:25:00.653365 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:00.653320    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-9rr4c" podUID="e048b2be-ced7-420d-8247-7c79bea7c409" containerName="postgres" containerID="cri-o://6705da06414b0588fdb2a1e7422c64d711427db753020ed2a0a3e63f18453507" gracePeriod=30
Sep 15 07:25:00.659501 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:00.659471    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-frhpv"]
Sep 15 07:25:00.659834 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:00.659805    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-frhpv" podUID="2d395a65-6b29-48b2-a11a-6ba2830d5a8a" containerName="redis" containerID="cri-o://1794febab3aaadd30a4582647bb4324cc592135733854ab3120f40eeef1946b4" gracePeriod=30
Sep 15 07:25:00.935558 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:00.935535    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-9rr4c"
Sep 15 07:25:00.937578 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:00.937556    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-frhpv"
Sep 15 07:25:01.030910 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.030885    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpxg5\" (UniqueName: \"kubernetes.io/projected/2d395a65-6b29-48b2-a11a-6ba2830d5a8a-kube-api-access-bpxg5\") pod \"2d395a65-6b29-48b2-a11a-6ba2830d5a8a\" (UID: \"2d395a65-6b29-48b2-a11a-6ba2830d5a8a\") "
Sep 15 07:25:01.031087 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.030955    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgkmv\" (UniqueName: \"kubernetes.io/projected/e048b2be-ced7-420d-8247-7c79bea7c409-kube-api-access-kgkmv\") pod \"e048b2be-ced7-420d-8247-7c79bea7c409\" (UID: \"e048b2be-ced7-420d-8247-7c79bea7c409\") "
Sep 15 07:25:01.031087 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.031018    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/e048b2be-ced7-420d-8247-7c79bea7c409-postgresdata\") pod \"e048b2be-ced7-420d-8247-7c79bea7c409\" (UID: \"e048b2be-ced7-420d-8247-7c79bea7c409\") "
Sep 15 07:25:01.033343 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.033315    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e048b2be-ced7-420d-8247-7c79bea7c409-kube-api-access-kgkmv" (OuterVolumeSpecName: "kube-api-access-kgkmv") pod "e048b2be-ced7-420d-8247-7c79bea7c409" (UID: "e048b2be-ced7-420d-8247-7c79bea7c409"). InnerVolumeSpecName "kube-api-access-kgkmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:25:01.033469 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.033388    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d395a65-6b29-48b2-a11a-6ba2830d5a8a-kube-api-access-bpxg5" (OuterVolumeSpecName: "kube-api-access-bpxg5") pod "2d395a65-6b29-48b2-a11a-6ba2830d5a8a" (UID: "2d395a65-6b29-48b2-a11a-6ba2830d5a8a"). InnerVolumeSpecName "kube-api-access-bpxg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:25:01.061662 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.061624    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e048b2be-ced7-420d-8247-7c79bea7c409-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "e048b2be-ced7-420d-8247-7c79bea7c409" (UID: "e048b2be-ced7-420d-8247-7c79bea7c409"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 07:25:01.132439 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.132409    2568 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/e048b2be-ced7-420d-8247-7c79bea7c409-postgresdata\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:25:01.132439 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.132435    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpxg5\" (UniqueName: \"kubernetes.io/projected/2d395a65-6b29-48b2-a11a-6ba2830d5a8a-kube-api-access-bpxg5\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:25:01.132439 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.132445    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgkmv\" (UniqueName: \"kubernetes.io/projected/e048b2be-ced7-420d-8247-7c79bea7c409-kube-api-access-kgkmv\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:25:01.731113 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.731076    2568 generic.go:356] "Generic (PLEG): container finished" podID="2d395a65-6b29-48b2-a11a-6ba2830d5a8a" containerID="1794febab3aaadd30a4582647bb4324cc592135733854ab3120f40eeef1946b4" exitCode=0
Sep 15 07:25:01.731266 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.731123    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-frhpv"
Sep 15 07:25:01.731266 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.731163    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-frhpv" event={"ID":"2d395a65-6b29-48b2-a11a-6ba2830d5a8a","Type":"ContainerDied","Data":"1794febab3aaadd30a4582647bb4324cc592135733854ab3120f40eeef1946b4"}
Sep 15 07:25:01.731266 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.731218    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-frhpv" event={"ID":"2d395a65-6b29-48b2-a11a-6ba2830d5a8a","Type":"ContainerDied","Data":"93bf8f4b5cf929320f40127589946fd60b884d8021acfdde7462a527aa1f544e"}
Sep 15 07:25:01.731266 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.731241    2568 scope.go:117] "RemoveContainer" containerID="1794febab3aaadd30a4582647bb4324cc592135733854ab3120f40eeef1946b4"
Sep 15 07:25:01.732603 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.732585    2568 generic.go:356] "Generic (PLEG): container finished" podID="e048b2be-ced7-420d-8247-7c79bea7c409" containerID="6705da06414b0588fdb2a1e7422c64d711427db753020ed2a0a3e63f18453507" exitCode=0
Sep 15 07:25:01.732703 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.732634    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-9rr4c"
Sep 15 07:25:01.732703 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.732675    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-9rr4c" event={"ID":"e048b2be-ced7-420d-8247-7c79bea7c409","Type":"ContainerDied","Data":"6705da06414b0588fdb2a1e7422c64d711427db753020ed2a0a3e63f18453507"}
Sep 15 07:25:01.732828 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.732728    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-9rr4c" event={"ID":"e048b2be-ced7-420d-8247-7c79bea7c409","Type":"ContainerDied","Data":"6e31860f7053c4cab1c642bfa81e4867713b583783f7684382f1918765f8f35a"}
Sep 15 07:25:01.740172 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.740086    2568 scope.go:117] "RemoveContainer" containerID="1794febab3aaadd30a4582647bb4324cc592135733854ab3120f40eeef1946b4"
Sep 15 07:25:01.740372 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:25:01.740353    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1794febab3aaadd30a4582647bb4324cc592135733854ab3120f40eeef1946b4\": container with ID starting with 1794febab3aaadd30a4582647bb4324cc592135733854ab3120f40eeef1946b4 not found: ID does not exist" containerID="1794febab3aaadd30a4582647bb4324cc592135733854ab3120f40eeef1946b4"
Sep 15 07:25:01.740422 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.740379    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1794febab3aaadd30a4582647bb4324cc592135733854ab3120f40eeef1946b4"} err="failed to get container status \"1794febab3aaadd30a4582647bb4324cc592135733854ab3120f40eeef1946b4\": rpc error: code = NotFound desc = could not find container \"1794febab3aaadd30a4582647bb4324cc592135733854ab3120f40eeef1946b4\": container with ID starting with 1794febab3aaadd30a4582647bb4324cc592135733854ab3120f40eeef1946b4 not found: ID does not exist"
Sep 15 07:25:01.740422 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.740396    2568 scope.go:117] "RemoveContainer" containerID="6705da06414b0588fdb2a1e7422c64d711427db753020ed2a0a3e63f18453507"
Sep 15 07:25:01.748454 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.748436    2568 scope.go:117] "RemoveContainer" containerID="6705da06414b0588fdb2a1e7422c64d711427db753020ed2a0a3e63f18453507"
Sep 15 07:25:01.748698 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:25:01.748676    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6705da06414b0588fdb2a1e7422c64d711427db753020ed2a0a3e63f18453507\": container with ID starting with 6705da06414b0588fdb2a1e7422c64d711427db753020ed2a0a3e63f18453507 not found: ID does not exist" containerID="6705da06414b0588fdb2a1e7422c64d711427db753020ed2a0a3e63f18453507"
Sep 15 07:25:01.748815 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.748703    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6705da06414b0588fdb2a1e7422c64d711427db753020ed2a0a3e63f18453507"} err="failed to get container status \"6705da06414b0588fdb2a1e7422c64d711427db753020ed2a0a3e63f18453507\": rpc error: code = NotFound desc = could not find container \"6705da06414b0588fdb2a1e7422c64d711427db753020ed2a0a3e63f18453507\": container with ID starting with 6705da06414b0588fdb2a1e7422c64d711427db753020ed2a0a3e63f18453507 not found: ID does not exist"
Sep 15 07:25:01.752632 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.752612    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-frhpv"]
Sep 15 07:25:01.756257 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.756238    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-frhpv"]
Sep 15 07:25:01.764541 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.764523    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-9rr4c"]
Sep 15 07:25:01.769644 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.769622    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-9rr4c"]
Sep 15 07:25:01.842720 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:01.842677    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" podUID="377710cc-c353-40f1-a106-bcf2ede57917" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Sep 15 07:25:02.742203 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:02.742170    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d395a65-6b29-48b2-a11a-6ba2830d5a8a" path="/var/lib/kubelet/pods/2d395a65-6b29-48b2-a11a-6ba2830d5a8a/volumes"
Sep 15 07:25:02.742568 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:02.742509    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e048b2be-ced7-420d-8247-7c79bea7c409" path="/var/lib/kubelet/pods/e048b2be-ced7-420d-8247-7c79bea7c409/volumes"
Sep 15 07:25:02.985781 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:02.985743    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Sep 15 07:25:11.842771 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:11.842730    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" podUID="377710cc-c353-40f1-a106-bcf2ede57917" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Sep 15 07:25:12.986405 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:12.986359    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Sep 15 07:25:21.842191 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:21.842149    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" podUID="377710cc-c353-40f1-a106-bcf2ede57917" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Sep 15 07:25:21.842607 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:21.842268    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:25:22.986574 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:22.986529    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Sep 15 07:25:22.986982 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:22.986636    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:25:28.847739 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:28.847638    2568 generic.go:356] "Generic (PLEG): container finished" podID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerID="0ad9be98aa637ec922a9dfb818c1ea110df76b53354033d3deca0989d40ca86a" exitCode=137
Sep 15 07:25:28.847739 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:28.847726    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" event={"ID":"2df2c386-c643-4b8b-b30c-d5baeb271f0d","Type":"ContainerDied","Data":"0ad9be98aa637ec922a9dfb818c1ea110df76b53354033d3deca0989d40ca86a"}
Sep 15 07:25:28.850237 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:28.850217    2568 generic.go:356] "Generic (PLEG): container finished" podID="377710cc-c353-40f1-a106-bcf2ede57917" containerID="8532789ee44f647a0df471b6a07b3cdecd5dac6430ad0936139d9cc32d8fa3d3" exitCode=137
Sep 15 07:25:28.850357 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:28.850253    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" event={"ID":"377710cc-c353-40f1-a106-bcf2ede57917","Type":"ContainerDied","Data":"8532789ee44f647a0df471b6a07b3cdecd5dac6430ad0936139d9cc32d8fa3d3"}
Sep 15 07:25:28.980985 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:28.980942    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.37:6571: connect: connection refused"
Sep 15 07:25:29.176940 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.176917    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:25:29.179458 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.179437    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:25:29.256758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.256721    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2df2c386-c643-4b8b-b30c-d5baeb271f0d-registry-tls\") pod \"2df2c386-c643-4b8b-b30c-d5baeb271f0d\" (UID: \"2df2c386-c643-4b8b-b30c-d5baeb271f0d\") "
Sep 15 07:25:29.256934 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.256766    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2df2c386-c643-4b8b-b30c-d5baeb271f0d-feast-data\") pod \"2df2c386-c643-4b8b-b30c-d5baeb271f0d\" (UID: \"2df2c386-c643-4b8b-b30c-d5baeb271f0d\") "
Sep 15 07:25:29.256934 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.256789    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2df2c386-c643-4b8b-b30c-d5baeb271f0d-online-tls\") pod \"2df2c386-c643-4b8b-b30c-d5baeb271f0d\" (UID: \"2df2c386-c643-4b8b-b30c-d5baeb271f0d\") "
Sep 15 07:25:29.256934 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.256833    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/377710cc-c353-40f1-a106-bcf2ede57917-registry-tls\") pod \"377710cc-c353-40f1-a106-bcf2ede57917\" (UID: \"377710cc-c353-40f1-a106-bcf2ede57917\") "
Sep 15 07:25:29.256934 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.256868    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzxcb\" (UniqueName: \"kubernetes.io/projected/377710cc-c353-40f1-a106-bcf2ede57917-kube-api-access-bzxcb\") pod \"377710cc-c353-40f1-a106-bcf2ede57917\" (UID: \"377710cc-c353-40f1-a106-bcf2ede57917\") "
Sep 15 07:25:29.256934 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.256885    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/377710cc-c353-40f1-a106-bcf2ede57917-online-tls\") pod \"377710cc-c353-40f1-a106-bcf2ede57917\" (UID: \"377710cc-c353-40f1-a106-bcf2ede57917\") "
Sep 15 07:25:29.256934 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.256920    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-545bz\" (UniqueName: \"kubernetes.io/projected/2df2c386-c643-4b8b-b30c-d5baeb271f0d-kube-api-access-545bz\") pod \"2df2c386-c643-4b8b-b30c-d5baeb271f0d\" (UID: \"2df2c386-c643-4b8b-b30c-d5baeb271f0d\") "
Sep 15 07:25:29.256934 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.256937    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/377710cc-c353-40f1-a106-bcf2ede57917-feast-data\") pod \"377710cc-c353-40f1-a106-bcf2ede57917\" (UID: \"377710cc-c353-40f1-a106-bcf2ede57917\") "
Sep 15 07:25:29.257639 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.257606    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/377710cc-c353-40f1-a106-bcf2ede57917-feast-data" (OuterVolumeSpecName: "feast-data") pod "377710cc-c353-40f1-a106-bcf2ede57917" (UID: "377710cc-c353-40f1-a106-bcf2ede57917"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 07:25:29.259448 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.259408    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2df2c386-c643-4b8b-b30c-d5baeb271f0d-kube-api-access-545bz" (OuterVolumeSpecName: "kube-api-access-545bz") pod "2df2c386-c643-4b8b-b30c-d5baeb271f0d" (UID: "2df2c386-c643-4b8b-b30c-d5baeb271f0d"). InnerVolumeSpecName "kube-api-access-545bz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:25:29.259563 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.259545    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/377710cc-c353-40f1-a106-bcf2ede57917-kube-api-access-bzxcb" (OuterVolumeSpecName: "kube-api-access-bzxcb") pod "377710cc-c353-40f1-a106-bcf2ede57917" (UID: "377710cc-c353-40f1-a106-bcf2ede57917"). InnerVolumeSpecName "kube-api-access-bzxcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:25:29.259619 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.259547    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2df2c386-c643-4b8b-b30c-d5baeb271f0d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2df2c386-c643-4b8b-b30c-d5baeb271f0d" (UID: "2df2c386-c643-4b8b-b30c-d5baeb271f0d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:25:29.259662 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.259619    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/377710cc-c353-40f1-a106-bcf2ede57917-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "377710cc-c353-40f1-a106-bcf2ede57917" (UID: "377710cc-c353-40f1-a106-bcf2ede57917"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:25:29.259662 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.259639    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2df2c386-c643-4b8b-b30c-d5baeb271f0d-online-tls" (OuterVolumeSpecName: "online-tls") pod "2df2c386-c643-4b8b-b30c-d5baeb271f0d" (UID: "2df2c386-c643-4b8b-b30c-d5baeb271f0d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:25:29.259786 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.259743    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/377710cc-c353-40f1-a106-bcf2ede57917-online-tls" (OuterVolumeSpecName: "online-tls") pod "377710cc-c353-40f1-a106-bcf2ede57917" (UID: "377710cc-c353-40f1-a106-bcf2ede57917"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:25:29.266934 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.266910    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2df2c386-c643-4b8b-b30c-d5baeb271f0d-feast-data" (OuterVolumeSpecName: "feast-data") pod "2df2c386-c643-4b8b-b30c-d5baeb271f0d" (UID: "2df2c386-c643-4b8b-b30c-d5baeb271f0d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 07:25:29.357922 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.357836    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzxcb\" (UniqueName: \"kubernetes.io/projected/377710cc-c353-40f1-a106-bcf2ede57917-kube-api-access-bzxcb\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:25:29.357922 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.357869    2568 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/377710cc-c353-40f1-a106-bcf2ede57917-online-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:25:29.357922 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.357879    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-545bz\" (UniqueName: \"kubernetes.io/projected/2df2c386-c643-4b8b-b30c-d5baeb271f0d-kube-api-access-545bz\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:25:29.357922 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.357889    2568 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/377710cc-c353-40f1-a106-bcf2ede57917-feast-data\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:25:29.357922 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.357898    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2df2c386-c643-4b8b-b30c-d5baeb271f0d-registry-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:25:29.357922 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.357906    2568 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2df2c386-c643-4b8b-b30c-d5baeb271f0d-feast-data\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:25:29.357922 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.357913    2568 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2df2c386-c643-4b8b-b30c-d5baeb271f0d-online-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:25:29.357922 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.357921    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/377710cc-c353-40f1-a106-bcf2ede57917-registry-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:25:29.856774 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.856743    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"
Sep 15 07:25:29.856774 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.856746    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q" event={"ID":"2df2c386-c643-4b8b-b30c-d5baeb271f0d","Type":"ContainerDied","Data":"9f4bd474cacbec44f1109318bd97563ac84bf8ffe6e7e9f0a5d44378386f7f89"}
Sep 15 07:25:29.857286 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.856822    2568 scope.go:117] "RemoveContainer" containerID="4a7ef785ede5da0e0ad5afba8315c949ec6fa557c8e781966282ba40101a61bd"
Sep 15 07:25:29.859241 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.859222    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"
Sep 15 07:25:29.859344 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.859240    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw" event={"ID":"377710cc-c353-40f1-a106-bcf2ede57917","Type":"ContainerDied","Data":"468ed49f25ab1844c198e74f160e7e7f4e7d1b28f1bb711ddf68c3b1a1b6dbb1"}
Sep 15 07:25:29.867507 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.867490    2568 scope.go:117] "RemoveContainer" containerID="0ad9be98aa637ec922a9dfb818c1ea110df76b53354033d3deca0989d40ca86a"
Sep 15 07:25:29.874974 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.874957    2568 scope.go:117] "RemoveContainer" containerID="81092794a8ecf3e3bb75a5df0803095125adc6ae2fdd3791ca5c28d689ba47a7"
Sep 15 07:25:29.879038 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.879013    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"]
Sep 15 07:25:29.882638 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.882619    2568 scope.go:117] "RemoveContainer" containerID="0c93276898d363ea04b43045fe4c86f582b41e5343f21bc639535d151edbc493"
Sep 15 07:25:29.882890 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.882874    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69946b4bc7-6pj9q"]
Sep 15 07:25:29.889703 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.889684    2568 scope.go:117] "RemoveContainer" containerID="26d1c418895390fe7532b7ef34ae1b320b997088cc4895cfc63a176942c77de3"
Sep 15 07:25:29.893182 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.893161    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"]
Sep 15 07:25:29.896627 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.896606    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-cb5cf8b94-v4kdw"]
Sep 15 07:25:29.897642 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.897620    2568 scope.go:117] "RemoveContainer" containerID="8532789ee44f647a0df471b6a07b3cdecd5dac6430ad0936139d9cc32d8fa3d3"
Sep 15 07:25:29.905451 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.905434    2568 scope.go:117] "RemoveContainer" containerID="e7dc176656e6d28a76728d565ea65bf13d456e5fae1266fc544d0317d3dbd5b3"
Sep 15 07:25:29.912462 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:29.912443    2568 scope.go:117] "RemoveContainer" containerID="2d9835b20d5c361523faa56fade478e6cc22b69541f13c0df01b4a8c378f4ada"
Sep 15 07:25:30.747011 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:30.746971    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" path="/var/lib/kubelet/pods/2df2c386-c643-4b8b-b30c-d5baeb271f0d/volumes"
Sep 15 07:25:30.747490 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:25:30.747476    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="377710cc-c353-40f1-a106-bcf2ede57917" path="/var/lib/kubelet/pods/377710cc-c353-40f1-a106-bcf2ede57917/volumes"
Sep 15 07:26:09.710431 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710393    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"]
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710722    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d395a65-6b29-48b2-a11a-6ba2830d5a8a" containerName="redis"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710736    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d395a65-6b29-48b2-a11a-6ba2830d5a8a" containerName="redis"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710750    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="377710cc-c353-40f1-a106-bcf2ede57917" containerName="feast-apply"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710757    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="377710cc-c353-40f1-a106-bcf2ede57917" containerName="feast-apply"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710767    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="377710cc-c353-40f1-a106-bcf2ede57917" containerName="feast-init"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710773    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="377710cc-c353-40f1-a106-bcf2ede57917" containerName="feast-init"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710781    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="377710cc-c353-40f1-a106-bcf2ede57917" containerName="registry"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710795    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="377710cc-c353-40f1-a106-bcf2ede57917" containerName="registry"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710804    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="feast-init"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710809    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="feast-init"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710820    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db18bd9d-e768-4553-a866-6772df980865" containerName="manager"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710825    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="db18bd9d-e768-4553-a866-6772df980865" containerName="manager"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710830    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="feast-apply"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710835    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="feast-apply"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710841    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="377710cc-c353-40f1-a106-bcf2ede57917" containerName="online"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710846    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="377710cc-c353-40f1-a106-bcf2ede57917" containerName="online"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710854    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e048b2be-ced7-420d-8247-7c79bea7c409" containerName="postgres"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710859    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e048b2be-ced7-420d-8247-7c79bea7c409" containerName="postgres"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710866    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="registry"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710871    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="registry"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710878    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="online"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710883    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="online"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710935    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d395a65-6b29-48b2-a11a-6ba2830d5a8a" containerName="redis"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710943    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e048b2be-ced7-420d-8247-7c79bea7c409" containerName="postgres"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710948    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="online"
Sep 15 07:26:09.710943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710957    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="db18bd9d-e768-4553-a866-6772df980865" containerName="manager"
Sep 15 07:26:09.712292 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710964    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2df2c386-c643-4b8b-b30c-d5baeb271f0d" containerName="registry"
Sep 15 07:26:09.712292 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710971    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="377710cc-c353-40f1-a106-bcf2ede57917" containerName="registry"
Sep 15 07:26:09.712292 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.710976    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="377710cc-c353-40f1-a106-bcf2ede57917" containerName="online"
Sep 15 07:26:09.714696 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.714677    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:09.719085 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.719044    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 15 07:26:09.719362 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.719341    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 15 07:26:09.719522 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.719102    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-tj2mg\""
Sep 15 07:26:09.719522 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.719098    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 15 07:26:09.719696 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.719613    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 15 07:26:09.719696 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.719630    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 15 07:26:09.720078 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.720059    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 15 07:26:09.736370 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.736346    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"]
Sep 15 07:26:09.894623 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.894585    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhp8\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:09.894824 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.894637    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhp8\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:09.894824 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.894737    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnndl\" (UniqueName: \"kubernetes.io/projected/48981ab4-74e9-47e7-9dd9-8458b0735939-kube-api-access-tnndl\") pod \"feast-simple-feast-setup-57576b8fcf-9fhp8\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:09.894824 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.894786    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhp8\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:09.894998 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.894868    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhp8\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:09.894998 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.894897    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/48981ab4-74e9-47e7-9dd9-8458b0735939-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-9fhp8\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:09.996258 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.996176    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhp8\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:09.996258 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.996228    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhp8\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:09.996258 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.996248    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/48981ab4-74e9-47e7-9dd9-8458b0735939-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-9fhp8\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:09.996526 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.996277    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhp8\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:09.996526 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.996300    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhp8\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:09.996526 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.996329    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnndl\" (UniqueName: \"kubernetes.io/projected/48981ab4-74e9-47e7-9dd9-8458b0735939-kube-api-access-tnndl\") pod \"feast-simple-feast-setup-57576b8fcf-9fhp8\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:09.996752 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.996732    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/48981ab4-74e9-47e7-9dd9-8458b0735939-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-9fhp8\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:09.998832 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.998807    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhp8\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:09.998952 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.998915    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhp8\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:09.998952 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.998917    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhp8\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:09.999043 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:09.999029    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhp8\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:10.006312 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:10.006283    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnndl\" (UniqueName: \"kubernetes.io/projected/48981ab4-74e9-47e7-9dd9-8458b0735939-kube-api-access-tnndl\") pod \"feast-simple-feast-setup-57576b8fcf-9fhp8\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:10.037745 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:10.037704    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:10.318122 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:10.318046    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"]
Sep 15 07:26:10.321362 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:26:10.321336    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48981ab4_74e9_47e7_9dd9_8458b0735939.slice/crio-b7d7ba3912f9723731cebe1a95c8f64206edbe381baa8a0502e1e287155f3740 WatchSource:0}: Error finding container b7d7ba3912f9723731cebe1a95c8f64206edbe381baa8a0502e1e287155f3740: Status 404 returned error can't find the container with id b7d7ba3912f9723731cebe1a95c8f64206edbe381baa8a0502e1e287155f3740
Sep 15 07:26:10.323585 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:10.323566    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 07:26:11.050544 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:11.050351    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" event={"ID":"48981ab4-74e9-47e7-9dd9-8458b0735939","Type":"ContainerStarted","Data":"b7d7ba3912f9723731cebe1a95c8f64206edbe381baa8a0502e1e287155f3740"}
Sep 15 07:26:24.115254 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:24.115220    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" event={"ID":"48981ab4-74e9-47e7-9dd9-8458b0735939","Type":"ContainerStarted","Data":"56b241c8bc7ba24d322a80fbe35ea4f59d09e0691c15f450fc3a3da2f920bd11"}
Sep 15 07:26:28.133958 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:28.133927    2568 generic.go:356] "Generic (PLEG): container finished" podID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerID="56b241c8bc7ba24d322a80fbe35ea4f59d09e0691c15f450fc3a3da2f920bd11" exitCode=0
Sep 15 07:26:28.134306 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:28.133999    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" event={"ID":"48981ab4-74e9-47e7-9dd9-8458b0735939","Type":"ContainerDied","Data":"56b241c8bc7ba24d322a80fbe35ea4f59d09e0691c15f450fc3a3da2f920bd11"}
Sep 15 07:26:29.140061 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:29.140025    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" event={"ID":"48981ab4-74e9-47e7-9dd9-8458b0735939","Type":"ContainerStarted","Data":"200c56210ffa629012a1ccc5ed17f9bd1505764c6f1534fae847981689bdcf30"}
Sep 15 07:26:34.164255 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:34.164176    2568 generic.go:356] "Generic (PLEG): container finished" podID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerID="200c56210ffa629012a1ccc5ed17f9bd1505764c6f1534fae847981689bdcf30" exitCode=0
Sep 15 07:26:34.164604 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:34.164249    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" event={"ID":"48981ab4-74e9-47e7-9dd9-8458b0735939","Type":"ContainerDied","Data":"200c56210ffa629012a1ccc5ed17f9bd1505764c6f1534fae847981689bdcf30"}
Sep 15 07:26:35.174800 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:35.174754    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" event={"ID":"48981ab4-74e9-47e7-9dd9-8458b0735939","Type":"ContainerStarted","Data":"b0c2f7c80572e5d92736996e4d9c8afeee939a2db7eb4219e38864355c23d680"}
Sep 15 07:26:35.175322 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:35.174821    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" event={"ID":"48981ab4-74e9-47e7-9dd9-8458b0735939","Type":"ContainerStarted","Data":"e1d15e873cb8431207382cf5254f8db2b50f25633e16b801b956d075e0747cf7"}
Sep 15 07:26:35.175322 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:35.174843    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" event={"ID":"48981ab4-74e9-47e7-9dd9-8458b0735939","Type":"ContainerStarted","Data":"4870fc6deaf18db2ccf3df295c96f4234fcc904f94791cc471974042b99bf827"}
Sep 15 07:26:35.175322 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:35.174861    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" event={"ID":"48981ab4-74e9-47e7-9dd9-8458b0735939","Type":"ContainerStarted","Data":"0f99b7c8532655258917602a85636d7f853ecffc8896d83de21d36ae450e849e"}
Sep 15 07:26:35.204955 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:35.204881    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" podStartSLOduration=13.37818747 podStartE2EDuration="26.2048585s" totalImagesPullingTime="12.82667103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:26:35.202936517 +0000 UTC m=+1534.993854373" watchObservedRunningTime="2026-09-15 07:26:35.2048585 +0000 UTC m=+1534.995776321"
Sep 15 07:26:37.039016 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:37.038634    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:37.039016 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:37.038731    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:37.039651 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:37.039411    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:37.039651 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:37.039453    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:37.041211 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:37.041169    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.39:6571: connect: connection refused"
Sep 15 07:26:37.041355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:37.041208    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.39:8816: connect: connection refused"
Sep 15 07:26:37.041355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:37.041215    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.39:8443: connect: connection refused"
Sep 15 07:26:37.041355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:37.041305    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="online" probeResult="failure" output="Get \"https://10.132.0.39:6567/health\": dial tcp 10.132.0.39:6567: connect: connection refused"
Sep 15 07:26:40.038161 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:40.038113    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.39:8443: connect: connection refused"
Sep 15 07:26:40.038764 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:40.038237    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.39:8816: connect: connection refused"
Sep 15 07:26:40.038918 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:40.038231    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.39:6571: connect: connection refused"
Sep 15 07:26:40.038918 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:40.037892    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:40.038918 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:40.038857    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:40.038918 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:40.038880    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:40.038918 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:40.038306    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="online" probeResult="failure" output="Get \"https://10.132.0.39:6567/health\": dial tcp 10.132.0.39:6567: connect: connection refused"
Sep 15 07:26:40.039213 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:40.038898    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:43.039321 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:43.039277    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:43.039904 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:43.039873    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:43.040064 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:43.040049    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:43.040124 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:43.040113    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:43.044596 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:43.044578    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:43.222451 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:43.222418    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:43.222622 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:43.222488    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:26:43.225072 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:26:43.225051    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:27:45.071741 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.071695    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"]
Sep 15 07:27:45.074488 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.071972    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="registry" containerID="cri-o://0f99b7c8532655258917602a85636d7f853ecffc8896d83de21d36ae450e849e" gracePeriod=30
Sep 15 07:27:45.074488 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.072006    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="offline" containerID="cri-o://e1d15e873cb8431207382cf5254f8db2b50f25633e16b801b956d075e0747cf7" gracePeriod=30
Sep 15 07:27:45.074488 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.072039    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="online" containerID="cri-o://4870fc6deaf18db2ccf3df295c96f4234fcc904f94791cc471974042b99bf827" gracePeriod=30
Sep 15 07:27:45.074488 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.072117    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="ui" containerID="cri-o://b0c2f7c80572e5d92736996e4d9c8afeee939a2db7eb4219e38864355c23d680" gracePeriod=30
Sep 15 07:27:45.567730 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.567684    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"]
Sep 15 07:27:45.571958 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.571930    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:27:45.574271 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.574237    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-trf2j\""
Sep 15 07:27:45.584176 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.584144    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"]
Sep 15 07:27:45.692986 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.692948    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bkhw\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:27:45.692986 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.692997    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bkhw\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:27:45.693267 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.693029    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/180590ee-3bfd-4475-96fb-87ea6dbf9c70-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-4bkhw\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:27:45.693267 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.693048    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd4gm\" (UniqueName: \"kubernetes.io/projected/180590ee-3bfd-4475-96fb-87ea6dbf9c70-kube-api-access-fd4gm\") pod \"feast-simple-feast-setup-57576b8fcf-4bkhw\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:27:45.693267 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.693126    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bkhw\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:27:45.693267 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.693145    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bkhw\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:27:45.793976 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.793947    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bkhw\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:27:45.794084 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.793993    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bkhw\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:27:45.794084 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.794060    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bkhw\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:27:45.794165 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.794103    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bkhw\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:27:45.794165 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:27:45.794115    2568 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Sep 15 07:27:45.794165 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.794140    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/180590ee-3bfd-4475-96fb-87ea6dbf9c70-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-4bkhw\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:27:45.794312 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.794170    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd4gm\" (UniqueName: \"kubernetes.io/projected/180590ee-3bfd-4475-96fb-87ea6dbf9c70-kube-api-access-fd4gm\") pod \"feast-simple-feast-setup-57576b8fcf-4bkhw\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:27:45.794312 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:27:45.794208    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-ui-tls podName:180590ee-3bfd-4475-96fb-87ea6dbf9c70 nodeName:}" failed. No retries permitted until 2026-09-15 07:27:46.29417813 +0000 UTC m=+1606.085095929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-4bkhw" (UID: "180590ee-3bfd-4475-96fb-87ea6dbf9c70") : secret "feast-simple-feast-setup-ui-tls" not found
Sep 15 07:27:45.794575 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.794550    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/180590ee-3bfd-4475-96fb-87ea6dbf9c70-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-4bkhw\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:27:45.796300 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.796271    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bkhw\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:27:45.796506 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.796488    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bkhw\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:27:45.796789 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.796773    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bkhw\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:27:45.802424 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:45.802403    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd4gm\" (UniqueName: \"kubernetes.io/projected/180590ee-3bfd-4475-96fb-87ea6dbf9c70-kube-api-access-fd4gm\") pod \"feast-simple-feast-setup-57576b8fcf-4bkhw\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:27:46.299564 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:46.299528    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bkhw\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:27:46.301876 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:46.301857    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bkhw\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:27:46.484161 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:46.484125    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:27:46.489867 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:46.489841    2568 generic.go:356] "Generic (PLEG): container finished" podID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerID="b0c2f7c80572e5d92736996e4d9c8afeee939a2db7eb4219e38864355c23d680" exitCode=0
Sep 15 07:27:46.489979 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:46.489869    2568 generic.go:356] "Generic (PLEG): container finished" podID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerID="4870fc6deaf18db2ccf3df295c96f4234fcc904f94791cc471974042b99bf827" exitCode=0
Sep 15 07:27:46.489979 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:46.489917    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" event={"ID":"48981ab4-74e9-47e7-9dd9-8458b0735939","Type":"ContainerDied","Data":"b0c2f7c80572e5d92736996e4d9c8afeee939a2db7eb4219e38864355c23d680"}
Sep 15 07:27:46.489979 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:46.489966    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" event={"ID":"48981ab4-74e9-47e7-9dd9-8458b0735939","Type":"ContainerDied","Data":"4870fc6deaf18db2ccf3df295c96f4234fcc904f94791cc471974042b99bf827"}
Sep 15 07:27:46.761414 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:46.761388    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"]
Sep 15 07:27:46.762999 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:27:46.762973    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod180590ee_3bfd_4475_96fb_87ea6dbf9c70.slice/crio-3c8ab24e926e9861a6dd9079d5e7001c5752850afcbaed2e5e3ac2c71a31b02c WatchSource:0}: Error finding container 3c8ab24e926e9861a6dd9079d5e7001c5752850afcbaed2e5e3ac2c71a31b02c: Status 404 returned error can't find the container with id 3c8ab24e926e9861a6dd9079d5e7001c5752850afcbaed2e5e3ac2c71a31b02c
Sep 15 07:27:47.496067 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:47.496028    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" event={"ID":"180590ee-3bfd-4475-96fb-87ea6dbf9c70","Type":"ContainerStarted","Data":"44cd43d135a344e8843cb9fd0b6fdd918c2491b0f9446cbc7a33d041c004f2b6"}
Sep 15 07:27:47.496428 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:47.496080    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" event={"ID":"180590ee-3bfd-4475-96fb-87ea6dbf9c70","Type":"ContainerStarted","Data":"3c8ab24e926e9861a6dd9079d5e7001c5752850afcbaed2e5e3ac2c71a31b02c"}
Sep 15 07:27:52.520802 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:52.520759    2568 generic.go:356] "Generic (PLEG): container finished" podID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerID="44cd43d135a344e8843cb9fd0b6fdd918c2491b0f9446cbc7a33d041c004f2b6" exitCode=0
Sep 15 07:27:52.521171 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:52.520833    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" event={"ID":"180590ee-3bfd-4475-96fb-87ea6dbf9c70","Type":"ContainerDied","Data":"44cd43d135a344e8843cb9fd0b6fdd918c2491b0f9446cbc7a33d041c004f2b6"}
Sep 15 07:27:53.223029 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:53.222934    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="online" probeResult="failure" output="Get \"https://10.132.0.39:6567/health\": dial tcp 10.132.0.39:6567: connect: connection refused"
Sep 15 07:27:53.223029 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:53.222930    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.39:8443: connect: connection refused"
Sep 15 07:27:53.527388 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:53.527307    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" event={"ID":"180590ee-3bfd-4475-96fb-87ea6dbf9c70","Type":"ContainerStarted","Data":"2540b0170b4fee0fc7b9ddcdbcd0114a95865e4107ad220ccbd55dca8d1f553c"}
Sep 15 07:27:58.552612 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:58.552532    2568 generic.go:356] "Generic (PLEG): container finished" podID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerID="2540b0170b4fee0fc7b9ddcdbcd0114a95865e4107ad220ccbd55dca8d1f553c" exitCode=0
Sep 15 07:27:58.552975 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:58.552605    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" event={"ID":"180590ee-3bfd-4475-96fb-87ea6dbf9c70","Type":"ContainerDied","Data":"2540b0170b4fee0fc7b9ddcdbcd0114a95865e4107ad220ccbd55dca8d1f553c"}
Sep 15 07:27:59.564113 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:59.564071    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" event={"ID":"180590ee-3bfd-4475-96fb-87ea6dbf9c70","Type":"ContainerStarted","Data":"f46bf504dff1ec1d4cfce0b2e0e432548f71b15d3d319c7772914fd8a7c33ac0"}
Sep 15 07:27:59.564605 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:59.564140    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" event={"ID":"180590ee-3bfd-4475-96fb-87ea6dbf9c70","Type":"ContainerStarted","Data":"e10484c31ef2625c28fc2e938ad310c9ffd604bd8dc97adfc59d53d509ed2fb5"}
Sep 15 07:27:59.564605 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:59.564167    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" event={"ID":"180590ee-3bfd-4475-96fb-87ea6dbf9c70","Type":"ContainerStarted","Data":"dad4a4d711732526912b33be22752d0bddf25704e3a19102fc7fcde1e599bf91"}
Sep 15 07:27:59.564605 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:59.564188    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" event={"ID":"180590ee-3bfd-4475-96fb-87ea6dbf9c70","Type":"ContainerStarted","Data":"f98b10868575d9ee34d1f51f5b675c9fc5716ca4ed5ce5ea0fba3f95cf0145a5"}
Sep 15 07:27:59.588730 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:27:59.588640    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" podStartSLOduration=14.588617784 podStartE2EDuration="14.588617784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:27:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:27:59.587178193 +0000 UTC m=+1619.378096015" watchObservedRunningTime="2026-09-15 07:27:59.588617784 +0000 UTC m=+1619.379535605"
Sep 15 07:28:01.484361 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:01.484315    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:28:01.484828 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:01.484391    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:28:01.484828 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:01.484409    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:28:01.484828 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:01.484424    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:28:01.486406 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:01.486370    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.40:6571: connect: connection refused"
Sep 15 07:28:01.486406 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:01.486390    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.40:8443: connect: connection refused"
Sep 15 07:28:01.486609 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:01.486417    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.40:8816: connect: connection refused"
Sep 15 07:28:01.486609 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:01.486374    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="online" probeResult="failure" output="Get \"https://10.132.0.40:6567/health\": dial tcp 10.132.0.40:6567: connect: connection refused"
Sep 15 07:28:03.222964 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:03.222909    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.39:8443: connect: connection refused"
Sep 15 07:28:03.223499 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:03.222919    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="online" probeResult="failure" output="Get \"https://10.132.0.39:6567/health\": dial tcp 10.132.0.39:6567: connect: connection refused"
Sep 15 07:28:04.485050 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:04.484996    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.40:6571: connect: connection refused"
Sep 15 07:28:04.485673 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:04.485008    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.40:8816: connect: connection refused"
Sep 15 07:28:04.485786 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:04.485018    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.40:8443: connect: connection refused"
Sep 15 07:28:04.485786 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:04.485088    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="online" probeResult="failure" output="Get \"https://10.132.0.40:6567/health\": dial tcp 10.132.0.40:6567: connect: connection refused"
Sep 15 07:28:06.485035 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:06.484985    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:28:06.485530 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:06.485051    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:28:06.485530 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:06.485066    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:28:06.485530 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:06.485078    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:28:07.485904 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:07.485872    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:28:07.486405 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:07.485984    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:28:07.486405 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:07.486204    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:28:07.486899 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:07.486878    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:28:07.487007 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:07.486932    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:28:07.487061 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:07.487030    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:28:07.491379 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:07.491356    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:28:07.616724 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:07.616688    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:28:13.222946 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:13.222892    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.39:8443: connect: connection refused"
Sep 15 07:28:13.223384 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:13.222896    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="online" probeResult="failure" output="Get \"https://10.132.0.39:6567/health\": dial tcp 10.132.0.39:6567: connect: connection refused"
Sep 15 07:28:13.223560 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:13.223541    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:28:13.223637 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:13.223624    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:28:15.650311 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.650282    2568 generic.go:356] "Generic (PLEG): container finished" podID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerID="e1d15e873cb8431207382cf5254f8db2b50f25633e16b801b956d075e0747cf7" exitCode=137
Sep 15 07:28:15.650311 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.650305    2568 generic.go:356] "Generic (PLEG): container finished" podID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerID="0f99b7c8532655258917602a85636d7f853ecffc8896d83de21d36ae450e849e" exitCode=137
Sep 15 07:28:15.650805 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.650351    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" event={"ID":"48981ab4-74e9-47e7-9dd9-8458b0735939","Type":"ContainerDied","Data":"e1d15e873cb8431207382cf5254f8db2b50f25633e16b801b956d075e0747cf7"}
Sep 15 07:28:15.650805 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.650392    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" event={"ID":"48981ab4-74e9-47e7-9dd9-8458b0735939","Type":"ContainerDied","Data":"0f99b7c8532655258917602a85636d7f853ecffc8896d83de21d36ae450e849e"}
Sep 15 07:28:15.727166 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.727142    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:28:15.748490 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.748464    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/48981ab4-74e9-47e7-9dd9-8458b0735939-feast-data\") pod \"48981ab4-74e9-47e7-9dd9-8458b0735939\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") "
Sep 15 07:28:15.748628 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.748506    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-ui-tls\") pod \"48981ab4-74e9-47e7-9dd9-8458b0735939\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") "
Sep 15 07:28:15.748628 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.748528    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-offline-tls\") pod \"48981ab4-74e9-47e7-9dd9-8458b0735939\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") "
Sep 15 07:28:15.748628 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.748557    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-registry-tls\") pod \"48981ab4-74e9-47e7-9dd9-8458b0735939\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") "
Sep 15 07:28:15.748628 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.748582    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnndl\" (UniqueName: \"kubernetes.io/projected/48981ab4-74e9-47e7-9dd9-8458b0735939-kube-api-access-tnndl\") pod \"48981ab4-74e9-47e7-9dd9-8458b0735939\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") "
Sep 15 07:28:15.748628 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.748610    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-online-tls\") pod \"48981ab4-74e9-47e7-9dd9-8458b0735939\" (UID: \"48981ab4-74e9-47e7-9dd9-8458b0735939\") "
Sep 15 07:28:15.749200 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.749149    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48981ab4-74e9-47e7-9dd9-8458b0735939-feast-data" (OuterVolumeSpecName: "feast-data") pod "48981ab4-74e9-47e7-9dd9-8458b0735939" (UID: "48981ab4-74e9-47e7-9dd9-8458b0735939"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 07:28:15.751649 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.751604    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "48981ab4-74e9-47e7-9dd9-8458b0735939" (UID: "48981ab4-74e9-47e7-9dd9-8458b0735939"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:28:15.751649 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.751609    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48981ab4-74e9-47e7-9dd9-8458b0735939-kube-api-access-tnndl" (OuterVolumeSpecName: "kube-api-access-tnndl") pod "48981ab4-74e9-47e7-9dd9-8458b0735939" (UID: "48981ab4-74e9-47e7-9dd9-8458b0735939"). InnerVolumeSpecName "kube-api-access-tnndl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:28:15.751863 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.751839    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "48981ab4-74e9-47e7-9dd9-8458b0735939" (UID: "48981ab4-74e9-47e7-9dd9-8458b0735939"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:28:15.752044 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.752011    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "48981ab4-74e9-47e7-9dd9-8458b0735939" (UID: "48981ab4-74e9-47e7-9dd9-8458b0735939"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:28:15.752126 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.752072    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-online-tls" (OuterVolumeSpecName: "online-tls") pod "48981ab4-74e9-47e7-9dd9-8458b0735939" (UID: "48981ab4-74e9-47e7-9dd9-8458b0735939"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:28:15.850182 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.850096    2568 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/48981ab4-74e9-47e7-9dd9-8458b0735939-feast-data\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:28:15.850182 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.850124    2568 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-ui-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:28:15.850182 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.850133    2568 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-offline-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:28:15.850182 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.850141    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-registry-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:28:15.850182 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.850150    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnndl\" (UniqueName: \"kubernetes.io/projected/48981ab4-74e9-47e7-9dd9-8458b0735939-kube-api-access-tnndl\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:28:15.850182 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:15.850158    2568 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/48981ab4-74e9-47e7-9dd9-8458b0735939-online-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:28:16.658496 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:16.658463    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8" event={"ID":"48981ab4-74e9-47e7-9dd9-8458b0735939","Type":"ContainerDied","Data":"b7d7ba3912f9723731cebe1a95c8f64206edbe381baa8a0502e1e287155f3740"}
Sep 15 07:28:16.658496 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:16.658493    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"
Sep 15 07:28:16.659043 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:16.658518    2568 scope.go:117] "RemoveContainer" containerID="b0c2f7c80572e5d92736996e4d9c8afeee939a2db7eb4219e38864355c23d680"
Sep 15 07:28:16.667100 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:16.667082    2568 scope.go:117] "RemoveContainer" containerID="e1d15e873cb8431207382cf5254f8db2b50f25633e16b801b956d075e0747cf7"
Sep 15 07:28:16.674421 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:16.674403    2568 scope.go:117] "RemoveContainer" containerID="4870fc6deaf18db2ccf3df295c96f4234fcc904f94791cc471974042b99bf827"
Sep 15 07:28:16.679691 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:16.679668    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"]
Sep 15 07:28:16.682576 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:16.682561    2568 scope.go:117] "RemoveContainer" containerID="0f99b7c8532655258917602a85636d7f853ecffc8896d83de21d36ae450e849e"
Sep 15 07:28:16.682653 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:16.682620    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhp8"]
Sep 15 07:28:16.690400 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:16.690382    2568 scope.go:117] "RemoveContainer" containerID="200c56210ffa629012a1ccc5ed17f9bd1505764c6f1534fae847981689bdcf30"
Sep 15 07:28:16.697685 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:16.697663    2568 scope.go:117] "RemoveContainer" containerID="56b241c8bc7ba24d322a80fbe35ea4f59d09e0691c15f450fc3a3da2f920bd11"
Sep 15 07:28:16.741394 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:28:16.741363    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" path="/var/lib/kubelet/pods/48981ab4-74e9-47e7-9dd9-8458b0735939/volumes"
Sep 15 07:29:10.286475 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.286433    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"]
Sep 15 07:29:10.286929 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.286913    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="feast-init"
Sep 15 07:29:10.286974 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.286932    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="feast-init"
Sep 15 07:29:10.286974 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.286949    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="online"
Sep 15 07:29:10.286974 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.286958    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="online"
Sep 15 07:29:10.287067 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.286984    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="registry"
Sep 15 07:29:10.287067 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.286993    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="registry"
Sep 15 07:29:10.287067 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.287008    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="feast-apply"
Sep 15 07:29:10.287067 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.287017    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="feast-apply"
Sep 15 07:29:10.287067 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.287028    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="ui"
Sep 15 07:29:10.287067 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.287036    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="ui"
Sep 15 07:29:10.287067 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.287048    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="offline"
Sep 15 07:29:10.287067 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.287056    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="offline"
Sep 15 07:29:10.287312 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.287131    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="registry"
Sep 15 07:29:10.287312 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.287142    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="online"
Sep 15 07:29:10.287312 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.287164    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="offline"
Sep 15 07:29:10.287312 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.287173    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="48981ab4-74e9-47e7-9dd9-8458b0735939" containerName="ui"
Sep 15 07:29:10.291072 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.291053    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:10.293424 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.293402    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 15 07:29:10.293688 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.293668    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-wdl92\""
Sep 15 07:29:10.294275 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.294259    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 15 07:29:10.294380 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.294261    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 15 07:29:10.294446 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.294373    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 15 07:29:10.294446 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.294383    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 15 07:29:10.294557 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.294451    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 15 07:29:10.301036 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.301013    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"]
Sep 15 07:29:10.415793 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.415759    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c8ecfcad-5797-4836-8a02-4326385c6b44-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-dlv4d\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:10.415793 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.415796    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c8ecfcad-5797-4836-8a02-4326385c6b44-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-dlv4d\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:10.416023 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.415830    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c8ecfcad-5797-4836-8a02-4326385c6b44-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-dlv4d\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:10.416023 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.415898    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c8ecfcad-5797-4836-8a02-4326385c6b44-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-dlv4d\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:10.416023 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.415952    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c8ecfcad-5797-4836-8a02-4326385c6b44-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-dlv4d\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:10.416023 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.415978    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xb77\" (UniqueName: \"kubernetes.io/projected/c8ecfcad-5797-4836-8a02-4326385c6b44-kube-api-access-6xb77\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-dlv4d\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:10.516559 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.516523    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c8ecfcad-5797-4836-8a02-4326385c6b44-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-dlv4d\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:10.516786 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.516582    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c8ecfcad-5797-4836-8a02-4326385c6b44-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-dlv4d\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:10.516786 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.516623    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c8ecfcad-5797-4836-8a02-4326385c6b44-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-dlv4d\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:10.516786 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.516645    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xb77\" (UniqueName: \"kubernetes.io/projected/c8ecfcad-5797-4836-8a02-4326385c6b44-kube-api-access-6xb77\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-dlv4d\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:10.516786 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.516708    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c8ecfcad-5797-4836-8a02-4326385c6b44-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-dlv4d\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:10.516786 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.516755    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c8ecfcad-5797-4836-8a02-4326385c6b44-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-dlv4d\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:10.517138 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.517108    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c8ecfcad-5797-4836-8a02-4326385c6b44-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-dlv4d\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:10.517380 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.517351    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c8ecfcad-5797-4836-8a02-4326385c6b44-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-dlv4d\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:10.519070 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.519047    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c8ecfcad-5797-4836-8a02-4326385c6b44-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-dlv4d\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:10.519175 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.519109    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c8ecfcad-5797-4836-8a02-4326385c6b44-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-dlv4d\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:10.519175 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.519129    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c8ecfcad-5797-4836-8a02-4326385c6b44-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-dlv4d\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:10.523900 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.523876    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xb77\" (UniqueName: \"kubernetes.io/projected/c8ecfcad-5797-4836-8a02-4326385c6b44-kube-api-access-6xb77\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-dlv4d\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:10.601970 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.601895    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:10.872823 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.872797    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"]
Sep 15 07:29:10.874423 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:29:10.874393    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8ecfcad_5797_4836_8a02_4326385c6b44.slice/crio-a8c91ab6064c04adb7b8f70728e78ecf5d5589842af36e152e5714801ffe9fbd WatchSource:0}: Error finding container a8c91ab6064c04adb7b8f70728e78ecf5d5589842af36e152e5714801ffe9fbd: Status 404 returned error can't find the container with id a8c91ab6064c04adb7b8f70728e78ecf5d5589842af36e152e5714801ffe9fbd
Sep 15 07:29:10.892090 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:10.892065    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" event={"ID":"c8ecfcad-5797-4836-8a02-4326385c6b44","Type":"ContainerStarted","Data":"a8c91ab6064c04adb7b8f70728e78ecf5d5589842af36e152e5714801ffe9fbd"}
Sep 15 07:29:11.898240 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:11.898204    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" event={"ID":"c8ecfcad-5797-4836-8a02-4326385c6b44","Type":"ContainerStarted","Data":"9f1dfd31c50c3abd9e9cccf528c133769d80eceb734fa0200f3e2115207773ba"}
Sep 15 07:29:15.914667 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:15.914632    2568 generic.go:356] "Generic (PLEG): container finished" podID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerID="9f1dfd31c50c3abd9e9cccf528c133769d80eceb734fa0200f3e2115207773ba" exitCode=0
Sep 15 07:29:15.915046 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:15.914701    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" event={"ID":"c8ecfcad-5797-4836-8a02-4326385c6b44","Type":"ContainerDied","Data":"9f1dfd31c50c3abd9e9cccf528c133769d80eceb734fa0200f3e2115207773ba"}
Sep 15 07:29:16.921152 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:16.921119    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" event={"ID":"c8ecfcad-5797-4836-8a02-4326385c6b44","Type":"ContainerStarted","Data":"0b313dcac24516debe5ce0dc0269cecec42d04ecca84867b6190b471450a2190"}
Sep 15 07:29:39.017920 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:39.017869    2568 generic.go:356] "Generic (PLEG): container finished" podID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerID="0b313dcac24516debe5ce0dc0269cecec42d04ecca84867b6190b471450a2190" exitCode=0
Sep 15 07:29:39.018309 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:39.017943    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" event={"ID":"c8ecfcad-5797-4836-8a02-4326385c6b44","Type":"ContainerDied","Data":"0b313dcac24516debe5ce0dc0269cecec42d04ecca84867b6190b471450a2190"}
Sep 15 07:29:40.026554 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:40.026512    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" event={"ID":"c8ecfcad-5797-4836-8a02-4326385c6b44","Type":"ContainerStarted","Data":"3e0508912df737c754a2a4b7254d56bf3e7000f7f2db6f26b79165ff817e2756"}
Sep 15 07:29:40.026962 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:40.026578    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" event={"ID":"c8ecfcad-5797-4836-8a02-4326385c6b44","Type":"ContainerStarted","Data":"baa27b67d8d5f951eb4ef164bef9fa8611a97855d01e9ffd6bb7ff9b57a3ac9c"}
Sep 15 07:29:40.026962 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:40.026599    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" event={"ID":"c8ecfcad-5797-4836-8a02-4326385c6b44","Type":"ContainerStarted","Data":"c30a13b51d3f9f15e25071fd1687acc51d6ba17b9a63bfebaa857346d3df1067"}
Sep 15 07:29:40.056273 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:40.056219    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" podStartSLOduration=30.056202853 podStartE2EDuration="30.056202853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:29:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:29:40.053598979 +0000 UTC m=+1719.844516812" watchObservedRunningTime="2026-09-15 07:29:40.056202853 +0000 UTC m=+1719.847120674"
Sep 15 07:29:40.602670 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:40.602619    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:40.602890 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:40.602682    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:40.602890 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:40.602700    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:40.602890 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:40.602738    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:40.602890 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:40.602756    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:40.602890 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:40.602769    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:40.604125 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:40.604079    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.41:8443: connect: connection refused"
Sep 15 07:29:40.604125 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:40.604106    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.41:8816: connect: connection refused"
Sep 15 07:29:40.604316 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:40.604130    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="online" probeResult="failure" output="Get \"https://10.132.0.41:6567/health\": dial tcp 10.132.0.41:6567: connect: connection refused"
Sep 15 07:29:43.602198 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:43.602155    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.41:8816: connect: connection refused"
Sep 15 07:29:43.602688 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:43.602223    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="online" probeResult="failure" output="Get \"https://10.132.0.41:6567/health\": dial tcp 10.132.0.41:6567: connect: connection refused"
Sep 15 07:29:43.602688 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:43.602156    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.41:8443: connect: connection refused"
Sep 15 07:29:46.603100 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:46.603049    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.41:8443: connect: connection refused"
Sep 15 07:29:46.603100 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:46.603080    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="online" probeResult="failure" output="Get \"https://10.132.0.41:6567/health\": dial tcp 10.132.0.41:6567: connect: connection refused"
Sep 15 07:29:46.603867 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:46.603847    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:46.604668 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:46.604649    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:49.603530 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:49.603498    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:49.604416 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:49.604391    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:50.368360 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:50.368326    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:51.454338 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:51.454303    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:29:51.606902 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:51.606817    2568 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="online" probeResult="failure" output="Get \"https://10.132.0.41:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 15 07:29:52.458843 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:29:52.458797    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="online" probeResult="failure" output="Get \"https://10.132.0.41:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 15 07:30:52.283451 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:30:52.283414    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"]
Sep 15 07:30:52.283993 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:30:52.283772    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="offline" containerID="cri-o://baa27b67d8d5f951eb4ef164bef9fa8611a97855d01e9ffd6bb7ff9b57a3ac9c" gracePeriod=30
Sep 15 07:30:52.283993 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:30:52.283779    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="ui" containerID="cri-o://3e0508912df737c754a2a4b7254d56bf3e7000f7f2db6f26b79165ff817e2756" gracePeriod=30
Sep 15 07:30:52.283993 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:30:52.283950    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="online" containerID="cri-o://c30a13b51d3f9f15e25071fd1687acc51d6ba17b9a63bfebaa857346d3df1067" gracePeriod=30
Sep 15 07:30:52.456849 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:30:52.456816    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"]
Sep 15 07:30:52.457064 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:30:52.457033    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="registry" containerID="cri-o://f98b10868575d9ee34d1f51f5b675c9fc5716ca4ed5ce5ea0fba3f95cf0145a5" gracePeriod=30
Sep 15 07:30:52.457203 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:30:52.457118    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="offline" containerID="cri-o://e10484c31ef2625c28fc2e938ad310c9ffd604bd8dc97adfc59d53d509ed2fb5" gracePeriod=30
Sep 15 07:30:52.457281 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:30:52.457083    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="ui" containerID="cri-o://f46bf504dff1ec1d4cfce0b2e0e432548f71b15d3d319c7772914fd8a7c33ac0" gracePeriod=30
Sep 15 07:30:52.457281 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:30:52.457109    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="online" containerID="cri-o://dad4a4d711732526912b33be22752d0bddf25704e3a19102fc7fcde1e599bf91" gracePeriod=30
Sep 15 07:30:53.349108 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:30:53.349075    2568 generic.go:356] "Generic (PLEG): container finished" podID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerID="f46bf504dff1ec1d4cfce0b2e0e432548f71b15d3d319c7772914fd8a7c33ac0" exitCode=0
Sep 15 07:30:53.349108 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:30:53.349102    2568 generic.go:356] "Generic (PLEG): container finished" podID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerID="dad4a4d711732526912b33be22752d0bddf25704e3a19102fc7fcde1e599bf91" exitCode=0
Sep 15 07:30:53.349509 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:30:53.349145    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" event={"ID":"180590ee-3bfd-4475-96fb-87ea6dbf9c70","Type":"ContainerDied","Data":"f46bf504dff1ec1d4cfce0b2e0e432548f71b15d3d319c7772914fd8a7c33ac0"}
Sep 15 07:30:53.349509 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:30:53.349187    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" event={"ID":"180590ee-3bfd-4475-96fb-87ea6dbf9c70","Type":"ContainerDied","Data":"dad4a4d711732526912b33be22752d0bddf25704e3a19102fc7fcde1e599bf91"}
Sep 15 07:30:53.351929 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:30:53.351910    2568 generic.go:356] "Generic (PLEG): container finished" podID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerID="3e0508912df737c754a2a4b7254d56bf3e7000f7f2db6f26b79165ff817e2756" exitCode=0
Sep 15 07:30:53.351929 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:30:53.351927    2568 generic.go:356] "Generic (PLEG): container finished" podID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerID="c30a13b51d3f9f15e25071fd1687acc51d6ba17b9a63bfebaa857346d3df1067" exitCode=0
Sep 15 07:30:53.352061 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:30:53.351972    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" event={"ID":"c8ecfcad-5797-4836-8a02-4326385c6b44","Type":"ContainerDied","Data":"3e0508912df737c754a2a4b7254d56bf3e7000f7f2db6f26b79165ff817e2756"}
Sep 15 07:30:53.352061 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:30:53.351999    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" event={"ID":"c8ecfcad-5797-4836-8a02-4326385c6b44","Type":"ContainerDied","Data":"c30a13b51d3f9f15e25071fd1687acc51d6ba17b9a63bfebaa857346d3df1067"}
Sep 15 07:30:57.487639 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:30:57.487594    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.40:8443: connect: connection refused"
Sep 15 07:30:57.614214 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:30:57.614173    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="online" probeResult="failure" output="Get \"https://10.132.0.40:6567/health\": dial tcp 10.132.0.40:6567: connect: connection refused"
Sep 15 07:30:59.604541 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:30:59.604501    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.41:8443: connect: connection refused"
Sep 15 07:31:01.454582 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:01.454542    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="online" probeResult="failure" output="Get \"https://10.132.0.41:6567/health\": dial tcp 10.132.0.41:6567: connect: connection refused"
Sep 15 07:31:07.487126 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:07.487082    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.40:8443: connect: connection refused"
Sep 15 07:31:07.614284 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:07.614251    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="online" probeResult="failure" output="Get \"https://10.132.0.40:6567/health\": dial tcp 10.132.0.40:6567: connect: connection refused"
Sep 15 07:31:09.604414 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:09.604371    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.41:8443: connect: connection refused"
Sep 15 07:31:11.455098 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:11.455056    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="online" probeResult="failure" output="Get \"https://10.132.0.41:6567/health\": dial tcp 10.132.0.41:6567: connect: connection refused"
Sep 15 07:31:17.487146 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:17.487100    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.40:8443: connect: connection refused"
Sep 15 07:31:17.487568 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:17.487227    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:31:17.614620 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:17.614576    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="online" probeResult="failure" output="Get \"https://10.132.0.40:6567/health\": dial tcp 10.132.0.40:6567: connect: connection refused"
Sep 15 07:31:17.614839 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:17.614680    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:31:19.604727 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:19.604670    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.41:8443: connect: connection refused"
Sep 15 07:31:19.605095 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:19.604825    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:31:21.454589 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:21.454547    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="online" probeResult="failure" output="Get \"https://10.132.0.41:6567/health\": dial tcp 10.132.0.41:6567: connect: connection refused"
Sep 15 07:31:21.455002 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:21.454652    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:31:22.480389 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.480359    2568 generic.go:356] "Generic (PLEG): container finished" podID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerID="baa27b67d8d5f951eb4ef164bef9fa8611a97855d01e9ffd6bb7ff9b57a3ac9c" exitCode=137
Sep 15 07:31:22.480774 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.480398    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" event={"ID":"c8ecfcad-5797-4836-8a02-4326385c6b44","Type":"ContainerDied","Data":"baa27b67d8d5f951eb4ef164bef9fa8611a97855d01e9ffd6bb7ff9b57a3ac9c"}
Sep 15 07:31:22.480774 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.480453    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d" event={"ID":"c8ecfcad-5797-4836-8a02-4326385c6b44","Type":"ContainerDied","Data":"a8c91ab6064c04adb7b8f70728e78ecf5d5589842af36e152e5714801ffe9fbd"}
Sep 15 07:31:22.480774 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.480473    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8c91ab6064c04adb7b8f70728e78ecf5d5589842af36e152e5714801ffe9fbd"
Sep 15 07:31:22.487861 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.487835    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:31:22.610354 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.610266    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c8ecfcad-5797-4836-8a02-4326385c6b44-feast-data\") pod \"c8ecfcad-5797-4836-8a02-4326385c6b44\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") "
Sep 15 07:31:22.610354 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.610315    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c8ecfcad-5797-4836-8a02-4326385c6b44-ui-tls\") pod \"c8ecfcad-5797-4836-8a02-4326385c6b44\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") "
Sep 15 07:31:22.610354 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.610352    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c8ecfcad-5797-4836-8a02-4326385c6b44-online-tls\") pod \"c8ecfcad-5797-4836-8a02-4326385c6b44\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") "
Sep 15 07:31:22.610611 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.610371    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xb77\" (UniqueName: \"kubernetes.io/projected/c8ecfcad-5797-4836-8a02-4326385c6b44-kube-api-access-6xb77\") pod \"c8ecfcad-5797-4836-8a02-4326385c6b44\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") "
Sep 15 07:31:22.610611 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.610419    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c8ecfcad-5797-4836-8a02-4326385c6b44-registry-tls\") pod \"c8ecfcad-5797-4836-8a02-4326385c6b44\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") "
Sep 15 07:31:22.610611 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.610466    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c8ecfcad-5797-4836-8a02-4326385c6b44-offline-tls\") pod \"c8ecfcad-5797-4836-8a02-4326385c6b44\" (UID: \"c8ecfcad-5797-4836-8a02-4326385c6b44\") "
Sep 15 07:31:22.610928 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.610902    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8ecfcad-5797-4836-8a02-4326385c6b44-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c8ecfcad-5797-4836-8a02-4326385c6b44" (UID: "c8ecfcad-5797-4836-8a02-4326385c6b44"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 07:31:22.610996 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.610965    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8ecfcad-5797-4836-8a02-4326385c6b44-feast-data" (OuterVolumeSpecName: "feast-data") pod "c8ecfcad-5797-4836-8a02-4326385c6b44" (UID: "c8ecfcad-5797-4836-8a02-4326385c6b44"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 07:31:22.612703 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.612680    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8ecfcad-5797-4836-8a02-4326385c6b44-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "c8ecfcad-5797-4836-8a02-4326385c6b44" (UID: "c8ecfcad-5797-4836-8a02-4326385c6b44"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:31:22.612903 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.612774    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8ecfcad-5797-4836-8a02-4326385c6b44-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "c8ecfcad-5797-4836-8a02-4326385c6b44" (UID: "c8ecfcad-5797-4836-8a02-4326385c6b44"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:31:22.612964 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.612942    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8ecfcad-5797-4836-8a02-4326385c6b44-online-tls" (OuterVolumeSpecName: "online-tls") pod "c8ecfcad-5797-4836-8a02-4326385c6b44" (UID: "c8ecfcad-5797-4836-8a02-4326385c6b44"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:31:22.613016 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.612962    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8ecfcad-5797-4836-8a02-4326385c6b44-kube-api-access-6xb77" (OuterVolumeSpecName: "kube-api-access-6xb77") pod "c8ecfcad-5797-4836-8a02-4326385c6b44" (UID: "c8ecfcad-5797-4836-8a02-4326385c6b44"). InnerVolumeSpecName "kube-api-access-6xb77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:31:22.711298 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.711260    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c8ecfcad-5797-4836-8a02-4326385c6b44-registry-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:31:22.711298 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.711292    2568 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c8ecfcad-5797-4836-8a02-4326385c6b44-offline-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:31:22.711298 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.711303    2568 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c8ecfcad-5797-4836-8a02-4326385c6b44-feast-data\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:31:22.711524 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.711315    2568 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c8ecfcad-5797-4836-8a02-4326385c6b44-ui-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:31:22.711524 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.711327    2568 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c8ecfcad-5797-4836-8a02-4326385c6b44-online-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:31:22.711524 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:22.711338    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xb77\" (UniqueName: \"kubernetes.io/projected/c8ecfcad-5797-4836-8a02-4326385c6b44-kube-api-access-6xb77\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:31:23.104037 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.104011    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:31:23.214927 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.214888    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-online-tls\") pod \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") "
Sep 15 07:31:23.215113 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.214953    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/180590ee-3bfd-4475-96fb-87ea6dbf9c70-feast-data\") pod \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") "
Sep 15 07:31:23.215113 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.214989    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-ui-tls\") pod \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") "
Sep 15 07:31:23.215113 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.215033    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd4gm\" (UniqueName: \"kubernetes.io/projected/180590ee-3bfd-4475-96fb-87ea6dbf9c70-kube-api-access-fd4gm\") pod \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") "
Sep 15 07:31:23.215113 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.215054    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-registry-tls\") pod \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") "
Sep 15 07:31:23.215113 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.215094    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-offline-tls\") pod \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\" (UID: \"180590ee-3bfd-4475-96fb-87ea6dbf9c70\") "
Sep 15 07:31:23.215562 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.215528    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/180590ee-3bfd-4475-96fb-87ea6dbf9c70-feast-data" (OuterVolumeSpecName: "feast-data") pod "180590ee-3bfd-4475-96fb-87ea6dbf9c70" (UID: "180590ee-3bfd-4475-96fb-87ea6dbf9c70"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 07:31:23.217310 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.217277    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/180590ee-3bfd-4475-96fb-87ea6dbf9c70-kube-api-access-fd4gm" (OuterVolumeSpecName: "kube-api-access-fd4gm") pod "180590ee-3bfd-4475-96fb-87ea6dbf9c70" (UID: "180590ee-3bfd-4475-96fb-87ea6dbf9c70"). InnerVolumeSpecName "kube-api-access-fd4gm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:31:23.217415 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.217321    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "180590ee-3bfd-4475-96fb-87ea6dbf9c70" (UID: "180590ee-3bfd-4475-96fb-87ea6dbf9c70"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:31:23.217415 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.217395    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "180590ee-3bfd-4475-96fb-87ea6dbf9c70" (UID: "180590ee-3bfd-4475-96fb-87ea6dbf9c70"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:31:23.217513 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.217483    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-online-tls" (OuterVolumeSpecName: "online-tls") pod "180590ee-3bfd-4475-96fb-87ea6dbf9c70" (UID: "180590ee-3bfd-4475-96fb-87ea6dbf9c70"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:31:23.217663 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.217636    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "180590ee-3bfd-4475-96fb-87ea6dbf9c70" (UID: "180590ee-3bfd-4475-96fb-87ea6dbf9c70"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:31:23.316103 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.316075    2568 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-ui-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:31:23.316103 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.316103    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd4gm\" (UniqueName: \"kubernetes.io/projected/180590ee-3bfd-4475-96fb-87ea6dbf9c70-kube-api-access-fd4gm\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:31:23.316267 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.316115    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-registry-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:31:23.316267 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.316124    2568 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-offline-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:31:23.316267 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.316132    2568 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/180590ee-3bfd-4475-96fb-87ea6dbf9c70-online-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:31:23.316267 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.316139    2568 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/180590ee-3bfd-4475-96fb-87ea6dbf9c70-feast-data\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:31:23.487818 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.487783    2568 generic.go:356] "Generic (PLEG): container finished" podID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerID="e10484c31ef2625c28fc2e938ad310c9ffd604bd8dc97adfc59d53d509ed2fb5" exitCode=137
Sep 15 07:31:23.487818 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.487813    2568 generic.go:356] "Generic (PLEG): container finished" podID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerID="f98b10868575d9ee34d1f51f5b675c9fc5716ca4ed5ce5ea0fba3f95cf0145a5" exitCode=137
Sep 15 07:31:23.488318 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.487848    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"
Sep 15 07:31:23.488318 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.487869    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" event={"ID":"180590ee-3bfd-4475-96fb-87ea6dbf9c70","Type":"ContainerDied","Data":"e10484c31ef2625c28fc2e938ad310c9ffd604bd8dc97adfc59d53d509ed2fb5"}
Sep 15 07:31:23.488318 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.487918    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" event={"ID":"180590ee-3bfd-4475-96fb-87ea6dbf9c70","Type":"ContainerDied","Data":"f98b10868575d9ee34d1f51f5b675c9fc5716ca4ed5ce5ea0fba3f95cf0145a5"}
Sep 15 07:31:23.488318 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.487933    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw" event={"ID":"180590ee-3bfd-4475-96fb-87ea6dbf9c70","Type":"ContainerDied","Data":"3c8ab24e926e9861a6dd9079d5e7001c5752850afcbaed2e5e3ac2c71a31b02c"}
Sep 15 07:31:23.488318 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.487952    2568 scope.go:117] "RemoveContainer" containerID="f46bf504dff1ec1d4cfce0b2e0e432548f71b15d3d319c7772914fd8a7c33ac0"
Sep 15 07:31:23.488318 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.488121    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"
Sep 15 07:31:23.496725 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.496692    2568 scope.go:117] "RemoveContainer" containerID="e10484c31ef2625c28fc2e938ad310c9ffd604bd8dc97adfc59d53d509ed2fb5"
Sep 15 07:31:23.504817 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.504787    2568 scope.go:117] "RemoveContainer" containerID="dad4a4d711732526912b33be22752d0bddf25704e3a19102fc7fcde1e599bf91"
Sep 15 07:31:23.505640 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.505618    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"]
Sep 15 07:31:23.509353 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.509332    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-dlv4d"]
Sep 15 07:31:23.513422 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.513403    2568 scope.go:117] "RemoveContainer" containerID="f98b10868575d9ee34d1f51f5b675c9fc5716ca4ed5ce5ea0fba3f95cf0145a5"
Sep 15 07:31:23.519810 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.519787    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"]
Sep 15 07:31:23.521045 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.521031    2568 scope.go:117] "RemoveContainer" containerID="2540b0170b4fee0fc7b9ddcdbcd0114a95865e4107ad220ccbd55dca8d1f553c"
Sep 15 07:31:23.523232 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.523210    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bkhw"]
Sep 15 07:31:23.528537 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.528513    2568 scope.go:117] "RemoveContainer" containerID="44cd43d135a344e8843cb9fd0b6fdd918c2491b0f9446cbc7a33d041c004f2b6"
Sep 15 07:31:23.535551 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.535537    2568 scope.go:117] "RemoveContainer" containerID="f46bf504dff1ec1d4cfce0b2e0e432548f71b15d3d319c7772914fd8a7c33ac0"
Sep 15 07:31:23.535841 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:31:23.535824    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f46bf504dff1ec1d4cfce0b2e0e432548f71b15d3d319c7772914fd8a7c33ac0\": container with ID starting with f46bf504dff1ec1d4cfce0b2e0e432548f71b15d3d319c7772914fd8a7c33ac0 not found: ID does not exist" containerID="f46bf504dff1ec1d4cfce0b2e0e432548f71b15d3d319c7772914fd8a7c33ac0"
Sep 15 07:31:23.535890 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.535848    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f46bf504dff1ec1d4cfce0b2e0e432548f71b15d3d319c7772914fd8a7c33ac0"} err="failed to get container status \"f46bf504dff1ec1d4cfce0b2e0e432548f71b15d3d319c7772914fd8a7c33ac0\": rpc error: code = NotFound desc = could not find container \"f46bf504dff1ec1d4cfce0b2e0e432548f71b15d3d319c7772914fd8a7c33ac0\": container with ID starting with f46bf504dff1ec1d4cfce0b2e0e432548f71b15d3d319c7772914fd8a7c33ac0 not found: ID does not exist"
Sep 15 07:31:23.535890 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.535865    2568 scope.go:117] "RemoveContainer" containerID="e10484c31ef2625c28fc2e938ad310c9ffd604bd8dc97adfc59d53d509ed2fb5"
Sep 15 07:31:23.536112 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:31:23.536093    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e10484c31ef2625c28fc2e938ad310c9ffd604bd8dc97adfc59d53d509ed2fb5\": container with ID starting with e10484c31ef2625c28fc2e938ad310c9ffd604bd8dc97adfc59d53d509ed2fb5 not found: ID does not exist" containerID="e10484c31ef2625c28fc2e938ad310c9ffd604bd8dc97adfc59d53d509ed2fb5"
Sep 15 07:31:23.536180 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.536120    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e10484c31ef2625c28fc2e938ad310c9ffd604bd8dc97adfc59d53d509ed2fb5"} err="failed to get container status \"e10484c31ef2625c28fc2e938ad310c9ffd604bd8dc97adfc59d53d509ed2fb5\": rpc error: code = NotFound desc = could not find container \"e10484c31ef2625c28fc2e938ad310c9ffd604bd8dc97adfc59d53d509ed2fb5\": container with ID starting with e10484c31ef2625c28fc2e938ad310c9ffd604bd8dc97adfc59d53d509ed2fb5 not found: ID does not exist"
Sep 15 07:31:23.536180 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.536143    2568 scope.go:117] "RemoveContainer" containerID="dad4a4d711732526912b33be22752d0bddf25704e3a19102fc7fcde1e599bf91"
Sep 15 07:31:23.536356 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:31:23.536342    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dad4a4d711732526912b33be22752d0bddf25704e3a19102fc7fcde1e599bf91\": container with ID starting with dad4a4d711732526912b33be22752d0bddf25704e3a19102fc7fcde1e599bf91 not found: ID does not exist" containerID="dad4a4d711732526912b33be22752d0bddf25704e3a19102fc7fcde1e599bf91"
Sep 15 07:31:23.536396 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.536360    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad4a4d711732526912b33be22752d0bddf25704e3a19102fc7fcde1e599bf91"} err="failed to get container status \"dad4a4d711732526912b33be22752d0bddf25704e3a19102fc7fcde1e599bf91\": rpc error: code = NotFound desc = could not find container \"dad4a4d711732526912b33be22752d0bddf25704e3a19102fc7fcde1e599bf91\": container with ID starting with dad4a4d711732526912b33be22752d0bddf25704e3a19102fc7fcde1e599bf91 not found: ID does not exist"
Sep 15 07:31:23.536396 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.536372    2568 scope.go:117] "RemoveContainer" containerID="f98b10868575d9ee34d1f51f5b675c9fc5716ca4ed5ce5ea0fba3f95cf0145a5"
Sep 15 07:31:23.536578 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:31:23.536560    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f98b10868575d9ee34d1f51f5b675c9fc5716ca4ed5ce5ea0fba3f95cf0145a5\": container with ID starting with f98b10868575d9ee34d1f51f5b675c9fc5716ca4ed5ce5ea0fba3f95cf0145a5 not found: ID does not exist" containerID="f98b10868575d9ee34d1f51f5b675c9fc5716ca4ed5ce5ea0fba3f95cf0145a5"
Sep 15 07:31:23.536624 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.536581    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f98b10868575d9ee34d1f51f5b675c9fc5716ca4ed5ce5ea0fba3f95cf0145a5"} err="failed to get container status \"f98b10868575d9ee34d1f51f5b675c9fc5716ca4ed5ce5ea0fba3f95cf0145a5\": rpc error: code = NotFound desc = could not find container \"f98b10868575d9ee34d1f51f5b675c9fc5716ca4ed5ce5ea0fba3f95cf0145a5\": container with ID starting with f98b10868575d9ee34d1f51f5b675c9fc5716ca4ed5ce5ea0fba3f95cf0145a5 not found: ID does not exist"
Sep 15 07:31:23.536624 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.536594    2568 scope.go:117] "RemoveContainer" containerID="2540b0170b4fee0fc7b9ddcdbcd0114a95865e4107ad220ccbd55dca8d1f553c"
Sep 15 07:31:23.536806 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:31:23.536791    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2540b0170b4fee0fc7b9ddcdbcd0114a95865e4107ad220ccbd55dca8d1f553c\": container with ID starting with 2540b0170b4fee0fc7b9ddcdbcd0114a95865e4107ad220ccbd55dca8d1f553c not found: ID does not exist" containerID="2540b0170b4fee0fc7b9ddcdbcd0114a95865e4107ad220ccbd55dca8d1f553c"
Sep 15 07:31:23.536870 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.536808    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2540b0170b4fee0fc7b9ddcdbcd0114a95865e4107ad220ccbd55dca8d1f553c"} err="failed to get container status \"2540b0170b4fee0fc7b9ddcdbcd0114a95865e4107ad220ccbd55dca8d1f553c\": rpc error: code = NotFound desc = could not find container \"2540b0170b4fee0fc7b9ddcdbcd0114a95865e4107ad220ccbd55dca8d1f553c\": container with ID starting with 2540b0170b4fee0fc7b9ddcdbcd0114a95865e4107ad220ccbd55dca8d1f553c not found: ID does not exist"
Sep 15 07:31:23.536870 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.536820    2568 scope.go:117] "RemoveContainer" containerID="44cd43d135a344e8843cb9fd0b6fdd918c2491b0f9446cbc7a33d041c004f2b6"
Sep 15 07:31:23.537053 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:31:23.537033    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44cd43d135a344e8843cb9fd0b6fdd918c2491b0f9446cbc7a33d041c004f2b6\": container with ID starting with 44cd43d135a344e8843cb9fd0b6fdd918c2491b0f9446cbc7a33d041c004f2b6 not found: ID does not exist" containerID="44cd43d135a344e8843cb9fd0b6fdd918c2491b0f9446cbc7a33d041c004f2b6"
Sep 15 07:31:23.537124 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.537060    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44cd43d135a344e8843cb9fd0b6fdd918c2491b0f9446cbc7a33d041c004f2b6"} err="failed to get container status \"44cd43d135a344e8843cb9fd0b6fdd918c2491b0f9446cbc7a33d041c004f2b6\": rpc error: code = NotFound desc = could not find container \"44cd43d135a344e8843cb9fd0b6fdd918c2491b0f9446cbc7a33d041c004f2b6\": container with ID starting with 44cd43d135a344e8843cb9fd0b6fdd918c2491b0f9446cbc7a33d041c004f2b6 not found: ID does not exist"
Sep 15 07:31:23.537124 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.537078    2568 scope.go:117] "RemoveContainer" containerID="f46bf504dff1ec1d4cfce0b2e0e432548f71b15d3d319c7772914fd8a7c33ac0"
Sep 15 07:31:23.537328 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.537309    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f46bf504dff1ec1d4cfce0b2e0e432548f71b15d3d319c7772914fd8a7c33ac0"} err="failed to get container status \"f46bf504dff1ec1d4cfce0b2e0e432548f71b15d3d319c7772914fd8a7c33ac0\": rpc error: code = NotFound desc = could not find container \"f46bf504dff1ec1d4cfce0b2e0e432548f71b15d3d319c7772914fd8a7c33ac0\": container with ID starting with f46bf504dff1ec1d4cfce0b2e0e432548f71b15d3d319c7772914fd8a7c33ac0 not found: ID does not exist"
Sep 15 07:31:23.537371 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.537336    2568 scope.go:117] "RemoveContainer" containerID="e10484c31ef2625c28fc2e938ad310c9ffd604bd8dc97adfc59d53d509ed2fb5"
Sep 15 07:31:23.537528 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.537514    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e10484c31ef2625c28fc2e938ad310c9ffd604bd8dc97adfc59d53d509ed2fb5"} err="failed to get container status \"e10484c31ef2625c28fc2e938ad310c9ffd604bd8dc97adfc59d53d509ed2fb5\": rpc error: code = NotFound desc = could not find container \"e10484c31ef2625c28fc2e938ad310c9ffd604bd8dc97adfc59d53d509ed2fb5\": container with ID starting with e10484c31ef2625c28fc2e938ad310c9ffd604bd8dc97adfc59d53d509ed2fb5 not found: ID does not exist"
Sep 15 07:31:23.537570 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.537527    2568 scope.go:117] "RemoveContainer" containerID="dad4a4d711732526912b33be22752d0bddf25704e3a19102fc7fcde1e599bf91"
Sep 15 07:31:23.537753 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.537735    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad4a4d711732526912b33be22752d0bddf25704e3a19102fc7fcde1e599bf91"} err="failed to get container status \"dad4a4d711732526912b33be22752d0bddf25704e3a19102fc7fcde1e599bf91\": rpc error: code = NotFound desc = could not find container \"dad4a4d711732526912b33be22752d0bddf25704e3a19102fc7fcde1e599bf91\": container with ID starting with dad4a4d711732526912b33be22752d0bddf25704e3a19102fc7fcde1e599bf91 not found: ID does not exist"
Sep 15 07:31:23.537834 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.537754    2568 scope.go:117] "RemoveContainer" containerID="f98b10868575d9ee34d1f51f5b675c9fc5716ca4ed5ce5ea0fba3f95cf0145a5"
Sep 15 07:31:23.537967 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.537948    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f98b10868575d9ee34d1f51f5b675c9fc5716ca4ed5ce5ea0fba3f95cf0145a5"} err="failed to get container status \"f98b10868575d9ee34d1f51f5b675c9fc5716ca4ed5ce5ea0fba3f95cf0145a5\": rpc error: code = NotFound desc = could not find container \"f98b10868575d9ee34d1f51f5b675c9fc5716ca4ed5ce5ea0fba3f95cf0145a5\": container with ID starting with f98b10868575d9ee34d1f51f5b675c9fc5716ca4ed5ce5ea0fba3f95cf0145a5 not found: ID does not exist"
Sep 15 07:31:23.538034 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.537982    2568 scope.go:117] "RemoveContainer" containerID="2540b0170b4fee0fc7b9ddcdbcd0114a95865e4107ad220ccbd55dca8d1f553c"
Sep 15 07:31:23.538224 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.538206    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2540b0170b4fee0fc7b9ddcdbcd0114a95865e4107ad220ccbd55dca8d1f553c"} err="failed to get container status \"2540b0170b4fee0fc7b9ddcdbcd0114a95865e4107ad220ccbd55dca8d1f553c\": rpc error: code = NotFound desc = could not find container \"2540b0170b4fee0fc7b9ddcdbcd0114a95865e4107ad220ccbd55dca8d1f553c\": container with ID starting with 2540b0170b4fee0fc7b9ddcdbcd0114a95865e4107ad220ccbd55dca8d1f553c not found: ID does not exist"
Sep 15 07:31:23.538266 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.538224    2568 scope.go:117] "RemoveContainer" containerID="44cd43d135a344e8843cb9fd0b6fdd918c2491b0f9446cbc7a33d041c004f2b6"
Sep 15 07:31:23.538445 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:23.538422    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44cd43d135a344e8843cb9fd0b6fdd918c2491b0f9446cbc7a33d041c004f2b6"} err="failed to get container status \"44cd43d135a344e8843cb9fd0b6fdd918c2491b0f9446cbc7a33d041c004f2b6\": rpc error: code = NotFound desc = could not find container \"44cd43d135a344e8843cb9fd0b6fdd918c2491b0f9446cbc7a33d041c004f2b6\": container with ID starting with 44cd43d135a344e8843cb9fd0b6fdd918c2491b0f9446cbc7a33d041c004f2b6 not found: ID does not exist"
Sep 15 07:31:24.741647 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:24.741614    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" path="/var/lib/kubelet/pods/180590ee-3bfd-4475-96fb-87ea6dbf9c70/volumes"
Sep 15 07:31:24.742253 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:24.742237    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" path="/var/lib/kubelet/pods/c8ecfcad-5797-4836-8a02-4326385c6b44/volumes"
Sep 15 07:31:41.144837 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.144805    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jtztc/must-gather-hjcvt"]
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145177    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="registry"
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145189    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="registry"
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145198    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="online"
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145204    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="online"
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145213    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="feast-init"
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145219    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="feast-init"
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145225    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="feast-apply"
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145229    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="feast-apply"
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145242    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="ui"
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145250    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="ui"
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145256    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="feast-init"
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145262    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="feast-init"
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145270    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="ui"
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145275    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="ui"
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145284    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="online"
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145289    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="online"
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145296    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="offline"
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145302    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="offline"
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145313    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="feast-apply"
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145321    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="feast-apply"
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145332    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="offline"
Sep 15 07:31:41.145355 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145336    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="offline"
Sep 15 07:31:41.146211 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145386    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="offline"
Sep 15 07:31:41.146211 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145396    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="online"
Sep 15 07:31:41.146211 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145407    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="online"
Sep 15 07:31:41.146211 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145415    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="ui"
Sep 15 07:31:41.146211 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145422    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="registry"
Sep 15 07:31:41.146211 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145429    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="180590ee-3bfd-4475-96fb-87ea6dbf9c70" containerName="offline"
Sep 15 07:31:41.146211 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.145438    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8ecfcad-5797-4836-8a02-4326385c6b44" containerName="ui"
Sep 15 07:31:41.148642 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.148615    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jtztc/must-gather-hjcvt"
Sep 15 07:31:41.150682 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.150663    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jtztc\"/\"openshift-service-ca.crt\""
Sep 15 07:31:41.151342 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.151322    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jtztc\"/\"default-dockercfg-ws5zm\""
Sep 15 07:31:41.151429 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.151341    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jtztc\"/\"kube-root-ca.crt\""
Sep 15 07:31:41.155987 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.155966    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jtztc/must-gather-hjcvt"]
Sep 15 07:31:41.257258 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.257225    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5e99c28e-4636-4cb9-ad56-e34fe76b970a-must-gather-output\") pod \"must-gather-hjcvt\" (UID: \"5e99c28e-4636-4cb9-ad56-e34fe76b970a\") " pod="openshift-must-gather-jtztc/must-gather-hjcvt"
Sep 15 07:31:41.257416 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.257270    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rplw\" (UniqueName: \"kubernetes.io/projected/5e99c28e-4636-4cb9-ad56-e34fe76b970a-kube-api-access-2rplw\") pod \"must-gather-hjcvt\" (UID: \"5e99c28e-4636-4cb9-ad56-e34fe76b970a\") " pod="openshift-must-gather-jtztc/must-gather-hjcvt"
Sep 15 07:31:41.358700 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.358668    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5e99c28e-4636-4cb9-ad56-e34fe76b970a-must-gather-output\") pod \"must-gather-hjcvt\" (UID: \"5e99c28e-4636-4cb9-ad56-e34fe76b970a\") " pod="openshift-must-gather-jtztc/must-gather-hjcvt"
Sep 15 07:31:41.358700 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.358704    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rplw\" (UniqueName: \"kubernetes.io/projected/5e99c28e-4636-4cb9-ad56-e34fe76b970a-kube-api-access-2rplw\") pod \"must-gather-hjcvt\" (UID: \"5e99c28e-4636-4cb9-ad56-e34fe76b970a\") " pod="openshift-must-gather-jtztc/must-gather-hjcvt"
Sep 15 07:31:41.359004 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.358986    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5e99c28e-4636-4cb9-ad56-e34fe76b970a-must-gather-output\") pod \"must-gather-hjcvt\" (UID: \"5e99c28e-4636-4cb9-ad56-e34fe76b970a\") " pod="openshift-must-gather-jtztc/must-gather-hjcvt"
Sep 15 07:31:41.365790 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.365761    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rplw\" (UniqueName: \"kubernetes.io/projected/5e99c28e-4636-4cb9-ad56-e34fe76b970a-kube-api-access-2rplw\") pod \"must-gather-hjcvt\" (UID: \"5e99c28e-4636-4cb9-ad56-e34fe76b970a\") " pod="openshift-must-gather-jtztc/must-gather-hjcvt"
Sep 15 07:31:41.469109 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.469082    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jtztc/must-gather-hjcvt"
Sep 15 07:31:41.735354 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.735279    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jtztc/must-gather-hjcvt"]
Sep 15 07:31:41.739554 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:31:41.739528    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e99c28e_4636_4cb9_ad56_e34fe76b970a.slice/crio-00a4e5b49a387f6ae34b4ce91f0ef5b74a3023e55fe2ca0aee89629b160c5a6e WatchSource:0}: Error finding container 00a4e5b49a387f6ae34b4ce91f0ef5b74a3023e55fe2ca0aee89629b160c5a6e: Status 404 returned error can't find the container with id 00a4e5b49a387f6ae34b4ce91f0ef5b74a3023e55fe2ca0aee89629b160c5a6e
Sep 15 07:31:41.741316 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:41.741295    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 07:31:42.569361 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:42.569310    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jtztc/must-gather-hjcvt" event={"ID":"5e99c28e-4636-4cb9-ad56-e34fe76b970a","Type":"ContainerStarted","Data":"00a4e5b49a387f6ae34b4ce91f0ef5b74a3023e55fe2ca0aee89629b160c5a6e"}
Sep 15 07:31:48.602673 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:48.602583    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jtztc/must-gather-hjcvt" event={"ID":"5e99c28e-4636-4cb9-ad56-e34fe76b970a","Type":"ContainerStarted","Data":"4b2bb4a9dd625d4374a2eeb1675789d147c68fc98109d66d3eb3ce90bbf6d6ff"}
Sep 15 07:31:48.602673 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:48.602631    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jtztc/must-gather-hjcvt" event={"ID":"5e99c28e-4636-4cb9-ad56-e34fe76b970a","Type":"ContainerStarted","Data":"df51edbfee153bc2ffe7d361deddae27b62311298f6b66cfc6e13112281147e4"}
Sep 15 07:31:48.617533 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:48.617480    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jtztc/must-gather-hjcvt" podStartSLOduration=1.391763145 podStartE2EDuration="7.617462288s" totalImagesPullingTime="6.225699143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:31:48.616043385 +0000 UTC m=+1848.406961207" watchObservedRunningTime="2026-09-15 07:31:48.617462288 +0000 UTC m=+1848.408380109"
Sep 15 07:31:57.644956 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:57.644928    2568 generic.go:356] "Generic (PLEG): container finished" podID="5e99c28e-4636-4cb9-ad56-e34fe76b970a" containerID="df51edbfee153bc2ffe7d361deddae27b62311298f6b66cfc6e13112281147e4" exitCode=0
Sep 15 07:31:57.645319 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:57.644985    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jtztc/must-gather-hjcvt" event={"ID":"5e99c28e-4636-4cb9-ad56-e34fe76b970a","Type":"ContainerDied","Data":"df51edbfee153bc2ffe7d361deddae27b62311298f6b66cfc6e13112281147e4"}
Sep 15 07:31:57.645319 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:57.645273    2568 scope.go:117] "RemoveContainer" containerID="df51edbfee153bc2ffe7d361deddae27b62311298f6b66cfc6e13112281147e4"
Sep 15 07:31:58.608264 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:31:58.608226    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-jtztc_must-gather-hjcvt_5e99c28e-4636-4cb9-ad56-e34fe76b970a/gather/0.log"
Sep 15 07:32:02.138796 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:02.138747    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dzpwd_7eaabe27-7956-4d37-abaa-d28ac2e47447/global-pull-secret-syncer/0.log"
Sep 15 07:32:02.322260 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:02.322229    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h5zdl_fbc008a1-b0d8-45d4-aa3a-adf819a127af/konnectivity-agent/0.log"
Sep 15 07:32:02.340259 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:02.340231    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-10.ec2.internal_1f1ba8a42accaebaa2593b3b48d06684/haproxy/0.log"
Sep 15 07:32:03.937224 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:03.937189    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-jtztc/must-gather-hjcvt"]
Sep 15 07:32:03.937655 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:03.937373    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-jtztc/must-gather-hjcvt" podUID="5e99c28e-4636-4cb9-ad56-e34fe76b970a" containerName="copy" containerID="cri-o://4b2bb4a9dd625d4374a2eeb1675789d147c68fc98109d66d3eb3ce90bbf6d6ff" gracePeriod=2
Sep 15 07:32:03.941529 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:03.941300    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-jtztc/must-gather-hjcvt"]
Sep 15 07:32:04.168475 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:04.168455    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-jtztc_must-gather-hjcvt_5e99c28e-4636-4cb9-ad56-e34fe76b970a/copy/0.log"
Sep 15 07:32:04.171073 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:04.171050    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jtztc/must-gather-hjcvt"
Sep 15 07:32:04.172859 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:32:04.172835    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-hjcvt\" is forbidden: User \"system:node:ip-10-0-129-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-jtztc\": no relationship found between node 'ip-10-0-129-10.ec2.internal' and this object" podUID="5e99c28e-4636-4cb9-ad56-e34fe76b970a" pod="openshift-must-gather-jtztc/must-gather-hjcvt"
Sep 15 07:32:04.246934 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:04.246863    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rplw\" (UniqueName: \"kubernetes.io/projected/5e99c28e-4636-4cb9-ad56-e34fe76b970a-kube-api-access-2rplw\") pod \"5e99c28e-4636-4cb9-ad56-e34fe76b970a\" (UID: \"5e99c28e-4636-4cb9-ad56-e34fe76b970a\") "
Sep 15 07:32:04.246934 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:04.246931    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5e99c28e-4636-4cb9-ad56-e34fe76b970a-must-gather-output\") pod \"5e99c28e-4636-4cb9-ad56-e34fe76b970a\" (UID: \"5e99c28e-4636-4cb9-ad56-e34fe76b970a\") "
Sep 15 07:32:04.247323 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:04.247299    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e99c28e-4636-4cb9-ad56-e34fe76b970a-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "5e99c28e-4636-4cb9-ad56-e34fe76b970a" (UID: "5e99c28e-4636-4cb9-ad56-e34fe76b970a"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 07:32:04.249248 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:04.249228    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e99c28e-4636-4cb9-ad56-e34fe76b970a-kube-api-access-2rplw" (OuterVolumeSpecName: "kube-api-access-2rplw") pod "5e99c28e-4636-4cb9-ad56-e34fe76b970a" (UID: "5e99c28e-4636-4cb9-ad56-e34fe76b970a"). InnerVolumeSpecName "kube-api-access-2rplw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:32:04.348300 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:04.348255    2568 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5e99c28e-4636-4cb9-ad56-e34fe76b970a-must-gather-output\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:32:04.348300 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:04.348288    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rplw\" (UniqueName: \"kubernetes.io/projected/5e99c28e-4636-4cb9-ad56-e34fe76b970a-kube-api-access-2rplw\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Sep 15 07:32:04.676453 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:04.676425    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-jtztc_must-gather-hjcvt_5e99c28e-4636-4cb9-ad56-e34fe76b970a/copy/0.log"
Sep 15 07:32:04.676854 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:04.676830    2568 generic.go:356] "Generic (PLEG): container finished" podID="5e99c28e-4636-4cb9-ad56-e34fe76b970a" containerID="4b2bb4a9dd625d4374a2eeb1675789d147c68fc98109d66d3eb3ce90bbf6d6ff" exitCode=143
Sep 15 07:32:04.676912 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:04.676881    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jtztc/must-gather-hjcvt"
Sep 15 07:32:04.676965 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:04.676890    2568 scope.go:117] "RemoveContainer" containerID="4b2bb4a9dd625d4374a2eeb1675789d147c68fc98109d66d3eb3ce90bbf6d6ff"
Sep 15 07:32:04.678871 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:32:04.678843    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-hjcvt\" is forbidden: User \"system:node:ip-10-0-129-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-jtztc\": no relationship found between node 'ip-10-0-129-10.ec2.internal' and this object" podUID="5e99c28e-4636-4cb9-ad56-e34fe76b970a" pod="openshift-must-gather-jtztc/must-gather-hjcvt"
Sep 15 07:32:04.685159 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:04.685141    2568 scope.go:117] "RemoveContainer" containerID="df51edbfee153bc2ffe7d361deddae27b62311298f6b66cfc6e13112281147e4"
Sep 15 07:32:04.686985 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:32:04.686955    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-hjcvt\" is forbidden: User \"system:node:ip-10-0-129-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-jtztc\": no relationship found between node 'ip-10-0-129-10.ec2.internal' and this object" podUID="5e99c28e-4636-4cb9-ad56-e34fe76b970a" pod="openshift-must-gather-jtztc/must-gather-hjcvt"
Sep 15 07:32:04.697217 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:04.697193    2568 scope.go:117] "RemoveContainer" containerID="4b2bb4a9dd625d4374a2eeb1675789d147c68fc98109d66d3eb3ce90bbf6d6ff"
Sep 15 07:32:04.697510 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:32:04.697488    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b2bb4a9dd625d4374a2eeb1675789d147c68fc98109d66d3eb3ce90bbf6d6ff\": container with ID starting with 4b2bb4a9dd625d4374a2eeb1675789d147c68fc98109d66d3eb3ce90bbf6d6ff not found: ID does not exist" containerID="4b2bb4a9dd625d4374a2eeb1675789d147c68fc98109d66d3eb3ce90bbf6d6ff"
Sep 15 07:32:04.697587 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:04.697519    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b2bb4a9dd625d4374a2eeb1675789d147c68fc98109d66d3eb3ce90bbf6d6ff"} err="failed to get container status \"4b2bb4a9dd625d4374a2eeb1675789d147c68fc98109d66d3eb3ce90bbf6d6ff\": rpc error: code = NotFound desc = could not find container \"4b2bb4a9dd625d4374a2eeb1675789d147c68fc98109d66d3eb3ce90bbf6d6ff\": container with ID starting with 4b2bb4a9dd625d4374a2eeb1675789d147c68fc98109d66d3eb3ce90bbf6d6ff not found: ID does not exist"
Sep 15 07:32:04.697587 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:04.697538    2568 scope.go:117] "RemoveContainer" containerID="df51edbfee153bc2ffe7d361deddae27b62311298f6b66cfc6e13112281147e4"
Sep 15 07:32:04.697823 ip-10-0-129-10 kubenswrapper[2568]: E0915 07:32:04.697808    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df51edbfee153bc2ffe7d361deddae27b62311298f6b66cfc6e13112281147e4\": container with ID starting with df51edbfee153bc2ffe7d361deddae27b62311298f6b66cfc6e13112281147e4 not found: ID does not exist" containerID="df51edbfee153bc2ffe7d361deddae27b62311298f6b66cfc6e13112281147e4"
Sep 15 07:32:04.697883 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:04.697825    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df51edbfee153bc2ffe7d361deddae27b62311298f6b66cfc6e13112281147e4"} err="failed to get container status \"df51edbfee153bc2ffe7d361deddae27b62311298f6b66cfc6e13112281147e4\": rpc error: code = NotFound desc = could not find container \"df51edbfee153bc2ffe7d361deddae27b62311298f6b66cfc6e13112281147e4\": container with ID starting with df51edbfee153bc2ffe7d361deddae27b62311298f6b66cfc6e13112281147e4 not found: ID does not exist"
Sep 15 07:32:04.741262 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:04.741235    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e99c28e-4636-4cb9-ad56-e34fe76b970a" path="/var/lib/kubelet/pods/5e99c28e-4636-4cb9-ad56-e34fe76b970a/volumes"
Sep 15 07:32:05.972730 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:05.972686    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5/alertmanager/0.log"
Sep 15 07:32:06.006818 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:06.006790    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5/config-reloader/0.log"
Sep 15 07:32:06.046550 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:06.046511    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5/kube-rbac-proxy-web/0.log"
Sep 15 07:32:06.085305 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:06.085281    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5/kube-rbac-proxy/0.log"
Sep 15 07:32:06.110441 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:06.110413    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5/kube-rbac-proxy-metric/0.log"
Sep 15 07:32:06.133829 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:06.133810    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5/prom-label-proxy/0.log"
Sep 15 07:32:06.160706 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:06.160683    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c2dc3a6-aa78-4aeb-8a26-acb838ea81d5/init-config-reloader/0.log"
Sep 15 07:32:06.369770 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:06.369744    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4qbl5_84bb02b4-6541-4aa5-b13d-e1dd1c181977/node-exporter/0.log"
Sep 15 07:32:06.392029 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:06.392002    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4qbl5_84bb02b4-6541-4aa5-b13d-e1dd1c181977/kube-rbac-proxy/0.log"
Sep 15 07:32:06.414057 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:06.414037    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4qbl5_84bb02b4-6541-4aa5-b13d-e1dd1c181977/init-textfile/0.log"
Sep 15 07:32:06.602412 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:06.602380    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-jjmrn_9ab36021-eea1-424a-9e63-84c45ea557ef/kube-rbac-proxy-main/0.log"
Sep 15 07:32:06.622291 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:06.622216    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-jjmrn_9ab36021-eea1-424a-9e63-84c45ea557ef/kube-rbac-proxy-self/0.log"
Sep 15 07:32:06.642304 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:06.642275    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-jjmrn_9ab36021-eea1-424a-9e63-84c45ea557ef/openshift-state-metrics/0.log"
Sep 15 07:32:06.931435 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:06.931382    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d7ccf8f5b-r5gqq_765da131-7b50-4cac-b922-f11249472394/telemeter-client/0.log"
Sep 15 07:32:06.967099 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:06.967071    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d7ccf8f5b-r5gqq_765da131-7b50-4cac-b922-f11249472394/reload/0.log"
Sep 15 07:32:07.004073 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:07.004040    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d7ccf8f5b-r5gqq_765da131-7b50-4cac-b922-f11249472394/kube-rbac-proxy/0.log"
Sep 15 07:32:07.057378 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:07.057343    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ffd4d9f94-mwf2f_846145ce-5668-4682-920a-64532767e101/thanos-query/0.log"
Sep 15 07:32:07.097023 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:07.096994    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ffd4d9f94-mwf2f_846145ce-5668-4682-920a-64532767e101/kube-rbac-proxy-web/0.log"
Sep 15 07:32:07.132161 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:07.132137    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ffd4d9f94-mwf2f_846145ce-5668-4682-920a-64532767e101/kube-rbac-proxy/0.log"
Sep 15 07:32:07.168849 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:07.168825    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ffd4d9f94-mwf2f_846145ce-5668-4682-920a-64532767e101/prom-label-proxy/0.log"
Sep 15 07:32:07.209086 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:07.209013    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ffd4d9f94-mwf2f_846145ce-5668-4682-920a-64532767e101/kube-rbac-proxy-rules/0.log"
Sep 15 07:32:07.246948 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:07.246924    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ffd4d9f94-mwf2f_846145ce-5668-4682-920a-64532767e101/kube-rbac-proxy-metrics/0.log"
Sep 15 07:32:08.583141 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:08.583111    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-bz528_16f5f861-0b53-462e-bb9b-4727524236ba/networking-console-plugin/0.log"
Sep 15 07:32:09.576677 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:09.576649    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-jfxld_4803d979-5738-459d-9aab-27bd1d842697/download-server/0.log"
Sep 15 07:32:10.060432 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.060396    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-5blq6_05e7b838-09d8-41bf-be7e-b9baa6bb106f/volume-data-source-validator/0.log"
Sep 15 07:32:10.190943 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.190906    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"]
Sep 15 07:32:10.191257 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.191243    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e99c28e-4636-4cb9-ad56-e34fe76b970a" containerName="copy"
Sep 15 07:32:10.191307 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.191259    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e99c28e-4636-4cb9-ad56-e34fe76b970a" containerName="copy"
Sep 15 07:32:10.191307 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.191274    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e99c28e-4636-4cb9-ad56-e34fe76b970a" containerName="gather"
Sep 15 07:32:10.191307 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.191280    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e99c28e-4636-4cb9-ad56-e34fe76b970a" containerName="gather"
Sep 15 07:32:10.191399 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.191334    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e99c28e-4636-4cb9-ad56-e34fe76b970a" containerName="copy"
Sep 15 07:32:10.191399 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.191341    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e99c28e-4636-4cb9-ad56-e34fe76b970a" containerName="gather"
Sep 15 07:32:10.196163 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.196141    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"
Sep 15 07:32:10.198154 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.198130    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vt6rc\"/\"kube-root-ca.crt\""
Sep 15 07:32:10.198891 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.198871    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vt6rc\"/\"default-dockercfg-c76x4\""
Sep 15 07:32:10.199003 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.198907    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vt6rc\"/\"openshift-service-ca.crt\""
Sep 15 07:32:10.204573 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.204550    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"]
Sep 15 07:32:10.299774 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.299729    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/627cfbc5-634a-4854-abbd-eee128611fb5-podres\") pod \"perf-node-gather-daemonset-bhvp9\" (UID: \"627cfbc5-634a-4854-abbd-eee128611fb5\") " pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"
Sep 15 07:32:10.299957 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.299788    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/627cfbc5-634a-4854-abbd-eee128611fb5-sys\") pod \"perf-node-gather-daemonset-bhvp9\" (UID: \"627cfbc5-634a-4854-abbd-eee128611fb5\") " pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"
Sep 15 07:32:10.299957 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.299824    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/627cfbc5-634a-4854-abbd-eee128611fb5-proc\") pod \"perf-node-gather-daemonset-bhvp9\" (UID: \"627cfbc5-634a-4854-abbd-eee128611fb5\") " pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"
Sep 15 07:32:10.299957 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.299852    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5trx\" (UniqueName: \"kubernetes.io/projected/627cfbc5-634a-4854-abbd-eee128611fb5-kube-api-access-p5trx\") pod \"perf-node-gather-daemonset-bhvp9\" (UID: \"627cfbc5-634a-4854-abbd-eee128611fb5\") " pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"
Sep 15 07:32:10.299957 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.299917    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/627cfbc5-634a-4854-abbd-eee128611fb5-lib-modules\") pod \"perf-node-gather-daemonset-bhvp9\" (UID: \"627cfbc5-634a-4854-abbd-eee128611fb5\") " pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"
Sep 15 07:32:10.400740 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.400619    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/627cfbc5-634a-4854-abbd-eee128611fb5-sys\") pod \"perf-node-gather-daemonset-bhvp9\" (UID: \"627cfbc5-634a-4854-abbd-eee128611fb5\") " pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"
Sep 15 07:32:10.400740 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.400687    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/627cfbc5-634a-4854-abbd-eee128611fb5-proc\") pod \"perf-node-gather-daemonset-bhvp9\" (UID: \"627cfbc5-634a-4854-abbd-eee128611fb5\") " pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"
Sep 15 07:32:10.400974 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.400749    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5trx\" (UniqueName: \"kubernetes.io/projected/627cfbc5-634a-4854-abbd-eee128611fb5-kube-api-access-p5trx\") pod \"perf-node-gather-daemonset-bhvp9\" (UID: \"627cfbc5-634a-4854-abbd-eee128611fb5\") " pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"
Sep 15 07:32:10.400974 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.400769    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/627cfbc5-634a-4854-abbd-eee128611fb5-sys\") pod \"perf-node-gather-daemonset-bhvp9\" (UID: \"627cfbc5-634a-4854-abbd-eee128611fb5\") " pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"
Sep 15 07:32:10.400974 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.400779    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/627cfbc5-634a-4854-abbd-eee128611fb5-lib-modules\") pod \"perf-node-gather-daemonset-bhvp9\" (UID: \"627cfbc5-634a-4854-abbd-eee128611fb5\") " pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"
Sep 15 07:32:10.400974 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.400806    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/627cfbc5-634a-4854-abbd-eee128611fb5-proc\") pod \"perf-node-gather-daemonset-bhvp9\" (UID: \"627cfbc5-634a-4854-abbd-eee128611fb5\") " pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"
Sep 15 07:32:10.400974 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.400837    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/627cfbc5-634a-4854-abbd-eee128611fb5-podres\") pod \"perf-node-gather-daemonset-bhvp9\" (UID: \"627cfbc5-634a-4854-abbd-eee128611fb5\") " pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"
Sep 15 07:32:10.400974 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.400907    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/627cfbc5-634a-4854-abbd-eee128611fb5-lib-modules\") pod \"perf-node-gather-daemonset-bhvp9\" (UID: \"627cfbc5-634a-4854-abbd-eee128611fb5\") " pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"
Sep 15 07:32:10.400974 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.400937    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/627cfbc5-634a-4854-abbd-eee128611fb5-podres\") pod \"perf-node-gather-daemonset-bhvp9\" (UID: \"627cfbc5-634a-4854-abbd-eee128611fb5\") " pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"
Sep 15 07:32:10.408951 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.408923    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5trx\" (UniqueName: \"kubernetes.io/projected/627cfbc5-634a-4854-abbd-eee128611fb5-kube-api-access-p5trx\") pod \"perf-node-gather-daemonset-bhvp9\" (UID: \"627cfbc5-634a-4854-abbd-eee128611fb5\") " pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"
Sep 15 07:32:10.507224 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.507180    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"
Sep 15 07:32:10.773446 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.773415    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"]
Sep 15 07:32:10.776944 ip-10-0-129-10 kubenswrapper[2568]: W0915 07:32:10.776910    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod627cfbc5_634a_4854_abbd_eee128611fb5.slice/crio-cf62768f67a5297abe87a21ccdea6ac224c9702122912087000d2bd047b6d74f WatchSource:0}: Error finding container cf62768f67a5297abe87a21ccdea6ac224c9702122912087000d2bd047b6d74f: Status 404 returned error can't find the container with id cf62768f67a5297abe87a21ccdea6ac224c9702122912087000d2bd047b6d74f
Sep 15 07:32:10.962193 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.962167    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vvw8v_371738e8-15d1-4b74-8c57-572edc740b7d/dns/0.log"
Sep 15 07:32:10.981495 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:10.981461    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vvw8v_371738e8-15d1-4b74-8c57-572edc740b7d/kube-rbac-proxy/0.log"
Sep 15 07:32:11.033408 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:11.033331    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7p7gl_33d4f8d4-2be4-453c-8f99-a19ce58c1e36/dns-node-resolver/0.log"
Sep 15 07:32:11.475639 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:11.475605    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8k4fj_67a0be6f-84c1-4b98-b6d1-0dad5516fe99/node-ca/0.log"
Sep 15 07:32:11.708138 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:11.708101    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9" event={"ID":"627cfbc5-634a-4854-abbd-eee128611fb5","Type":"ContainerStarted","Data":"5f76b0e0cbbcef197f974dce573bed99a0130c3ca607ee160c758c162eee43d9"}
Sep 15 07:32:11.708319 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:11.708192    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9" event={"ID":"627cfbc5-634a-4854-abbd-eee128611fb5","Type":"ContainerStarted","Data":"cf62768f67a5297abe87a21ccdea6ac224c9702122912087000d2bd047b6d74f"}
Sep 15 07:32:11.708319 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:11.708244    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"
Sep 15 07:32:11.723836 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:11.723787    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9" podStartSLOduration=1.7237735779999999 podStartE2EDuration="1.723773578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:32:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:32:11.722367 +0000 UTC m=+1871.513284820" watchObservedRunningTime="2026-09-15 07:32:11.723773578 +0000 UTC m=+1871.514691399"
Sep 15 07:32:12.170482 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:12.170453    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-df8bc4958-v6bd2_e5e3323d-9a48-4d23-ad31-a0d3401e6b60/router/0.log"
Sep 15 07:32:12.468952 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:12.468876    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lvw2b_1d13caa1-05ce-4c88-becc-5632369bf463/serve-healthcheck-canary/0.log"
Sep 15 07:32:12.836798 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:12.836688    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-x9hvx_97764651-185b-4a70-a59a-138dd852cbef/insights-operator/0.log"
Sep 15 07:32:12.837190 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:12.836865    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-x9hvx_97764651-185b-4a70-a59a-138dd852cbef/insights-operator/1.log"
Sep 15 07:32:12.915002 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:12.914971    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jmb6d_9225807a-3d64-4e72-b62c-d67b1b6a7cb3/kube-rbac-proxy/0.log"
Sep 15 07:32:12.932611 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:12.932586    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jmb6d_9225807a-3d64-4e72-b62c-d67b1b6a7cb3/exporter/0.log"
Sep 15 07:32:12.951112 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:12.951079    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jmb6d_9225807a-3d64-4e72-b62c-d67b1b6a7cb3/extractor/0.log"
Sep 15 07:32:17.173030 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:17.172994    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-whnrm_13b6b89c-c6c2-445f-a32e-828c94f1ac35/kube-storage-version-migrator-operator/1.log"
Sep 15 07:32:17.174633 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:17.174602    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-whnrm_13b6b89c-c6c2-445f-a32e-828c94f1ac35/kube-storage-version-migrator-operator/0.log"
Sep 15 07:32:17.722362 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:17.722332    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vt6rc/perf-node-gather-daemonset-bhvp9"
Sep 15 07:32:18.256244 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:18.256216    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tkzx6_6a977870-0600-4a83-a169-6ed663e485ae/kube-multus-additional-cni-plugins/0.log"
Sep 15 07:32:18.275884 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:18.275852    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tkzx6_6a977870-0600-4a83-a169-6ed663e485ae/egress-router-binary-copy/0.log"
Sep 15 07:32:18.295145 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:18.295117    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tkzx6_6a977870-0600-4a83-a169-6ed663e485ae/cni-plugins/0.log"
Sep 15 07:32:18.313928 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:18.313904    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tkzx6_6a977870-0600-4a83-a169-6ed663e485ae/bond-cni-plugin/0.log"
Sep 15 07:32:18.332608 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:18.332586    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tkzx6_6a977870-0600-4a83-a169-6ed663e485ae/routeoverride-cni/0.log"
Sep 15 07:32:18.352056 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:18.352032    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tkzx6_6a977870-0600-4a83-a169-6ed663e485ae/whereabouts-cni-bincopy/0.log"
Sep 15 07:32:18.371062 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:18.371035    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tkzx6_6a977870-0600-4a83-a169-6ed663e485ae/whereabouts-cni/0.log"
Sep 15 07:32:18.469933 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:18.469905    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wqdxh_bd613c9f-dcfb-47a1-9c8b-ef63401cf342/kube-multus/0.log"
Sep 15 07:32:18.533070 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:18.532983    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9r6zz_8e7d8199-6790-4b03-bd95-5eeb637d2f99/network-metrics-daemon/0.log"
Sep 15 07:32:18.549153 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:18.549126    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9r6zz_8e7d8199-6790-4b03-bd95-5eeb637d2f99/kube-rbac-proxy/0.log"
Sep 15 07:32:19.708105 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:19.708077    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n92hd_c97f88a6-f9a0-49bd-82a9-41ed2f617e8f/ovn-controller/0.log"
Sep 15 07:32:19.725027 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:19.725003    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n92hd_c97f88a6-f9a0-49bd-82a9-41ed2f617e8f/ovn-acl-logging/0.log"
Sep 15 07:32:19.778902 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:19.778882    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n92hd_c97f88a6-f9a0-49bd-82a9-41ed2f617e8f/kube-rbac-proxy-node/0.log"
Sep 15 07:32:19.822632 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:19.822611    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n92hd_c97f88a6-f9a0-49bd-82a9-41ed2f617e8f/kube-rbac-proxy-ovn-metrics/0.log"
Sep 15 07:32:19.839179 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:19.839146    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n92hd_c97f88a6-f9a0-49bd-82a9-41ed2f617e8f/northd/0.log"
Sep 15 07:32:19.857163 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:19.857142    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n92hd_c97f88a6-f9a0-49bd-82a9-41ed2f617e8f/nbdb/0.log"
Sep 15 07:32:19.876753 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:19.876734    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n92hd_c97f88a6-f9a0-49bd-82a9-41ed2f617e8f/sbdb/0.log"
Sep 15 07:32:19.929726 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:19.929694    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n92hd_c97f88a6-f9a0-49bd-82a9-41ed2f617e8f/ovnkube-controller/0.log"
Sep 15 07:32:21.062962 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:21.062865    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-6f8b768455-8rz9j_5f694574-2528-41d7-8029-dc893cb1ed4b/check-endpoints/0.log"
Sep 15 07:32:21.115793 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:21.115767    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-tcldw_69bff7ef-8a76-40f8-9e5f-1ad219bf15b8/network-check-target-container/0.log"
Sep 15 07:32:22.017197 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:22.017144    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-l5chg_4aee77e0-4ad8-4134-8a4e-3c07793a6574/iptables-alerter/0.log"
Sep 15 07:32:22.729836 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:22.729809    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-cjf92_7a8a2fd0-fa70-4f65-b3c7-214eb5f8a83c/tuned/0.log"
Sep 15 07:32:24.316963 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:24.316933    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-wxj7v_5c72e28c-b940-4153-90bd-54b2e77f8ccf/cluster-samples-operator/0.log"
Sep 15 07:32:24.331901 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:24.331875    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-wxj7v_5c72e28c-b940-4153-90bd-54b2e77f8ccf/cluster-samples-operator-watch/0.log"
Sep 15 07:32:25.183878 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:25.183848    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-cf7c776b7-wpk8h_5c5ce87a-73d1-4c7d-92da-bab849f8e62a/service-ca-operator/1.log"
Sep 15 07:32:25.185609 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:25.185585    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-cf7c776b7-wpk8h_5c5ce87a-73d1-4c7d-92da-bab849f8e62a/service-ca-operator/0.log"
Sep 15 07:32:25.478036 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:25.477952    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-568869fdc5-h4kzb_8cbe0e93-94c1-4519-a36f-e241b6a111f4/service-ca-controller/0.log"
Sep 15 07:32:25.821365 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:25.821286    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-btwkr_e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50/csi-driver/0.log"
Sep 15 07:32:25.840060 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:25.840034    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-btwkr_e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50/csi-node-driver-registrar/0.log"
Sep 15 07:32:25.857758 ip-10-0-129-10 kubenswrapper[2568]: I0915 07:32:25.857733    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-btwkr_e09c58ca-e3a9-4abf-ba56-a89fa6aa1c50/csi-liveness-probe/0.log"