Jul 28 08:00:48.422161 ip-10-0-130-46 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 28 08:00:48.422175 ip-10-0-130-46 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 28 08:00:48.422184 ip-10-0-130-46 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 28 08:00:48.422518 ip-10-0-130-46 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 28 08:00:58.671444 ip-10-0-130-46 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 28 08:00:58.671461 ip-10-0-130-46 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot efdc13ca658d498c82715def156359ca --
Jul 28 08:02:44.698778 ip-10-0-130-46 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 08:02:45.077244 ip-10-0-130-46 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 08:02:45.077244 ip-10-0-130-46 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 08:02:45.077244 ip-10-0-130-46 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 08:02:45.077244 ip-10-0-130-46 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 08:02:45.077244 ip-10-0-130-46 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 08:02:45.079143 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.079024    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 08:02:45.087728 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087689    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 08:02:45.087728 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087712    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 08:02:45.087728 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087724    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 08:02:45.087728 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087728    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 08:02:45.087728 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087731    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 08:02:45.087728 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087733    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 08:02:45.087728 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087736    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 08:02:45.087728 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087738    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 08:02:45.088030 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087744    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 08:02:45.088030 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087748    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 08:02:45.088030 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087751    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 08:02:45.088030 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087754    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 08:02:45.088030 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087756    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 08:02:45.088030 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087759    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 08:02:45.088030 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087761    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 08:02:45.088030 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087764    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 08:02:45.088030 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087767    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 08:02:45.088030 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087769    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 08:02:45.088030 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087772    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 08:02:45.088030 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087774    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 08:02:45.088030 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087777    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 08:02:45.088030 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087779    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 08:02:45.088030 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087781    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 08:02:45.088030 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087784    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 08:02:45.088030 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087787    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 08:02:45.088030 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087793    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 08:02:45.088030 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087795    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 08:02:45.088525 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087798    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 08:02:45.088525 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087800    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 08:02:45.088525 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087809    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 08:02:45.088525 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087813    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 08:02:45.088525 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087816    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 08:02:45.088525 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087820    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 08:02:45.088525 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087823    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 08:02:45.088525 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087827    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 08:02:45.088525 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087831    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 08:02:45.088525 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087834    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 08:02:45.088525 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087836    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 08:02:45.088525 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087839    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 08:02:45.088525 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087842    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 08:02:45.088525 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087845    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 08:02:45.088525 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087848    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 08:02:45.088525 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087851    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 08:02:45.088525 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087854    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 08:02:45.088525 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087856    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 08:02:45.088525 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087859    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 08:02:45.089037 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087861    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 08:02:45.089037 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087864    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 08:02:45.089037 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087867    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 08:02:45.089037 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087869    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 08:02:45.089037 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087872    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 08:02:45.089037 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087874    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 08:02:45.089037 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087876    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 08:02:45.089037 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087879    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 08:02:45.089037 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087881    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 08:02:45.089037 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087884    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 08:02:45.089037 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087886    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 08:02:45.089037 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087889    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 08:02:45.089037 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087891    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 08:02:45.089037 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087894    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 08:02:45.089037 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087896    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 08:02:45.089037 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087898    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 08:02:45.089037 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087900    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 08:02:45.089037 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087903    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 08:02:45.089037 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087906    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 08:02:45.089037 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087909    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 08:02:45.089564 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087913    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 08:02:45.089564 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087915    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 08:02:45.089564 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087918    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 08:02:45.089564 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087920    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 08:02:45.089564 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087923    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 08:02:45.089564 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087925    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 08:02:45.089564 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087928    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 08:02:45.089564 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087931    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 08:02:45.089564 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087933    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 08:02:45.089564 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087935    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 08:02:45.089564 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087938    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 08:02:45.089564 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087940    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 08:02:45.089564 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087943    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 08:02:45.089564 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087945    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 08:02:45.089564 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087948    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 08:02:45.089564 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087950    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 08:02:45.089564 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087952    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 08:02:45.089564 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087956    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 08:02:45.089564 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087958    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 08:02:45.089564 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087960    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 08:02:45.090089 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087963    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 08:02:45.090089 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087965    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 08:02:45.090089 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087967    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 08:02:45.090089 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087970    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 08:02:45.090089 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087972    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 08:02:45.090089 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087975    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 08:02:45.090089 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087977    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 08:02:45.090089 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087979    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 08:02:45.090089 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087982    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 08:02:45.090089 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087984    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 08:02:45.090089 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087987    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 08:02:45.090089 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087990    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 08:02:45.090089 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.087992    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 08:02:45.090089 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088772    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 08:02:45.090089 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088783    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 08:02:45.090089 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088787    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 08:02:45.090089 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088791    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 08:02:45.090089 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088793    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 08:02:45.090089 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088796    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 08:02:45.090089 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088798    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 08:02:45.090593 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088801    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 08:02:45.090593 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088804    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 08:02:45.090593 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088806    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 08:02:45.090593 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088809    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 08:02:45.090593 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088811    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 08:02:45.090593 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088814    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 08:02:45.090593 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088816    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 08:02:45.090593 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088819    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 08:02:45.090593 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088821    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 08:02:45.090593 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088824    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 08:02:45.090593 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088827    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 08:02:45.090593 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088830    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 08:02:45.090593 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088832    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 08:02:45.090593 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088835    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 08:02:45.090593 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088837    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 08:02:45.090593 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088840    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 08:02:45.090593 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088842    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 08:02:45.090593 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088845    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 08:02:45.090593 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088848    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 08:02:45.090593 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088850    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 08:02:45.091195 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088852    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 08:02:45.091195 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088855    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 08:02:45.091195 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088858    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 08:02:45.091195 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088861    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 08:02:45.091195 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088863    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 08:02:45.091195 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088866    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 08:02:45.091195 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088868    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 08:02:45.091195 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088871    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 08:02:45.091195 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088874    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 08:02:45.091195 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088876    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 08:02:45.091195 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088879    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 08:02:45.091195 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088881    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 08:02:45.091195 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088884    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 08:02:45.091195 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088886    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 08:02:45.091195 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088889    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 08:02:45.091195 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088891    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 08:02:45.091195 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088893    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 08:02:45.091195 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088896    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 08:02:45.091195 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088898    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 08:02:45.091195 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088901    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 08:02:45.091762 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088903    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 08:02:45.091762 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088905    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 08:02:45.091762 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088908    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 08:02:45.091762 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088910    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 08:02:45.091762 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088913    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 08:02:45.091762 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088915    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 08:02:45.091762 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088918    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 08:02:45.091762 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088921    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 08:02:45.091762 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088923    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 08:02:45.091762 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088926    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 08:02:45.091762 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088928    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 08:02:45.091762 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088930    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 08:02:45.091762 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088933    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 08:02:45.091762 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088935    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 08:02:45.091762 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088941    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 08:02:45.091762 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088944    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 08:02:45.091762 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088946    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 08:02:45.091762 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088949    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 08:02:45.091762 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088952    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 08:02:45.091762 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088954    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 08:02:45.092250 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088957    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 08:02:45.092250 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088959    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 08:02:45.092250 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088962    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 08:02:45.092250 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088964    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 08:02:45.092250 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088966    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 08:02:45.092250 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088969    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 08:02:45.092250 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088971    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 08:02:45.092250 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088974    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 08:02:45.092250 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088976    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 08:02:45.092250 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088979    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 08:02:45.092250 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088982    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 08:02:45.092250 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088984    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 08:02:45.092250 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088986    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 08:02:45.092250 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088989    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 08:02:45.092250 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088991    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 08:02:45.092250 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088994    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 08:02:45.092250 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.088997    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 08:02:45.092250 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089000    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 08:02:45.092250 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089003    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 08:02:45.092250 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089006    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 08:02:45.092777 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089008    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 08:02:45.092777 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089011    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 08:02:45.092777 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089014    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 08:02:45.092777 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089018    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 08:02:45.092777 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089022    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 08:02:45.092777 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089025    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 08:02:45.092777 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089029    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 08:02:45.092777 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089032    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 08:02:45.092777 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089035    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 08:02:45.092777 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089038    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 08:02:45.092777 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089041    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 08:02:45.092777 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089044    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 08:02:45.092777 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089462    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 08:02:45.092777 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089467    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 08:02:45.092777 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089471    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 08:02:45.092777 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089474    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 08:02:45.092777 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089477    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 08:02:45.092777 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089479    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 08:02:45.092777 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089482    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 08:02:45.093263 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089484    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 08:02:45.093263 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089487    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 08:02:45.093263 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089489    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 08:02:45.093263 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089492    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 08:02:45.093263 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089494    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 08:02:45.093263 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089497    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 08:02:45.093263 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089499    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 08:02:45.093263 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089502    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 08:02:45.093263 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089504    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 08:02:45.093263 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089507    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 08:02:45.093263 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089509    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 08:02:45.093263 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089512    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 08:02:45.093263 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089514    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 08:02:45.093263 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089517    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 08:02:45.093263 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089519    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 08:02:45.093263 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089522    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 08:02:45.093263 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089524    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 08:02:45.093263 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089527    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 08:02:45.093263 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089529    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 08:02:45.093263 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089535    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 08:02:45.093789 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089538    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 08:02:45.093789 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089540    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 08:02:45.093789 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089544    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 08:02:45.093789 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089547    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 08:02:45.093789 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089550    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 08:02:45.093789 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089554    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 08:02:45.093789 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089559    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 08:02:45.093789 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089562    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 08:02:45.093789 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089565    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 08:02:45.093789 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089568    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 08:02:45.093789 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089571    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 08:02:45.093789 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089575    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 08:02:45.093789 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089578    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 08:02:45.093789 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089581    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 08:02:45.093789 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089583    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 08:02:45.093789 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089586    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 08:02:45.093789 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089588    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 08:02:45.093789 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089591    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 08:02:45.093789 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089593    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 08:02:45.094290 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089596    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 08:02:45.094290 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089598    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 08:02:45.094290 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089602    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 08:02:45.094290 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089605    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 08:02:45.094290 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089607    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 08:02:45.094290 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089610    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 08:02:45.094290 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089612    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 08:02:45.094290 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089615    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 08:02:45.094290 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089617    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 08:02:45.094290 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089620    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 08:02:45.094290 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089623    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 08:02:45.094290 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089625    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 08:02:45.094290 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089630    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 08:02:45.094290 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089632    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 08:02:45.094290 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089635    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 08:02:45.094290 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089637    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 08:02:45.094290 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089640    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 08:02:45.094290 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089642    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 08:02:45.094290 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089645    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 08:02:45.094290 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089647    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 08:02:45.094838 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089650    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 08:02:45.094838 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089653    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 08:02:45.094838 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089655    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 08:02:45.094838 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089658    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 08:02:45.094838 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089660    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 08:02:45.094838 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089664    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 08:02:45.094838 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089667    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 08:02:45.094838 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089669    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 08:02:45.094838 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089672    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 08:02:45.094838 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089674    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 08:02:45.094838 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089677    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 08:02:45.094838 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089680    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 08:02:45.094838 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089682    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 08:02:45.094838 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089685    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 08:02:45.094838 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089687    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 08:02:45.094838 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089690    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 08:02:45.094838 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089693    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 08:02:45.094838 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089695    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 08:02:45.094838 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089698    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 08:02:45.094838 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089700    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 08:02:45.095342 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089703    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 08:02:45.095342 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089705    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 08:02:45.095342 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089707    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 08:02:45.095342 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089710    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 08:02:45.095342 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089714    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 08:02:45.095342 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089717    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 08:02:45.095342 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089719    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 08:02:45.095342 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089722    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 08:02:45.095342 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089724    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 08:02:45.095342 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089727    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 08:02:45.095342 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089729    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 08:02:45.095342 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089732    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 08:02:45.095342 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.089735    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 08:02:45.095342 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089811    2583 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 08:02:45.095342 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089820    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 08:02:45.095342 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089826    2583 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 08:02:45.095342 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089830    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 08:02:45.095342 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089834    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 08:02:45.095342 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089838    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 08:02:45.095342 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089842    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 08:02:45.095342 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089846    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089849    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089852    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089856    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089859    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089862    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089865    2583 flags.go:64] FLAG: --cgroup-root=""
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089867    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089870    2583 flags.go:64] FLAG: --client-ca-file=""
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089874    2583 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089877    2583 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089882    2583 flags.go:64] FLAG: --cluster-domain=""
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089885    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089888    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089891    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089894    2583 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089902    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089905    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089908    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089911    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089914    2583 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089917    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089919    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089923    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 08:02:45.095913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089925    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089930    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089933    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089936    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089938    2583 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089941    2583 flags.go:64] FLAG: --enable-server="true"
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089944    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089948    2583 flags.go:64] FLAG: --event-burst="100"
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089951    2583 flags.go:64] FLAG: --event-qps="50"
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089954    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089957    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089960    2583 flags.go:64] FLAG: --eviction-hard=""
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089963    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089965    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089968    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089971    2583 flags.go:64] FLAG: --eviction-soft=""
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089974    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089977    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089980    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089983    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089986    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089989    2583 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089991    2583 flags.go:64] FLAG: --feature-gates=""
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.089995    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090002    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 08:02:45.096525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090005    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090008    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090011    2583 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090014    2583 flags.go:64] FLAG: --help="false"
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090017    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-130-46.ec2.internal"
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090020    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090023    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090026    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090030    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090034    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090036    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090039    2583 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090042    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090045    2583 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090047    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090050    2583 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090053    2583 flags.go:64] FLAG: --kube-reserved=""
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090056    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090059    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090061    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090064    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090067    2583 flags.go:64] FLAG: --lock-file=""
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090069    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090072    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 08:02:45.097219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090075    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090080    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090084    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090086    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090089    2583 flags.go:64] FLAG: --logging-format="text"
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090092    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090095    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090100    2583 flags.go:64] FLAG: --manifest-url=""
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090103    2583 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090108    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090110    2583 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090114    2583 flags.go:64] FLAG: --max-pods="110"
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090117    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090120    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090123    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090126    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090129    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090132    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090134    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090142    2583 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090145    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090148    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090150    2583 flags.go:64] FLAG: --pod-cidr=""
Jul 28 08:02:45.097847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090153    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090159    2583 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090161    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090164    2583 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090167    2583 flags.go:64] FLAG: --port="10250"
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090170    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090173    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01eb8c2cf7ef2c7ca"
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090176    2583 flags.go:64] FLAG: --qos-reserved=""
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090178    2583 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090181    2583 flags.go:64] FLAG: --register-node="true"
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090184    2583 flags.go:64] FLAG: --register-with-taints=""
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090187    2583 flags.go:64] FLAG: --registry-burst="10"
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090191    2583 flags.go:64] FLAG: --registry-qps="5"
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090194    2583 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090197    2583 flags.go:64] FLAG: --reserved-memory=""
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090200    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090204    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090208    2583 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090211    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090214    2583 flags.go:64] FLAG: --runonce="false"
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090217    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090220    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090223    2583 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090226    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090229    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090232    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 08:02:45.098458 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090235    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090237    2583 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090240    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090243    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090246    2583 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090249    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090251    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090254    2583 flags.go:64] FLAG: --system-cgroups=""
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090257    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090262    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090265    2583 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090267    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090272    2583 flags.go:64] FLAG: --tls-min-version=""
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090274    2583 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090277    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090280    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090283    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090285    2583 flags.go:64] FLAG: --v="2"
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090289    2583 flags.go:64] FLAG: --version="false"
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090294    2583 flags.go:64] FLAG: --vmodule=""
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090298    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.090301    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090412    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090416    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 08:02:45.099113 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090419    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 08:02:45.099800 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090423    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 08:02:45.099800 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090425    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 08:02:45.099800 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090427    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 08:02:45.099800 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090430    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 08:02:45.099800 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090432    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 08:02:45.099800 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090435    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 08:02:45.099800 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090438    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 08:02:45.099800 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090440    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 08:02:45.099800 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090460    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 08:02:45.099800 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090463    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 08:02:45.099800 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090465    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 08:02:45.099800 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090469    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 08:02:45.099800 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090473    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 08:02:45.099800 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090477    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 08:02:45.099800 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090480    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 08:02:45.099800 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090483    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 08:02:45.099800 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090486    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 08:02:45.099800 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090488    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 08:02:45.099800 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090491    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 08:02:45.100271 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090493    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 08:02:45.100271 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090496    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 08:02:45.100271 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090498    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 08:02:45.100271 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090501    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 08:02:45.100271 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090503    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 08:02:45.100271 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090506    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 08:02:45.100271 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090508    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 08:02:45.100271 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090511    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 08:02:45.100271 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090514    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 08:02:45.100271 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090517    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 08:02:45.100271 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090519    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 08:02:45.100271 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090522    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 08:02:45.100271 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090524    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 08:02:45.100271 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090527    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 08:02:45.100271 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090530    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 08:02:45.100271 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090532    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 08:02:45.100271 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090534    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 08:02:45.100271 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090537    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 08:02:45.100271 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090540    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 08:02:45.100271 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090542    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 08:02:45.100780 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090545    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 08:02:45.100780 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090547    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 08:02:45.100780 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090550    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 08:02:45.100780 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090552    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 08:02:45.100780 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090555    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 08:02:45.100780 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090557    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 08:02:45.100780 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090560    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 08:02:45.100780 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090562    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 08:02:45.100780 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090565    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 08:02:45.100780 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090567    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 08:02:45.100780 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090570    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 08:02:45.100780 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090572    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 08:02:45.100780 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090574    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 08:02:45.100780 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090577    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 08:02:45.100780 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090580    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 08:02:45.100780 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090582    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 08:02:45.100780 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090585    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 08:02:45.100780 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090587    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 08:02:45.100780 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090590    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 08:02:45.100780 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090592    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 08:02:45.101315 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090595    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 08:02:45.101315 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090598    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 08:02:45.101315 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090601    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 08:02:45.101315 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090603    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 08:02:45.101315 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090606    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 08:02:45.101315 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090608    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 08:02:45.101315 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090611    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 08:02:45.101315 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090613    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 08:02:45.101315 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090616    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 08:02:45.101315 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090618    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 08:02:45.101315 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090621    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 08:02:45.101315 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090623    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 08:02:45.101315 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090626    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 08:02:45.101315 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090628    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 08:02:45.101315 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090631    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 08:02:45.101315 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090633    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 08:02:45.101315 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090635    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 08:02:45.101315 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090638    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 08:02:45.101315 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090640    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 08:02:45.101315 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090643    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 08:02:45.101830 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090645    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 08:02:45.101830 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090648    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 08:02:45.101830 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090651    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 08:02:45.101830 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090653    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 08:02:45.101830 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090656    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 08:02:45.101830 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090660    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 08:02:45.101830 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090662    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 08:02:45.101830 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090664    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 08:02:45.101830 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090667    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 08:02:45.101830 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090669    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 08:02:45.101830 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090674    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 08:02:45.101830 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090676    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 08:02:45.101830 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090679    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 08:02:45.101830 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090681    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 08:02:45.101830 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090684    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 08:02:45.101830 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090686    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 08:02:45.101830 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.090689    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 08:02:45.102249 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.091238    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 08:02:45.102249 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.098483    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 08:02:45.102249 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.098505    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 08:02:45.102249 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.099380    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 08:02:45.102249 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.099388    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 08:02:45.102249 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099468    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 08:02:45.102249 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099475    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 08:02:45.102249 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099478    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 08:02:45.102249 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099481    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 08:02:45.102249 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099484    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 08:02:45.102249 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099487    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 08:02:45.102249 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099490    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 08:02:45.102249 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099493    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 08:02:45.102249 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099496    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 08:02:45.102249 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099498    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 08:02:45.102644 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099501    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 08:02:45.102644 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099503    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 08:02:45.102644 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099506    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 08:02:45.102644 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099508    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 08:02:45.102644 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099511    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 08:02:45.102644 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099513    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 08:02:45.102644 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099516    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 08:02:45.102644 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099518    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 08:02:45.102644 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099521    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 08:02:45.102644 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099523    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 08:02:45.102644 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099526    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 08:02:45.102644 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099528    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 08:02:45.102644 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099532    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 08:02:45.102644 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099536    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 08:02:45.102644 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099540    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 08:02:45.102644 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099543    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 08:02:45.102644 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099545    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 08:02:45.102644 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099548    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 08:02:45.102644 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099550    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 08:02:45.103128 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099561    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 08:02:45.103128 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099564    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 08:02:45.103128 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099566    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 08:02:45.103128 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099569    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 08:02:45.103128 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099572    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 08:02:45.103128 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099574    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 08:02:45.103128 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099577    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 08:02:45.103128 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099579    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 08:02:45.103128 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099582    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 08:02:45.103128 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099584    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 08:02:45.103128 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099587    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 08:02:45.103128 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099590    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 08:02:45.103128 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099593    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 08:02:45.103128 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099595    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 08:02:45.103128 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099598    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 08:02:45.103128 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099600    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 08:02:45.103128 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099603    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 08:02:45.103128 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099605    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 08:02:45.103128 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099607    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 08:02:45.103614 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099610    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 08:02:45.103614 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099612    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 08:02:45.103614 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099615    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 08:02:45.103614 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099617    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 08:02:45.103614 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099620    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 08:02:45.103614 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099622    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 08:02:45.103614 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099625    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 08:02:45.103614 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099628    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 08:02:45.103614 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099632    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 08:02:45.103614 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099634    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 08:02:45.103614 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099637    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 08:02:45.103614 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099639    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 08:02:45.103614 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099642    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 08:02:45.103614 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099645    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 08:02:45.103614 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099653    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 08:02:45.103614 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099656    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 08:02:45.103614 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099659    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 08:02:45.103614 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099661    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 08:02:45.103614 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099663    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 08:02:45.103614 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099666    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 08:02:45.104110 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099668    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 08:02:45.104110 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099671    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 08:02:45.104110 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099673    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 08:02:45.104110 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099676    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 08:02:45.104110 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099678    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 08:02:45.104110 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099681    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 08:02:45.104110 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099683    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 08:02:45.104110 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099685    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 08:02:45.104110 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099688    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 08:02:45.104110 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099690    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 08:02:45.104110 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099693    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 08:02:45.104110 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099695    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 08:02:45.104110 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099698    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 08:02:45.104110 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099700    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 08:02:45.104110 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099703    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 08:02:45.104110 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099705    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 08:02:45.104110 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099708    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 08:02:45.104110 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099710    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 08:02:45.104110 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099712    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 08:02:45.104110 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099722    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 08:02:45.104672 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099726    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 08:02:45.104672 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099729    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 08:02:45.104672 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099731    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 08:02:45.104672 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099734    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 08:02:45.104672 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099736    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 08:02:45.104672 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099740    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 08:02:45.104672 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099743    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 08:02:45.104672 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099752    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 08:02:45.104672 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099754    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 08:02:45.104672 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099757    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 08:02:45.104672 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099759    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 08:02:45.104672 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.099764    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 08:02:45.104672 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099940    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 08:02:45.104672 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099945    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 08:02:45.104672 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099948    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 08:02:45.105049 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099952    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 08:02:45.105049 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099955    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 08:02:45.105049 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099958    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 08:02:45.105049 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099961    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 08:02:45.105049 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099963    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 08:02:45.105049 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099966    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 08:02:45.105049 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099969    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 08:02:45.105049 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099971    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 08:02:45.105049 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099973    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 08:02:45.105049 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099976    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 08:02:45.105049 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099978    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 08:02:45.105049 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099981    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 08:02:45.105049 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099983    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 08:02:45.105049 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099985    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 08:02:45.105049 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099988    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 08:02:45.105049 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099990    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 08:02:45.105049 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099993    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 08:02:45.105049 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099995    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 08:02:45.105049 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.099998    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 08:02:45.105534 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100000    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 08:02:45.105534 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100002    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 08:02:45.105534 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100005    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 08:02:45.105534 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100007    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 08:02:45.105534 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100010    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 08:02:45.105534 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100012    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 08:02:45.105534 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100021    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 08:02:45.105534 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100023    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 08:02:45.105534 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100026    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 08:02:45.105534 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100028    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 08:02:45.105534 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100031    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 08:02:45.105534 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100033    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 08:02:45.105534 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100036    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 08:02:45.105534 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100038    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 08:02:45.105534 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100040    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 08:02:45.105534 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100043    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 08:02:45.105534 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100045    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 08:02:45.105534 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100048    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 08:02:45.105534 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100050    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 08:02:45.105534 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100053    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 08:02:45.106014 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100055    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 08:02:45.106014 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100057    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 08:02:45.106014 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100060    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 08:02:45.106014 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100062    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 08:02:45.106014 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100064    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 08:02:45.106014 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100067    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 08:02:45.106014 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100069    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 08:02:45.106014 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100072    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 08:02:45.106014 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100074    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 08:02:45.106014 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100076    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 08:02:45.106014 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100079    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 08:02:45.106014 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100081    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 08:02:45.106014 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100084    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 08:02:45.106014 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100087    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 08:02:45.106014 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100089    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 08:02:45.106014 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100092    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 08:02:45.106014 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100094    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 08:02:45.106014 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100096    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 08:02:45.106014 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100099    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 08:02:45.106014 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100108    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 08:02:45.106506 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100111    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 08:02:45.106506 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100113    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 08:02:45.106506 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100116    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 08:02:45.106506 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100119    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 08:02:45.106506 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100123    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 08:02:45.106506 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100126    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 08:02:45.106506 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100128    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 08:02:45.106506 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100130    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 08:02:45.106506 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100133    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 08:02:45.106506 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100135    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 08:02:45.106506 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100138    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 08:02:45.106506 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100140    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 08:02:45.106506 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100143    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 08:02:45.106506 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100145    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 08:02:45.106506 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100147    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 08:02:45.106506 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100150    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 08:02:45.106506 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100152    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 08:02:45.106506 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100154    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 08:02:45.106506 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100157    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 08:02:45.106506 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100159    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 08:02:45.107074 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100162    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 08:02:45.107074 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100165    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 08:02:45.107074 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100169    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 08:02:45.107074 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100171    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 08:02:45.107074 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100174    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 08:02:45.107074 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100177    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 08:02:45.107074 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100180    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 08:02:45.107074 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100184    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 08:02:45.107074 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100186    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 08:02:45.107074 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100189    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 08:02:45.107074 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100192    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 08:02:45.107074 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100195    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 08:02:45.107074 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100203    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 08:02:45.107074 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100205    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 08:02:45.107074 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100208    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 08:02:45.107074 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100211    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 08:02:45.107074 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:45.100213    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 08:02:45.107789 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.100218    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 08:02:45.107789 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.100376    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 08:02:45.107789 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.102364    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 08:02:45.107789 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.103646    2583 server.go:1019] "Starting client certificate rotation"
Jul 28 08:02:45.107789 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.103763    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 08:02:45.107789 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.103809    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 08:02:45.107789 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.106045    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 08:02:45.109917 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.109863    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 08:02:45.117143 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.117122    2583 log.go:25] "Validated CRI v1 runtime API"
Jul 28 08:02:45.120706 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.120688    2583 log.go:25] "Validated CRI v1 image API"
Jul 28 08:02:45.122612 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.122582    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 08:02:45.124904 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.124881    2583 fs.go:135] Filesystem UUIDs: map[48ddada2-6de0-411b-b5f5-dd09d4e51655:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9d4eafca-ccea-4484-bfe4-6155d09cc8c1:/dev/nvme0n1p3]
Jul 28 08:02:45.124957 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.124904    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 08:02:45.130299 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.130177    2583 manager.go:216] Machine: {Timestamp:2026-07-28 08:02:45.128878829 +0000 UTC m=+0.316066950 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099676 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24b058b72a1c762320855f9426e4ba SystemUUID:ec24b058-b72a-1c76-2320-855f9426e4ba BootID:efdc13ca-658d-498c-8271-5def156359ca Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:54:e4:81:8a:37 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:54:e4:81:8a:37 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:0e:84:3c:07:9d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 08:02:45.130299 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.130295    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 08:02:45.130404 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.130386    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 08:02:45.131597 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.131572    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 08:02:45.131756 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.131600    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-46.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 08:02:45.132091 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.132075    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 08:02:45.132978 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.132966    2583 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 08:02:45.133013 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.132981    2583 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 08:02:45.133013 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.132989    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 08:02:45.133697 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.133686    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 08:02:45.134580 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.134569    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 08:02:45.136210 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.136199    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 08:02:45.136356 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.136347    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 08:02:45.136386 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.136378    2583 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 08:02:45.136413 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.136390    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 08:02:45.136413 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.136405    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 08:02:45.136478 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.136422    2583 kubelet.go:398] "Adding apiserver pod source"
Jul 28 08:02:45.136478 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.136432    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 08:02:45.136824 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.136811    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 08:02:45.136878 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.136829    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 08:02:45.139190 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.139170    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 08:02:45.141006 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.140992    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 08:02:45.141064 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.141023    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 08:02:45.142663 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.142649    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 08:02:45.142663 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.142666    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 08:02:45.142799 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.142674    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 08:02:45.142799 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.142679    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 08:02:45.142799 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.142688    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 08:02:45.142799 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.142693    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 08:02:45.142799 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.142700    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 08:02:45.142799 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.142707    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 08:02:45.142799 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.142714    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 08:02:45.142799 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.142722    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 08:02:45.142799 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.142738    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 08:02:45.142799 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.142743    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 08:02:45.143374 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.143363    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 08:02:45.143374 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.143373    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 08:02:45.147532 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.147514    2583 server.go:1268] "Started kubelet"
Jul 28 08:02:45.147622 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.147594    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-46.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 08:02:45.147677 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.147600    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 08:02:45.147787 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.147648    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 08:02:45.147787 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.147725    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 08:02:45.147953 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.147929    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-46.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 08:02:45.147953 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.147943    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 08:02:45.148493 ip-10-0-130-46 systemd[1]: Started Kubernetes Kubelet.
Jul 28 08:02:45.149462 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.149436    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 08:02:45.149958 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.149942    2583 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 08:02:45.152283 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.152253    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 08:02:45.154913 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.154001    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-46.ec2.internal.18c6655ff77dbc5d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-46.ec2.internal,UID:ip-10-0-130-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-46.ec2.internal,},FirstTimestamp:2026-07-28 08:02:45.147491421 +0000 UTC m=+0.334679543,LastTimestamp:2026-07-28 08:02:45.147491421 +0000 UTC m=+0.334679543,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-46.ec2.internal,}"
Jul 28 08:02:45.155675 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.155663    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 08:02:45.155747 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.155734    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 08:02:45.155804 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.155759    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-46.ec2.internal\" not found"
Jul 28 08:02:45.156401 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.156247    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 08:02:45.156401 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.156247    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 08:02:45.156401 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.156273    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 08:02:45.156401 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.156374    2583 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 08:02:45.156401 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.156398    2583 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 08:02:45.156727 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.156655    2583 factory.go:55] Registering systemd factory
Jul 28 08:02:45.156727 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.156670    2583 factory.go:223] Registration of the systemd container factory successfully
Jul 28 08:02:45.156883 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.156863    2583 factory.go:153] Registering CRI-O factory
Jul 28 08:02:45.156883 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.156885    2583 factory.go:223] Registration of the crio container factory successfully
Jul 28 08:02:45.157013 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.156941    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 08:02:45.157013 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.156969    2583 factory.go:103] Registering Raw factory
Jul 28 08:02:45.157013 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.156987    2583 manager.go:1196] Started watching for new ooms in manager
Jul 28 08:02:45.157926 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.157912    2583 manager.go:349] Starting recovery of all containers
Jul 28 08:02:45.161085 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.161058    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 08:02:45.161182 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.161163    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-46.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 08:02:45.170065 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.169966    2583 manager.go:354] Recovery completed
Jul 28 08:02:45.175370 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.175356    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 08:02:45.177789 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.177762    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 08:02:45.177872 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.177803    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 08:02:45.177872 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.177814    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasSufficientPID"
Jul 28 08:02:45.178007 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.177981    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pnqhz"
Jul 28 08:02:45.178327 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.178312    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 08:02:45.178375 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.178329    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 08:02:45.178375 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.178330    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 08:02:45.178375 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.178349    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 08:02:45.179069 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.179056    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 08:02:45.179114 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.179082    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 08:02:45.179114 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.179091    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasSufficientPID"
Jul 28 08:02:45.179593 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.179520    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-46.ec2.internal.18c6655ff94c042c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-46.ec2.internal,UID:ip-10-0-130-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-46.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-46.ec2.internal,},FirstTimestamp:2026-07-28 08:02:45.177787436 +0000 UTC m=+0.364975559,LastTimestamp:2026-07-28 08:02:45.177787436 +0000 UTC m=+0.364975559,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-46.ec2.internal,}"
Jul 28 08:02:45.179894 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.179882    2583 policy_none.go:49] "None policy: Start"
Jul 28 08:02:45.179948 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.179899    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 08:02:45.179948 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.179913    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 08:02:45.180890 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.180879    2583 policy_none.go:47] "Start"
Jul 28 08:02:45.186145 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.185997    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pnqhz"
Jul 28 08:02:45.188166 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.188089    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-46.ec2.internal.18c6655ff94c5448  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-46.ec2.internal,UID:ip-10-0-130-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-46.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-46.ec2.internal,},FirstTimestamp:2026-07-28 08:02:45.177807944 +0000 UTC m=+0.364996065,LastTimestamp:2026-07-28 08:02:45.177807944 +0000 UTC m=+0.364996065,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-46.ec2.internal,}"
Jul 28 08:02:45.234154 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.234133    2583 manager.go:337] "Starting Device Plugin manager"
Jul 28 08:02:45.234290 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.234174    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 08:02:45.234290 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.234184    2583 server.go:87] "Starting device plugin registration server"
Jul 28 08:02:45.234548 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.234537    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 08:02:45.234587 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.234550    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 08:02:45.234686 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.234670    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 08:02:45.234788 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.234773    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 08:02:45.234788 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.234788    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 08:02:45.235345 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.235324    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 08:02:45.235429 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.235380    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-46.ec2.internal\" not found"
Jul 28 08:02:45.326582 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.326541    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 08:02:45.327974 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.327913    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 08:02:45.327974 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.327962    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 08:02:45.328112 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.328004    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 08:02:45.328112 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.328050    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 08:02:45.330338 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.330316    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 08:02:45.335333 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.335315    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 08:02:45.336298 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.336280    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 08:02:45.336388 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.336311    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 08:02:45.336388 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.336325    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasSufficientPID"
Jul 28 08:02:45.336388 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.336348    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-46.ec2.internal"
Jul 28 08:02:45.345411 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.345395    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-46.ec2.internal"
Jul 28 08:02:45.345493 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.345420    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-46.ec2.internal\": node \"ip-10-0-130-46.ec2.internal\" not found"
Jul 28 08:02:45.368239 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.368212    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-46.ec2.internal\" not found"
Jul 28 08:02:45.428668 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.428614    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-46.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-46.ec2.internal"]
Jul 28 08:02:45.428725 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.428717    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 08:02:45.429708 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.429686    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 08:02:45.429816 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.429722    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 08:02:45.429816 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.429732    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasSufficientPID"
Jul 28 08:02:45.431151 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.431139    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 08:02:45.431261 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.431245    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-46.ec2.internal"
Jul 28 08:02:45.431320 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.431276    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 08:02:45.431852 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.431835    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 08:02:45.431931 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.431865    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 08:02:45.431931 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.431879    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasSufficientPID"
Jul 28 08:02:45.431931 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.431920    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 08:02:45.432032 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.431935    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 08:02:45.432032 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.431949    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasSufficientPID"
Jul 28 08:02:45.433040 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.433025    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-46.ec2.internal"
Jul 28 08:02:45.433080 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.433051    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 08:02:45.433709 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.433693    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 08:02:45.433784 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.433720    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 08:02:45.433784 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.433734    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasSufficientPID"
Jul 28 08:02:45.454224 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.454189    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-46.ec2.internal\" not found" node="ip-10-0-130-46.ec2.internal"
Jul 28 08:02:45.457140 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.457119    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a65f886f3c4206dc5fdaf20b8d13828e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-46.ec2.internal\" (UID: \"a65f886f3c4206dc5fdaf20b8d13828e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-46.ec2.internal"
Jul 28 08:02:45.457262 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.457146    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e0c6e405082ae3c531b401ce1816ae32-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-46.ec2.internal\" (UID: \"e0c6e405082ae3c531b401ce1816ae32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-46.ec2.internal"
Jul 28 08:02:45.457262 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.457163    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0c6e405082ae3c531b401ce1816ae32-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-46.ec2.internal\" (UID: \"e0c6e405082ae3c531b401ce1816ae32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-46.ec2.internal"
Jul 28 08:02:45.458996 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.458976    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-46.ec2.internal\" not found" node="ip-10-0-130-46.ec2.internal"
Jul 28 08:02:45.468490 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.468468    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-46.ec2.internal\" not found"
Jul 28 08:02:45.558247 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.558211    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a65f886f3c4206dc5fdaf20b8d13828e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-46.ec2.internal\" (UID: \"a65f886f3c4206dc5fdaf20b8d13828e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-46.ec2.internal"
Jul 28 08:02:45.558247 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.558248    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e0c6e405082ae3c531b401ce1816ae32-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-46.ec2.internal\" (UID: \"e0c6e405082ae3c531b401ce1816ae32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-46.ec2.internal"
Jul 28 08:02:45.558491 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.558266    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0c6e405082ae3c531b401ce1816ae32-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-46.ec2.internal\" (UID: \"e0c6e405082ae3c531b401ce1816ae32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-46.ec2.internal"
Jul 28 08:02:45.558491 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.558317    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e0c6e405082ae3c531b401ce1816ae32-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-46.ec2.internal\" (UID: \"e0c6e405082ae3c531b401ce1816ae32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-46.ec2.internal"
Jul 28 08:02:45.558491 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.558316    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a65f886f3c4206dc5fdaf20b8d13828e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-46.ec2.internal\" (UID: \"a65f886f3c4206dc5fdaf20b8d13828e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-46.ec2.internal"
Jul 28 08:02:45.558491 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.558364    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0c6e405082ae3c531b401ce1816ae32-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-46.ec2.internal\" (UID: \"e0c6e405082ae3c531b401ce1816ae32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-46.ec2.internal"
Jul 28 08:02:45.569352 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.569317    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-46.ec2.internal\" not found"
Jul 28 08:02:45.670168 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.670099    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-46.ec2.internal\" not found"
Jul 28 08:02:45.757486 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.757461    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-46.ec2.internal"
Jul 28 08:02:45.762350 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:45.762329    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-46.ec2.internal"
Jul 28 08:02:45.770682 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.770659    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-46.ec2.internal\" not found"
Jul 28 08:02:45.871223 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.871179    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-46.ec2.internal\" not found"
Jul 28 08:02:45.971749 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:45.971668    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-46.ec2.internal\" not found"
Jul 28 08:02:46.053063 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:46.053041    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 08:02:46.072094 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:46.072070    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-46.ec2.internal\" not found"
Jul 28 08:02:46.103240 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:46.103218    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 08:02:46.103629 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:46.103350    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 08:02:46.103629 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:46.103411    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 08:02:46.172206 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:46.172178    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-46.ec2.internal\" not found"
Jul 28 08:02:46.190346 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:46.190321    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 08:02:46.190346 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:46.190332    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 07:57:46 +0000 UTC" deadline="2028-03-18 20:45:35.40380016 +0000 UTC"
Jul 28 08:02:46.190497 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:46.190351    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14388h42m49.213451408s"
Jul 28 08:02:46.191283 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:46.191266    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 08:02:46.191364 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:46.191295    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 08:02:46.191364 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:46.191305    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeHasSufficientPID"
Jul 28 08:02:46.272481 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:46.272398    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-46.ec2.internal\" not found"
Jul 28 08:02:46.319967 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:46.319944    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 08:02:46.356892 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:46.356863    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-46.ec2.internal"
Jul 28 08:02:46.370274 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:46.370248    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 08:02:46.372249 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:46.372232    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-46.ec2.internal"
Jul 28 08:02:46.381190 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:46.381171    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 08:02:46.633623 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:46.633593    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 08:02:46.694309 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:46.694269    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c6e405082ae3c531b401ce1816ae32.slice/crio-658ac74e82bd623560eb932033053ee753afe3f66e1d99411905603b4da5045f WatchSource:0}: Error finding container 658ac74e82bd623560eb932033053ee753afe3f66e1d99411905603b4da5045f: Status 404 returned error can't find the container with id 658ac74e82bd623560eb932033053ee753afe3f66e1d99411905603b4da5045f
Jul 28 08:02:46.698317 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:46.698304    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 08:02:46.941386 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:46.941355    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda65f886f3c4206dc5fdaf20b8d13828e.slice/crio-264c5cc02500da51c47689ae3d32988599e4b4d5e7c8f55cff41a9fdca7d9d3f WatchSource:0}: Error finding container 264c5cc02500da51c47689ae3d32988599e4b4d5e7c8f55cff41a9fdca7d9d3f: Status 404 returned error can't find the container with id 264c5cc02500da51c47689ae3d32988599e4b4d5e7c8f55cff41a9fdca7d9d3f
Jul 28 08:02:47.139571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.139537    2583 apiserver.go:52] "Watching apiserver"
Jul 28 08:02:47.146214 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.146192    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 08:02:47.148039 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.148014    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-7r5vh","openshift-network-diagnostics/network-check-target-jd9ts","openshift-network-operator/iptables-alerter-wvtsz","openshift-ovn-kubernetes/ovnkube-node-6jpqb","kube-system/konnectivity-agent-rcmfm","kube-system/kube-apiserver-proxy-ip-10-0-130-46.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v","openshift-cluster-node-tuning-operator/tuned-lhcb7","openshift-image-registry/node-ca-z7hg4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-46.ec2.internal","openshift-multus/multus-additional-cni-plugins-bncs5","openshift-multus/network-metrics-daemon-xphvp","kube-system/global-pull-secret-syncer-84jc8","openshift-dns/node-resolver-22gll"]
Jul 28 08:02:47.150018 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.149991    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.151171 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.151141    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:02:47.151280 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:47.151247    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84jc8" podUID="4ddcaf19-3fc1-4058-a75d-1f584909d4e4"
Jul 28 08:02:47.152352 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.152330    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 08:02:47.152489 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.152336    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 08:02:47.152489 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.152419    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 08:02:47.152489 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.152457    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wvtsz"
Jul 28 08:02:47.152658 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.152523    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xfmsh\""
Jul 28 08:02:47.153726 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.153691    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.154669 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.154650    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 08:02:47.154765 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.154653    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 08:02:47.154830 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.154814    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v2vlc\""
Jul 28 08:02:47.154913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.154897    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 08:02:47.156043 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.156027    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xzfpm\""
Jul 28 08:02:47.156139 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.156041    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 08:02:47.156139 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.156084    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rcmfm"
Jul 28 08:02:47.156579 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.156439    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 08:02:47.156579 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.156453    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 08:02:47.156579 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.156499    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 08:02:47.156787 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.156770    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 08:02:47.156903 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.156886    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 08:02:47.157126 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.157111    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 08:02:47.157505 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.157477    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-22gll"
Jul 28 08:02:47.158341 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.158326    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 08:02:47.158412 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.158347    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 08:02:47.158718 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.158701    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qwm9s\""
Jul 28 08:02:47.158798 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.158740    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z7hg4"
Jul 28 08:02:47.159444 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.159427    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 08:02:47.162560 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.160314    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.162560 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.162327    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 08:02:47.162560 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.162397    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 08:02:47.162758 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.162707    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 08:02:47.162814 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.162762    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-www9t\""
Jul 28 08:02:47.162882 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.162808    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t2k22\""
Jul 28 08:02:47.163019 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.162991    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 08:02:47.163161 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.163142    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:02:47.163235 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:47.163211    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jd9ts" podUID="6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63"
Jul 28 08:02:47.164134 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.164111    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 08:02:47.164687 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.164671    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2rhp6\""
Jul 28 08:02:47.164811 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.164794    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 08:02:47.165034 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165018    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 08:02:47.165221 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165205    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-run-openvswitch\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.165286 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165233    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-run-ovn\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.165286 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165241    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 08:02:47.165286 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165256    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-node-log\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.165286 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165281    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-host-run-ovn-kubernetes\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.165477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165307    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e7b9b888-e51a-48c1-9ae4-f31a703c4521-env-overrides\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.165477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165324    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jq6p\" (UniqueName: \"kubernetes.io/projected/e7b9b888-e51a-48c1-9ae4-f31a703c4521-kube-api-access-6jq6p\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.165477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165339    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01ab6444-91e8-4b3b-b942-b81755e6574b-socket-dir\") pod \"aws-ebs-csi-driver-node-sv86v\" (UID: \"01ab6444-91e8-4b3b-b942-b81755e6574b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.165477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165354    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01ab6444-91e8-4b3b-b942-b81755e6574b-device-dir\") pod \"aws-ebs-csi-driver-node-sv86v\" (UID: \"01ab6444-91e8-4b3b-b942-b81755e6574b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.165477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165399    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/157f719d-c569-403c-94e0-f34ee3f68ac8-agent-certs\") pod \"konnectivity-agent-rcmfm\" (UID: \"157f719d-c569-403c-94e0-f34ee3f68ac8\") " pod="kube-system/konnectivity-agent-rcmfm"
Jul 28 08:02:47.165477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165416    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/42846769-0c19-40cb-936c-0c8f3d7db4c5-hosts-file\") pod \"node-resolver-22gll\" (UID: \"42846769-0c19-40cb-936c-0c8f3d7db4c5\") " pod="openshift-dns/node-resolver-22gll"
Jul 28 08:02:47.165477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165445    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01ab6444-91e8-4b3b-b942-b81755e6574b-registration-dir\") pod \"aws-ebs-csi-driver-node-sv86v\" (UID: \"01ab6444-91e8-4b3b-b942-b81755e6574b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.165477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165468    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-dbus\") pod \"global-pull-secret-syncer-84jc8\" (UID: \"4ddcaf19-3fc1-4058-a75d-1f584909d4e4\") " pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:02:47.165841 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165513    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret\") pod \"global-pull-secret-syncer-84jc8\" (UID: \"4ddcaf19-3fc1-4058-a75d-1f584909d4e4\") " pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:02:47.165841 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165540    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2bbdbee2-0b11-417e-8a75-f52affa81a4a-iptables-alerter-script\") pod \"iptables-alerter-wvtsz\" (UID: \"2bbdbee2-0b11-417e-8a75-f52affa81a4a\") " pod="openshift-network-operator/iptables-alerter-wvtsz"
Jul 28 08:02:47.165841 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165558    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-etc-openvswitch\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.165841 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165579    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-host-cni-netd\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.165841 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165604    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7b9b888-e51a-48c1-9ae4-f31a703c4521-ovn-node-metrics-cert\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.165841 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165629    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01ab6444-91e8-4b3b-b942-b81755e6574b-etc-selinux\") pod \"aws-ebs-csi-driver-node-sv86v\" (UID: \"01ab6444-91e8-4b3b-b942-b81755e6574b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.165841 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165656    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-systemd-units\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.165841 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165680    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e7b9b888-e51a-48c1-9ae4-f31a703c4521-ovnkube-script-lib\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.165841 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165725    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42846769-0c19-40cb-936c-0c8f3d7db4c5-tmp-dir\") pod \"node-resolver-22gll\" (UID: \"42846769-0c19-40cb-936c-0c8f3d7db4c5\") " pod="openshift-dns/node-resolver-22gll"
Jul 28 08:02:47.165841 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165739    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.165841 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165760    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01ab6444-91e8-4b3b-b942-b81755e6574b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sv86v\" (UID: \"01ab6444-91e8-4b3b-b942-b81755e6574b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.165841 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165812    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e7b9b888-e51a-48c1-9ae4-f31a703c4521-ovnkube-config\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.165841 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165837    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-kubelet-config\") pod \"global-pull-secret-syncer-84jc8\" (UID: \"4ddcaf19-3fc1-4058-a75d-1f584909d4e4\") " pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:02:47.166409 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165890    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-host-run-netns\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.166409 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165924    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-run-systemd\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.166409 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165970    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-host-cni-bin\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.166409 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.165997    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-log-socket\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.166409 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.166028    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01ab6444-91e8-4b3b-b942-b81755e6574b-sys-fs\") pod \"aws-ebs-csi-driver-node-sv86v\" (UID: \"01ab6444-91e8-4b3b-b942-b81755e6574b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.166409 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.166053    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db9wg\" (UniqueName: \"kubernetes.io/projected/01ab6444-91e8-4b3b-b942-b81755e6574b-kube-api-access-db9wg\") pod \"aws-ebs-csi-driver-node-sv86v\" (UID: \"01ab6444-91e8-4b3b-b942-b81755e6574b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.166409 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.166079    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2bbdbee2-0b11-417e-8a75-f52affa81a4a-host-slash\") pod \"iptables-alerter-wvtsz\" (UID: \"2bbdbee2-0b11-417e-8a75-f52affa81a4a\") " pod="openshift-network-operator/iptables-alerter-wvtsz"
Jul 28 08:02:47.166409 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.166111    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-host-slash\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.166409 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.166135    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-var-lib-openvswitch\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.166409 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.166160    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/157f719d-c569-403c-94e0-f34ee3f68ac8-konnectivity-ca\") pod \"konnectivity-agent-rcmfm\" (UID: \"157f719d-c569-403c-94e0-f34ee3f68ac8\") " pod="kube-system/konnectivity-agent-rcmfm"
Jul 28 08:02:47.166409 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.166195    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4k29\" (UniqueName: \"kubernetes.io/projected/2bbdbee2-0b11-417e-8a75-f52affa81a4a-kube-api-access-r4k29\") pod \"iptables-alerter-wvtsz\" (UID: \"2bbdbee2-0b11-417e-8a75-f52affa81a4a\") " pod="openshift-network-operator/iptables-alerter-wvtsz"
Jul 28 08:02:47.166409 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.166221    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-host-kubelet\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.166409 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.166247    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.166409 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.166274    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qhhg\" (UniqueName: \"kubernetes.io/projected/42846769-0c19-40cb-936c-0c8f3d7db4c5-kube-api-access-8qhhg\") pod \"node-resolver-22gll\" (UID: \"42846769-0c19-40cb-936c-0c8f3d7db4c5\") " pod="openshift-dns/node-resolver-22gll"
Jul 28 08:02:47.167180 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.167165    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.168273 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.168252    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9sr2q\""
Jul 28 08:02:47.168345 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.168290    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 08:02:47.168460 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.168442    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:02:47.168560 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:47.168515    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xphvp" podUID="eb7a2f95-8714-4283-8dcf-66f1fb75b4e4"
Jul 28 08:02:47.168671 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.168568    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 08:02:47.170502 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.170482    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 08:02:47.170626 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.170523    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dn8k4\""
Jul 28 08:02:47.170626 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.170523    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 08:02:47.172269 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.172247    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 08:02:47.201246 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.201224    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vlwh2"
Jul 28 08:02:47.209647 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.209629    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vlwh2"
Jul 28 08:02:47.257138 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.257110    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 08:02:47.266528 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.266502    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-multus-cni-dir\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.266591 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.266561    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2bbdbee2-0b11-417e-8a75-f52affa81a4a-host-slash\") pod \"iptables-alerter-wvtsz\" (UID: \"2bbdbee2-0b11-417e-8a75-f52affa81a4a\") " pod="openshift-network-operator/iptables-alerter-wvtsz"
Jul 28 08:02:47.266625 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.266593    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-host-slash\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.266625 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.266619    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-os-release\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.266701 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.266637    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8b607d7-a050-4231-a779-045d369abaf1-cni-binary-copy\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.266701 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.266635    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2bbdbee2-0b11-417e-8a75-f52affa81a4a-host-slash\") pod \"iptables-alerter-wvtsz\" (UID: \"2bbdbee2-0b11-417e-8a75-f52affa81a4a\") " pod="openshift-network-operator/iptables-alerter-wvtsz"
Jul 28 08:02:47.266701 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.266661    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4k29\" (UniqueName: \"kubernetes.io/projected/2bbdbee2-0b11-417e-8a75-f52affa81a4a-kube-api-access-r4k29\") pod \"iptables-alerter-wvtsz\" (UID: \"2bbdbee2-0b11-417e-8a75-f52affa81a4a\") " pod="openshift-network-operator/iptables-alerter-wvtsz"
Jul 28 08:02:47.266701 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.266688    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-host-kubelet\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.266833 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.266698    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-host-slash\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.266833 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.266713    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5585cee-7829-4764-8f3e-387217b86dbe-system-cni-dir\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.266833 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.266733    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-multus-conf-dir\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.266833 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.266745    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-host-kubelet\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.266833 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.266750    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-run-openvswitch\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.266833 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.266779    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-run-ovn\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.266833 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.266798    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e7b9b888-e51a-48c1-9ae4-f31a703c4521-env-overrides\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.266833 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.266818    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jq6p\" (UniqueName: \"kubernetes.io/projected/e7b9b888-e51a-48c1-9ae4-f31a703c4521-kube-api-access-6jq6p\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.266833 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.266828    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-run-ovn\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.267167 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.266837    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-host-var-lib-kubelet\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.267167 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.266799    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-run-openvswitch\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.267167 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.266881    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01ab6444-91e8-4b3b-b942-b81755e6574b-socket-dir\") pod \"aws-ebs-csi-driver-node-sv86v\" (UID: \"01ab6444-91e8-4b3b-b942-b81755e6574b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.267167 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.267011    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01ab6444-91e8-4b3b-b942-b81755e6574b-device-dir\") pod \"aws-ebs-csi-driver-node-sv86v\" (UID: \"01ab6444-91e8-4b3b-b942-b81755e6574b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.267167 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.267060    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/42846769-0c19-40cb-936c-0c8f3d7db4c5-hosts-file\") pod \"node-resolver-22gll\" (UID: \"42846769-0c19-40cb-936c-0c8f3d7db4c5\") " pod="openshift-dns/node-resolver-22gll"
Jul 28 08:02:47.267167 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.267110    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01ab6444-91e8-4b3b-b942-b81755e6574b-socket-dir\") pod \"aws-ebs-csi-driver-node-sv86v\" (UID: \"01ab6444-91e8-4b3b-b942-b81755e6574b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.267167 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.267121    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/42846769-0c19-40cb-936c-0c8f3d7db4c5-hosts-file\") pod \"node-resolver-22gll\" (UID: \"42846769-0c19-40cb-936c-0c8f3d7db4c5\") " pod="openshift-dns/node-resolver-22gll"
Jul 28 08:02:47.267167 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.267110    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01ab6444-91e8-4b3b-b942-b81755e6574b-device-dir\") pod \"aws-ebs-csi-driver-node-sv86v\" (UID: \"01ab6444-91e8-4b3b-b942-b81755e6574b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.267167 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.267141    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-host-run-netns\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.267470 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.267200    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-dbus\") pod \"global-pull-secret-syncer-84jc8\" (UID: \"4ddcaf19-3fc1-4058-a75d-1f584909d4e4\") " pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:02:47.267470 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.267230    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret\") pod \"global-pull-secret-syncer-84jc8\" (UID: \"4ddcaf19-3fc1-4058-a75d-1f584909d4e4\") " pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:02:47.267470 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:47.267330    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 08:02:47.267470 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.267431    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e7b9b888-e51a-48c1-9ae4-f31a703c4521-env-overrides\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.267470 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.267441    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-dbus\") pod \"global-pull-secret-syncer-84jc8\" (UID: \"4ddcaf19-3fc1-4058-a75d-1f584909d4e4\") " pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:02:47.267772 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.267755    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-etc-openvswitch\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.267814 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.267778    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-etc-openvswitch\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.267814 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.267790    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7b9b888-e51a-48c1-9ae4-f31a703c4521-ovn-node-metrics-cert\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.267883 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.267818    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvbkv\" (UniqueName: \"kubernetes.io/projected/a5585cee-7829-4764-8f3e-387217b86dbe-kube-api-access-vvbkv\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.267883 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:47.267872    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret podName:4ddcaf19-3fc1-4058-a75d-1f584909d4e4 nodeName:}" failed. No retries permitted until 2026-07-28 08:02:47.767825436 +0000 UTC m=+2.955013553 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret") pod "global-pull-secret-syncer-84jc8" (UID: "4ddcaf19-3fc1-4058-a75d-1f584909d4e4") : object "kube-system"/"original-pull-secret" not registered
Jul 28 08:02:47.267971 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.267921    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sql9q\" (UniqueName: \"kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q\") pod \"network-check-target-jd9ts\" (UID: \"6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63\") " pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:02:47.267971 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.267952    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-host-var-lib-cni-bin\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.268051 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.267980    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01ab6444-91e8-4b3b-b942-b81755e6574b-etc-selinux\") pod \"aws-ebs-csi-driver-node-sv86v\" (UID: \"01ab6444-91e8-4b3b-b942-b81755e6574b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.268051 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268012    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-systemd-units\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.268124 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268061    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-lib-modules\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.268124 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268091    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5585cee-7829-4764-8f3e-387217b86dbe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.268124 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268116    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01ab6444-91e8-4b3b-b942-b81755e6574b-etc-selinux\") pod \"aws-ebs-csi-driver-node-sv86v\" (UID: \"01ab6444-91e8-4b3b-b942-b81755e6574b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.268234 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268122    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5585cee-7829-4764-8f3e-387217b86dbe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.268234 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268138    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-systemd-units\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.268234 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268164    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-etc-kubernetes\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.268234 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268165    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 08:02:47.268234 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268183    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-sys\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.268234 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268199    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1bc071b-1927-435b-bea2-1b1d5265c8ae-tmp\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.268436 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268234    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2fdc640c-ac36-407b-8fe0-d497c4cc05c2-serviceca\") pod \"node-ca-z7hg4\" (UID: \"2fdc640c-ac36-407b-8fe0-d497c4cc05c2\") " pod="openshift-image-registry/node-ca-z7hg4"
Jul 28 08:02:47.268436 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268254    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-system-cni-dir\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.268436 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268272    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-kubelet-config\") pod \"global-pull-secret-syncer-84jc8\" (UID: \"4ddcaf19-3fc1-4058-a75d-1f584909d4e4\") " pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:02:47.268436 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268289    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-run-systemd\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.268436 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268312    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-var-lib-kubelet\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.268436 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268335    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-cnibin\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.268436 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268345    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-run-systemd\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.268436 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268353    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-kubelet-config\") pod \"global-pull-secret-syncer-84jc8\" (UID: \"4ddcaf19-3fc1-4058-a75d-1f584909d4e4\") " pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:02:47.268436 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268359    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-log-socket\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.268436 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268398    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-log-socket\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.268436 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268417    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01ab6444-91e8-4b3b-b942-b81755e6574b-sys-fs\") pod \"aws-ebs-csi-driver-node-sv86v\" (UID: \"01ab6444-91e8-4b3b-b942-b81755e6574b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.268436 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268433    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db9wg\" (UniqueName: \"kubernetes.io/projected/01ab6444-91e8-4b3b-b942-b81755e6574b-kube-api-access-db9wg\") pod \"aws-ebs-csi-driver-node-sv86v\" (UID: \"01ab6444-91e8-4b3b-b942-b81755e6574b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.268892 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268454    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-var-lib-openvswitch\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.268892 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268493    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-var-lib-openvswitch\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.268892 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268509    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/157f719d-c569-403c-94e0-f34ee3f68ac8-konnectivity-ca\") pod \"konnectivity-agent-rcmfm\" (UID: \"157f719d-c569-403c-94e0-f34ee3f68ac8\") " pod="kube-system/konnectivity-agent-rcmfm"
Jul 28 08:02:47.268892 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268510    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01ab6444-91e8-4b3b-b942-b81755e6574b-sys-fs\") pod \"aws-ebs-csi-driver-node-sv86v\" (UID: \"01ab6444-91e8-4b3b-b942-b81755e6574b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.268892 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268533    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5585cee-7829-4764-8f3e-387217b86dbe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.268892 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268571    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2fdc640c-ac36-407b-8fe0-d497c4cc05c2-host\") pod \"node-ca-z7hg4\" (UID: \"2fdc640c-ac36-407b-8fe0-d497c4cc05c2\") " pod="openshift-image-registry/node-ca-z7hg4"
Jul 28 08:02:47.268892 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268601    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.268892 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268626    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qhhg\" (UniqueName: \"kubernetes.io/projected/42846769-0c19-40cb-936c-0c8f3d7db4c5-kube-api-access-8qhhg\") pod \"node-resolver-22gll\" (UID: \"42846769-0c19-40cb-936c-0c8f3d7db4c5\") " pod="openshift-dns/node-resolver-22gll"
Jul 28 08:02:47.268892 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268651    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-host\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.268892 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268666    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.268892 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268675    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b8b607d7-a050-4231-a779-045d369abaf1-multus-daemon-config\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.268892 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268725    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-etc-kubernetes\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.268892 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268753    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-node-log\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.268892 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268795    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-host-run-ovn-kubernetes\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.268892 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268822    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5585cee-7829-4764-8f3e-387217b86dbe-cnibin\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.268892 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268855    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-host-run-ovn-kubernetes\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.268892 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268856    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-node-log\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.269571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268866    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs\") pod \"network-metrics-daemon-xphvp\" (UID: \"eb7a2f95-8714-4283-8dcf-66f1fb75b4e4\") " pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:02:47.269571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268906    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-etc-systemd\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.269571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268931    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1bc071b-1927-435b-bea2-1b1d5265c8ae-etc-tuned\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.269571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268956    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-multus-socket-dir-parent\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.269571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.268984    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/157f719d-c569-403c-94e0-f34ee3f68ac8-agent-certs\") pod \"konnectivity-agent-rcmfm\" (UID: \"157f719d-c569-403c-94e0-f34ee3f68ac8\") " pod="kube-system/konnectivity-agent-rcmfm"
Jul 28 08:02:47.269571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269009    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-etc-sysconfig\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.269571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269035    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsc5n\" (UniqueName: \"kubernetes.io/projected/e1bc071b-1927-435b-bea2-1b1d5265c8ae-kube-api-access-jsc5n\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.269571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269061    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7bgp\" (UniqueName: \"kubernetes.io/projected/2fdc640c-ac36-407b-8fe0-d497c4cc05c2-kube-api-access-h7bgp\") pod \"node-ca-z7hg4\" (UID: \"2fdc640c-ac36-407b-8fe0-d497c4cc05c2\") " pod="openshift-image-registry/node-ca-z7hg4"
Jul 28 08:02:47.269571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269094    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98858\" (UniqueName: \"kubernetes.io/projected/b8b607d7-a050-4231-a779-045d369abaf1-kube-api-access-98858\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.269571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269103    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/157f719d-c569-403c-94e0-f34ee3f68ac8-konnectivity-ca\") pod \"konnectivity-agent-rcmfm\" (UID: \"157f719d-c569-403c-94e0-f34ee3f68ac8\") " pod="kube-system/konnectivity-agent-rcmfm"
Jul 28 08:02:47.269571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269123    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01ab6444-91e8-4b3b-b942-b81755e6574b-registration-dir\") pod \"aws-ebs-csi-driver-node-sv86v\" (UID: \"01ab6444-91e8-4b3b-b942-b81755e6574b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.269571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269145    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2bbdbee2-0b11-417e-8a75-f52affa81a4a-iptables-alerter-script\") pod \"iptables-alerter-wvtsz\" (UID: \"2bbdbee2-0b11-417e-8a75-f52affa81a4a\") " pod="openshift-network-operator/iptables-alerter-wvtsz"
Jul 28 08:02:47.269571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269157    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01ab6444-91e8-4b3b-b942-b81755e6574b-registration-dir\") pod \"aws-ebs-csi-driver-node-sv86v\" (UID: \"01ab6444-91e8-4b3b-b942-b81755e6574b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.269571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269169    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-host-cni-netd\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.269571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269192    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e7b9b888-e51a-48c1-9ae4-f31a703c4521-ovnkube-script-lib\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.269571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269218    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42846769-0c19-40cb-936c-0c8f3d7db4c5-tmp-dir\") pod \"node-resolver-22gll\" (UID: \"42846769-0c19-40cb-936c-0c8f3d7db4c5\") " pod="openshift-dns/node-resolver-22gll"
Jul 28 08:02:47.269571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269224    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-host-cni-netd\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.270453 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269246    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqgjq\" (UniqueName: \"kubernetes.io/projected/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-kube-api-access-rqgjq\") pod \"network-metrics-daemon-xphvp\" (UID: \"eb7a2f95-8714-4283-8dcf-66f1fb75b4e4\") " pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:02:47.270453 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269270    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-hostroot\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.270453 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269687    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-etc-modprobe-d\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.270453 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269735    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-host-run-k8s-cni-cncf-io\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.270453 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269766    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-host-var-lib-cni-multus\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.270453 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269792    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-host-run-multus-certs\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.270453 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269830    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01ab6444-91e8-4b3b-b942-b81755e6574b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sv86v\" (UID: \"01ab6444-91e8-4b3b-b942-b81755e6574b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.270453 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269862    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e7b9b888-e51a-48c1-9ae4-f31a703c4521-ovnkube-config\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.270453 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269893    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5585cee-7829-4764-8f3e-387217b86dbe-os-release\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.270453 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269926    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-etc-sysctl-d\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.270453 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269948    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-etc-sysctl-conf\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.270453 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.269977    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-run\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.270453 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.270011    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-host-run-netns\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.270453 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.270045    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-host-cni-bin\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.270453 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.270053    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2bbdbee2-0b11-417e-8a75-f52affa81a4a-iptables-alerter-script\") pod \"iptables-alerter-wvtsz\" (UID: \"2bbdbee2-0b11-417e-8a75-f52affa81a4a\") " pod="openshift-network-operator/iptables-alerter-wvtsz"
Jul 28 08:02:47.270453 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.270080    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5585cee-7829-4764-8f3e-387217b86dbe-cni-binary-copy\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.270453 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.270396    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42846769-0c19-40cb-936c-0c8f3d7db4c5-tmp-dir\") pod \"node-resolver-22gll\" (UID: \"42846769-0c19-40cb-936c-0c8f3d7db4c5\") " pod="openshift-dns/node-resolver-22gll"
Jul 28 08:02:47.271363 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.270518    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-host-run-netns\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.271363 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.270613    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7b9b888-e51a-48c1-9ae4-f31a703c4521-host-cni-bin\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.271363 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.270713    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01ab6444-91e8-4b3b-b942-b81755e6574b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sv86v\" (UID: \"01ab6444-91e8-4b3b-b942-b81755e6574b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.271363 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.270743    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e7b9b888-e51a-48c1-9ae4-f31a703c4521-ovnkube-config\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.273409 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.271728    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e7b9b888-e51a-48c1-9ae4-f31a703c4521-ovnkube-script-lib\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.273409 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.272515    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/157f719d-c569-403c-94e0-f34ee3f68ac8-agent-certs\") pod \"konnectivity-agent-rcmfm\" (UID: \"157f719d-c569-403c-94e0-f34ee3f68ac8\") " pod="kube-system/konnectivity-agent-rcmfm"
Jul 28 08:02:47.273924 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.273905    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7b9b888-e51a-48c1-9ae4-f31a703c4521-ovn-node-metrics-cert\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.276275 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.276249    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4k29\" (UniqueName: \"kubernetes.io/projected/2bbdbee2-0b11-417e-8a75-f52affa81a4a-kube-api-access-r4k29\") pod \"iptables-alerter-wvtsz\" (UID: \"2bbdbee2-0b11-417e-8a75-f52affa81a4a\") " pod="openshift-network-operator/iptables-alerter-wvtsz"
Jul 28 08:02:47.276407 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.276383    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jq6p\" (UniqueName: \"kubernetes.io/projected/e7b9b888-e51a-48c1-9ae4-f31a703c4521-kube-api-access-6jq6p\") pod \"ovnkube-node-6jpqb\" (UID: \"e7b9b888-e51a-48c1-9ae4-f31a703c4521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.277096 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.277074    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qhhg\" (UniqueName: \"kubernetes.io/projected/42846769-0c19-40cb-936c-0c8f3d7db4c5-kube-api-access-8qhhg\") pod \"node-resolver-22gll\" (UID: \"42846769-0c19-40cb-936c-0c8f3d7db4c5\") " pod="openshift-dns/node-resolver-22gll"
Jul 28 08:02:47.277731 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.277714    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db9wg\" (UniqueName: \"kubernetes.io/projected/01ab6444-91e8-4b3b-b942-b81755e6574b-kube-api-access-db9wg\") pod \"aws-ebs-csi-driver-node-sv86v\" (UID: \"01ab6444-91e8-4b3b-b942-b81755e6574b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.333587 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.333531    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-46.ec2.internal" event={"ID":"a65f886f3c4206dc5fdaf20b8d13828e","Type":"ContainerStarted","Data":"264c5cc02500da51c47689ae3d32988599e4b4d5e7c8f55cff41a9fdca7d9d3f"}
Jul 28 08:02:47.335144 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.335118    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-46.ec2.internal" event={"ID":"e0c6e405082ae3c531b401ce1816ae32","Type":"ContainerStarted","Data":"658ac74e82bd623560eb932033053ee753afe3f66e1d99411905603b4da5045f"}
Jul 28 08:02:47.370466 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.370411    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98858\" (UniqueName: \"kubernetes.io/projected/b8b607d7-a050-4231-a779-045d369abaf1-kube-api-access-98858\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.370659 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.370479    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqgjq\" (UniqueName: \"kubernetes.io/projected/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-kube-api-access-rqgjq\") pod \"network-metrics-daemon-xphvp\" (UID: \"eb7a2f95-8714-4283-8dcf-66f1fb75b4e4\") " pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:02:47.370659 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.370514    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-hostroot\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.370659 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.370539    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-etc-modprobe-d\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.370659 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.370564    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-host-run-k8s-cni-cncf-io\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.370659 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.370647    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-hostroot\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.370948 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.370676    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-host-var-lib-cni-multus\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.370948 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.370711    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-host-run-multus-certs\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.370948 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.370718    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-host-var-lib-cni-multus\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.370948 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.370716    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-etc-modprobe-d\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.370948 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.370754    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-host-run-multus-certs\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.370948 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.370764    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5585cee-7829-4764-8f3e-387217b86dbe-os-release\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.370948 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.370715    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-host-run-k8s-cni-cncf-io\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.370948 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.370845    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-etc-sysctl-d\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.370948 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.370886    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-etc-sysctl-conf\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.370948 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.370914    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-run\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.370948 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.370913    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5585cee-7829-4764-8f3e-387217b86dbe-os-release\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.371499 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.370947    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5585cee-7829-4764-8f3e-387217b86dbe-cni-binary-copy\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.371499 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.370989    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-run\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.371499 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371032    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-multus-cni-dir\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.371499 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371041    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-etc-sysctl-conf\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.371499 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371039    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-etc-sysctl-d\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.371499 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371068    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-os-release\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.371499 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371115    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8b607d7-a050-4231-a779-045d369abaf1-cni-binary-copy\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.371499 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371126    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-multus-cni-dir\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.371499 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371129    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-os-release\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.371499 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371144    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5585cee-7829-4764-8f3e-387217b86dbe-system-cni-dir\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.371499 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371179    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-multus-conf-dir\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.371499 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371198    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-host-var-lib-kubelet\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.371499 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371215    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-host-run-netns\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.371499 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371231    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5585cee-7829-4764-8f3e-387217b86dbe-system-cni-dir\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.371499 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371247    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-multus-conf-dir\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.371499 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371259    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvbkv\" (UniqueName: \"kubernetes.io/projected/a5585cee-7829-4764-8f3e-387217b86dbe-kube-api-access-vvbkv\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.371499 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371284    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-host-var-lib-kubelet\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.371499 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371287    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-host-run-netns\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.372477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371314    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sql9q\" (UniqueName: \"kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q\") pod \"network-check-target-jd9ts\" (UID: \"6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63\") " pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:02:47.372477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371441    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-host-var-lib-cni-bin\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.372477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371576    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-host-var-lib-cni-bin\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.372477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371589    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-lib-modules\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.372477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371633    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5585cee-7829-4764-8f3e-387217b86dbe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.372477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371667    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5585cee-7829-4764-8f3e-387217b86dbe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.372477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371692    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-etc-kubernetes\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.372477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371689    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5585cee-7829-4764-8f3e-387217b86dbe-cni-binary-copy\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.372477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371718    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-lib-modules\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.372477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371743    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-etc-kubernetes\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.372477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371761    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-sys\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.372477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371776    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8b607d7-a050-4231-a779-045d369abaf1-cni-binary-copy\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.372477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1bc071b-1927-435b-bea2-1b1d5265c8ae-tmp\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.372477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371815    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2fdc640c-ac36-407b-8fe0-d497c4cc05c2-serviceca\") pod \"node-ca-z7hg4\" (UID: \"2fdc640c-ac36-407b-8fe0-d497c4cc05c2\") " pod="openshift-image-registry/node-ca-z7hg4"
Jul 28 08:02:47.372477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371833    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-sys\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.372477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371838    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5585cee-7829-4764-8f3e-387217b86dbe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.372477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371840    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-system-cni-dir\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.372477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371886    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-system-cni-dir\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.373439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371933    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-var-lib-kubelet\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.373439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.371956    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-cnibin\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.373439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372020    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-var-lib-kubelet\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.373439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372019    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-cnibin\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.373439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372056    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5585cee-7829-4764-8f3e-387217b86dbe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.373439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372084    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2fdc640c-ac36-407b-8fe0-d497c4cc05c2-host\") pod \"node-ca-z7hg4\" (UID: \"2fdc640c-ac36-407b-8fe0-d497c4cc05c2\") " pod="openshift-image-registry/node-ca-z7hg4"
Jul 28 08:02:47.373439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372112    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-host\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.373439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372138    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b8b607d7-a050-4231-a779-045d369abaf1-multus-daemon-config\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.373439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372187    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5585cee-7829-4764-8f3e-387217b86dbe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.373439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372192    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-etc-kubernetes\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.373439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372225    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-etc-kubernetes\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.373439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372221    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2fdc640c-ac36-407b-8fe0-d497c4cc05c2-host\") pod \"node-ca-z7hg4\" (UID: \"2fdc640c-ac36-407b-8fe0-d497c4cc05c2\") " pod="openshift-image-registry/node-ca-z7hg4"
Jul 28 08:02:47.373439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372254    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5585cee-7829-4764-8f3e-387217b86dbe-cnibin\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.373439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372276    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2fdc640c-ac36-407b-8fe0-d497c4cc05c2-serviceca\") pod \"node-ca-z7hg4\" (UID: \"2fdc640c-ac36-407b-8fe0-d497c4cc05c2\") " pod="openshift-image-registry/node-ca-z7hg4"
Jul 28 08:02:47.373439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372287    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs\") pod \"network-metrics-daemon-xphvp\" (UID: \"eb7a2f95-8714-4283-8dcf-66f1fb75b4e4\") " pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:02:47.373439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372290    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-host\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.373439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372323    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5585cee-7829-4764-8f3e-387217b86dbe-cnibin\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.373439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372325    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-etc-systemd\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.374439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372371    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-etc-systemd\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.374439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372362    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1bc071b-1927-435b-bea2-1b1d5265c8ae-etc-tuned\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.374439 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:47.372392    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 08:02:47.374439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372411    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-multus-socket-dir-parent\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.374439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372447    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-etc-sysconfig\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.374439 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:47.372465    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs podName:eb7a2f95-8714-4283-8dcf-66f1fb75b4e4 nodeName:}" failed. No retries permitted until 2026-07-28 08:02:47.872444871 +0000 UTC m=+3.059632998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs") pod "network-metrics-daemon-xphvp" (UID: "eb7a2f95-8714-4283-8dcf-66f1fb75b4e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 08:02:47.374439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsc5n\" (UniqueName: \"kubernetes.io/projected/e1bc071b-1927-435b-bea2-1b1d5265c8ae-kube-api-access-jsc5n\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.374439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372533    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5585cee-7829-4764-8f3e-387217b86dbe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.374439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372543    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7bgp\" (UniqueName: \"kubernetes.io/projected/2fdc640c-ac36-407b-8fe0-d497c4cc05c2-kube-api-access-h7bgp\") pod \"node-ca-z7hg4\" (UID: \"2fdc640c-ac36-407b-8fe0-d497c4cc05c2\") " pod="openshift-image-registry/node-ca-z7hg4"
Jul 28 08:02:47.374439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372593    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b8b607d7-a050-4231-a779-045d369abaf1-multus-socket-dir-parent\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.374439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.372574    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1bc071b-1927-435b-bea2-1b1d5265c8ae-etc-sysconfig\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.374439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.373351    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b8b607d7-a050-4231-a779-045d369abaf1-multus-daemon-config\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.375102 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.374578    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1bc071b-1927-435b-bea2-1b1d5265c8ae-tmp\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.375102 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.374890    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1bc071b-1927-435b-bea2-1b1d5265c8ae-etc-tuned\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.379575 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.379551    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqgjq\" (UniqueName: \"kubernetes.io/projected/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-kube-api-access-rqgjq\") pod \"network-metrics-daemon-xphvp\" (UID: \"eb7a2f95-8714-4283-8dcf-66f1fb75b4e4\") " pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:02:47.382592 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:47.382274    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 08:02:47.382592 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:47.382307    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 08:02:47.382592 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:47.382322    2583 projected.go:196] Error preparing data for projected volume kube-api-access-sql9q for pod openshift-network-diagnostics/network-check-target-jd9ts: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 08:02:47.382592 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:47.382387    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q podName:6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63 nodeName:}" failed. No retries permitted until 2026-07-28 08:02:47.882368518 +0000 UTC m=+3.069556646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sql9q" (UniqueName: "kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q") pod "network-check-target-jd9ts" (UID: "6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 08:02:47.385067 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.385031    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvbkv\" (UniqueName: \"kubernetes.io/projected/a5585cee-7829-4764-8f3e-387217b86dbe-kube-api-access-vvbkv\") pod \"multus-additional-cni-plugins-bncs5\" (UID: \"a5585cee-7829-4764-8f3e-387217b86dbe\") " pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.385695 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.385667    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsc5n\" (UniqueName: \"kubernetes.io/projected/e1bc071b-1927-435b-bea2-1b1d5265c8ae-kube-api-access-jsc5n\") pod \"tuned-lhcb7\" (UID: \"e1bc071b-1927-435b-bea2-1b1d5265c8ae\") " pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.385832 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.385810    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7bgp\" (UniqueName: \"kubernetes.io/projected/2fdc640c-ac36-407b-8fe0-d497c4cc05c2-kube-api-access-h7bgp\") pod \"node-ca-z7hg4\" (UID: \"2fdc640c-ac36-407b-8fe0-d497c4cc05c2\") " pod="openshift-image-registry/node-ca-z7hg4"
Jul 28 08:02:47.385970 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.385915    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98858\" (UniqueName: \"kubernetes.io/projected/b8b607d7-a050-4231-a779-045d369abaf1-kube-api-access-98858\") pod \"multus-7r5vh\" (UID: \"b8b607d7-a050-4231-a779-045d369abaf1\") " pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.390611 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.390593    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 08:02:47.462275 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.462182    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v"
Jul 28 08:02:47.470329 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.470302    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:02:47.472748 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:47.472714    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ab6444_91e8_4b3b_b942_b81755e6574b.slice/crio-364325e59e4f6e64815d04c0222778b7e14ac3d895f8d859e80f5b7050147356 WatchSource:0}: Error finding container 364325e59e4f6e64815d04c0222778b7e14ac3d895f8d859e80f5b7050147356: Status 404 returned error can't find the container with id 364325e59e4f6e64815d04c0222778b7e14ac3d895f8d859e80f5b7050147356
Jul 28 08:02:47.478244 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.478220    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wvtsz"
Jul 28 08:02:47.482503 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:47.482463    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b9b888_e51a_48c1_9ae4_f31a703c4521.slice/crio-e5d88871b0e59706cbfe297820753379397e832dcf48ae15e237642de05a4de2 WatchSource:0}: Error finding container e5d88871b0e59706cbfe297820753379397e832dcf48ae15e237642de05a4de2: Status 404 returned error can't find the container with id e5d88871b0e59706cbfe297820753379397e832dcf48ae15e237642de05a4de2
Jul 28 08:02:47.482680 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.482656    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rcmfm"
Jul 28 08:02:47.488681 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.488658    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-22gll"
Jul 28 08:02:47.489283 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:47.489256    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bbdbee2_0b11_417e_8a75_f52affa81a4a.slice/crio-c316ca79038e0a0cc79f78c24ccb28db8414f6aa8f1d9421b6c967458f60b554 WatchSource:0}: Error finding container c316ca79038e0a0cc79f78c24ccb28db8414f6aa8f1d9421b6c967458f60b554: Status 404 returned error can't find the container with id c316ca79038e0a0cc79f78c24ccb28db8414f6aa8f1d9421b6c967458f60b554
Jul 28 08:02:47.492698 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:47.492668    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod157f719d_c569_403c_94e0_f34ee3f68ac8.slice/crio-25e0c5e4402fe2f5e1e1a145a5f4853af269f2276ac83b76a7da3ab14d2201e7 WatchSource:0}: Error finding container 25e0c5e4402fe2f5e1e1a145a5f4853af269f2276ac83b76a7da3ab14d2201e7: Status 404 returned error can't find the container with id 25e0c5e4402fe2f5e1e1a145a5f4853af269f2276ac83b76a7da3ab14d2201e7
Jul 28 08:02:47.494030 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.494010    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z7hg4"
Jul 28 08:02:47.498312 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:47.498277    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42846769_0c19_40cb_936c_0c8f3d7db4c5.slice/crio-22f2287865e81a9e1914592a6bdd8c61cdeb116c91879fafd94382e95ade44ad WatchSource:0}: Error finding container 22f2287865e81a9e1914592a6bdd8c61cdeb116c91879fafd94382e95ade44ad: Status 404 returned error can't find the container with id 22f2287865e81a9e1914592a6bdd8c61cdeb116c91879fafd94382e95ade44ad
Jul 28 08:02:47.499559 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.499538    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7r5vh"
Jul 28 08:02:47.503815 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:47.503787    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fdc640c_ac36_407b_8fe0_d497c4cc05c2.slice/crio-4edb44ced3f4802b74d8d0b6c3e22b13c70a63ebe34ee23f1c6516e0a5b3d244 WatchSource:0}: Error finding container 4edb44ced3f4802b74d8d0b6c3e22b13c70a63ebe34ee23f1c6516e0a5b3d244: Status 404 returned error can't find the container with id 4edb44ced3f4802b74d8d0b6c3e22b13c70a63ebe34ee23f1c6516e0a5b3d244
Jul 28 08:02:47.504666 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.504646    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lhcb7"
Jul 28 08:02:47.509347 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.509325    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bncs5"
Jul 28 08:02:47.516727 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:47.516691    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1bc071b_1927_435b_bea2_1b1d5265c8ae.slice/crio-a569f210228d63c1324a988eb2c4d26b04af471675b54d114627096304e4b7d0 WatchSource:0}: Error finding container a569f210228d63c1324a988eb2c4d26b04af471675b54d114627096304e4b7d0: Status 404 returned error can't find the container with id a569f210228d63c1324a988eb2c4d26b04af471675b54d114627096304e4b7d0
Jul 28 08:02:47.520307 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:02:47.520278    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5585cee_7829_4764_8f3e_387217b86dbe.slice/crio-a9a84f06d15fe33344b5e42af29216155f2f34597f341da3d40fb8c259c8e96d WatchSource:0}: Error finding container a9a84f06d15fe33344b5e42af29216155f2f34597f341da3d40fb8c259c8e96d: Status 404 returned error can't find the container with id a9a84f06d15fe33344b5e42af29216155f2f34597f341da3d40fb8c259c8e96d
Jul 28 08:02:47.775900 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.775807    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret\") pod \"global-pull-secret-syncer-84jc8\" (UID: \"4ddcaf19-3fc1-4058-a75d-1f584909d4e4\") " pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:02:47.776082 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:47.776043    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 08:02:47.776144 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:47.776125    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret podName:4ddcaf19-3fc1-4058-a75d-1f584909d4e4 nodeName:}" failed. No retries permitted until 2026-07-28 08:02:48.776101991 +0000 UTC m=+3.963290105 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret") pod "global-pull-secret-syncer-84jc8" (UID: "4ddcaf19-3fc1-4058-a75d-1f584909d4e4") : object "kube-system"/"original-pull-secret" not registered
Jul 28 08:02:47.877148 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.877107    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs\") pod \"network-metrics-daemon-xphvp\" (UID: \"eb7a2f95-8714-4283-8dcf-66f1fb75b4e4\") " pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:02:47.877346 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:47.877291    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 08:02:47.877414 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:47.877371    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs podName:eb7a2f95-8714-4283-8dcf-66f1fb75b4e4 nodeName:}" failed. No retries permitted until 2026-07-28 08:02:48.877348935 +0000 UTC m=+4.064537052 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs") pod "network-metrics-daemon-xphvp" (UID: "eb7a2f95-8714-4283-8dcf-66f1fb75b4e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 08:02:47.978552 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:47.977848    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sql9q\" (UniqueName: \"kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q\") pod \"network-check-target-jd9ts\" (UID: \"6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63\") " pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:02:47.978552 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:47.978148    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 08:02:47.978552 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:47.978174    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 08:02:47.978552 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:47.978189    2583 projected.go:196] Error preparing data for projected volume kube-api-access-sql9q for pod openshift-network-diagnostics/network-check-target-jd9ts: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 08:02:47.978552 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:47.978257    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q podName:6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63 nodeName:}" failed. No retries permitted until 2026-07-28 08:02:48.978235957 +0000 UTC m=+4.165424073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sql9q" (UniqueName: "kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q") pod "network-check-target-jd9ts" (UID: "6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 08:02:48.212708 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:48.212595    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 07:57:47 +0000 UTC" deadline="2028-02-20 03:22:24.800307513 +0000 UTC"
Jul 28 08:02:48.212708 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:48.212657    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13723h19m36.587655397s"
Jul 28 08:02:48.329430 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:48.328822    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:02:48.329430 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:48.328990    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84jc8" podUID="4ddcaf19-3fc1-4058-a75d-1f584909d4e4"
Jul 28 08:02:48.339079 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:48.338993    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lhcb7" event={"ID":"e1bc071b-1927-435b-bea2-1b1d5265c8ae","Type":"ContainerStarted","Data":"a569f210228d63c1324a988eb2c4d26b04af471675b54d114627096304e4b7d0"}
Jul 28 08:02:48.342240 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:48.342141    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v" event={"ID":"01ab6444-91e8-4b3b-b942-b81755e6574b","Type":"ContainerStarted","Data":"364325e59e4f6e64815d04c0222778b7e14ac3d895f8d859e80f5b7050147356"}
Jul 28 08:02:48.344926 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:48.344839    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bncs5" event={"ID":"a5585cee-7829-4764-8f3e-387217b86dbe","Type":"ContainerStarted","Data":"a9a84f06d15fe33344b5e42af29216155f2f34597f341da3d40fb8c259c8e96d"}
Jul 28 08:02:48.350957 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:48.350872    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7r5vh" event={"ID":"b8b607d7-a050-4231-a779-045d369abaf1","Type":"ContainerStarted","Data":"fa7902cabb35914f81ce4979cdd7387326f335388ddda191daf114cdb9286901"}
Jul 28 08:02:48.353629 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:48.353573    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z7hg4" event={"ID":"2fdc640c-ac36-407b-8fe0-d497c4cc05c2","Type":"ContainerStarted","Data":"4edb44ced3f4802b74d8d0b6c3e22b13c70a63ebe34ee23f1c6516e0a5b3d244"}
Jul 28 08:02:48.356070 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:48.356039    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-22gll" event={"ID":"42846769-0c19-40cb-936c-0c8f3d7db4c5","Type":"ContainerStarted","Data":"22f2287865e81a9e1914592a6bdd8c61cdeb116c91879fafd94382e95ade44ad"}
Jul 28 08:02:48.360036 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:48.360005    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rcmfm" event={"ID":"157f719d-c569-403c-94e0-f34ee3f68ac8","Type":"ContainerStarted","Data":"25e0c5e4402fe2f5e1e1a145a5f4853af269f2276ac83b76a7da3ab14d2201e7"}
Jul 28 08:02:48.362171 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:48.362141    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wvtsz" event={"ID":"2bbdbee2-0b11-417e-8a75-f52affa81a4a","Type":"ContainerStarted","Data":"c316ca79038e0a0cc79f78c24ccb28db8414f6aa8f1d9421b6c967458f60b554"}
Jul 28 08:02:48.364253 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:48.364230    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb" event={"ID":"e7b9b888-e51a-48c1-9ae4-f31a703c4521","Type":"ContainerStarted","Data":"e5d88871b0e59706cbfe297820753379397e832dcf48ae15e237642de05a4de2"}
Jul 28 08:02:48.785955 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:48.785910    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret\") pod \"global-pull-secret-syncer-84jc8\" (UID: \"4ddcaf19-3fc1-4058-a75d-1f584909d4e4\") " pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:02:48.786168 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:48.786073    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 08:02:48.786168 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:48.786127    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret podName:4ddcaf19-3fc1-4058-a75d-1f584909d4e4 nodeName:}" failed. No retries permitted until 2026-07-28 08:02:50.786112432 +0000 UTC m=+5.973300541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret") pod "global-pull-secret-syncer-84jc8" (UID: "4ddcaf19-3fc1-4058-a75d-1f584909d4e4") : object "kube-system"/"original-pull-secret" not registered
Jul 28 08:02:48.887073 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:48.887031    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs\") pod \"network-metrics-daemon-xphvp\" (UID: \"eb7a2f95-8714-4283-8dcf-66f1fb75b4e4\") " pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:02:48.887272 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:48.887233    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 08:02:48.887346 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:48.887329    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs podName:eb7a2f95-8714-4283-8dcf-66f1fb75b4e4 nodeName:}" failed. No retries permitted until 2026-07-28 08:02:50.887304601 +0000 UTC m=+6.074492717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs") pod "network-metrics-daemon-xphvp" (UID: "eb7a2f95-8714-4283-8dcf-66f1fb75b4e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 08:02:48.943404 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:48.943355    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 08:02:48.988089 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:48.988053    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sql9q\" (UniqueName: \"kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q\") pod \"network-check-target-jd9ts\" (UID: \"6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63\") " pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:02:48.988275 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:48.988259    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 08:02:48.988349 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:48.988280    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 08:02:48.988349 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:48.988294    2583 projected.go:196] Error preparing data for projected volume kube-api-access-sql9q for pod openshift-network-diagnostics/network-check-target-jd9ts: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 08:02:48.988459 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:48.988357    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q podName:6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63 nodeName:}" failed. No retries permitted until 2026-07-28 08:02:50.988336768 +0000 UTC m=+6.175524886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sql9q" (UniqueName: "kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q") pod "network-check-target-jd9ts" (UID: "6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 08:02:49.213498 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:49.213359    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 07:57:47 +0000 UTC" deadline="2028-01-04 14:50:36.519171826 +0000 UTC"
Jul 28 08:02:49.213498 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:49.213399    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12606h47m47.305778702s"
Jul 28 08:02:49.332433 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:49.331700    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:02:49.332433 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:49.331850    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xphvp" podUID="eb7a2f95-8714-4283-8dcf-66f1fb75b4e4"
Jul 28 08:02:49.332433 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:49.332258    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:02:49.332433 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:49.332355    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jd9ts" podUID="6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63"
Jul 28 08:02:50.329264 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:50.329227    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:02:50.329820 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:50.329377    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84jc8" podUID="4ddcaf19-3fc1-4058-a75d-1f584909d4e4"
Jul 28 08:02:50.803828 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:50.803740    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret\") pod \"global-pull-secret-syncer-84jc8\" (UID: \"4ddcaf19-3fc1-4058-a75d-1f584909d4e4\") " pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:02:50.804010 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:50.803895    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 08:02:50.804010 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:50.803965    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret podName:4ddcaf19-3fc1-4058-a75d-1f584909d4e4 nodeName:}" failed. No retries permitted until 2026-07-28 08:02:54.803944468 +0000 UTC m=+9.991132580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret") pod "global-pull-secret-syncer-84jc8" (UID: "4ddcaf19-3fc1-4058-a75d-1f584909d4e4") : object "kube-system"/"original-pull-secret" not registered
Jul 28 08:02:50.905436 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:50.904831    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs\") pod \"network-metrics-daemon-xphvp\" (UID: \"eb7a2f95-8714-4283-8dcf-66f1fb75b4e4\") " pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:02:50.905436 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:50.905033    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 08:02:50.905436 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:50.905095    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs podName:eb7a2f95-8714-4283-8dcf-66f1fb75b4e4 nodeName:}" failed. No retries permitted until 2026-07-28 08:02:54.90507536 +0000 UTC m=+10.092263484 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs") pod "network-metrics-daemon-xphvp" (UID: "eb7a2f95-8714-4283-8dcf-66f1fb75b4e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 08:02:51.006364 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:51.005389    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sql9q\" (UniqueName: \"kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q\") pod \"network-check-target-jd9ts\" (UID: \"6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63\") " pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:02:51.006364 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:51.005581    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 08:02:51.006364 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:51.005607    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 08:02:51.006364 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:51.005620    2583 projected.go:196] Error preparing data for projected volume kube-api-access-sql9q for pod openshift-network-diagnostics/network-check-target-jd9ts: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 08:02:51.006364 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:51.005684    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q podName:6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63 nodeName:}" failed. No retries permitted until 2026-07-28 08:02:55.005665345 +0000 UTC m=+10.192853462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sql9q" (UniqueName: "kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q") pod "network-check-target-jd9ts" (UID: "6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 08:02:51.329524 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:51.329000    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:02:51.329524 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:51.329054    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:02:51.329524 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:51.329159    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xphvp" podUID="eb7a2f95-8714-4283-8dcf-66f1fb75b4e4"
Jul 28 08:02:51.330154 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:51.329614    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jd9ts" podUID="6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63"
Jul 28 08:02:52.328540 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:52.328502    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:02:52.328726 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:52.328651    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84jc8" podUID="4ddcaf19-3fc1-4058-a75d-1f584909d4e4"
Jul 28 08:02:53.329662 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:53.329622    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:02:53.330141 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:53.329764    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jd9ts" podUID="6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63"
Jul 28 08:02:53.332369 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:53.332185    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:02:53.332369 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:53.332314    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xphvp" podUID="eb7a2f95-8714-4283-8dcf-66f1fb75b4e4"
Jul 28 08:02:54.329240 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:54.329155    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:02:54.329416 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:54.329287    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84jc8" podUID="4ddcaf19-3fc1-4058-a75d-1f584909d4e4"
Jul 28 08:02:54.839679 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:54.839636    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret\") pod \"global-pull-secret-syncer-84jc8\" (UID: \"4ddcaf19-3fc1-4058-a75d-1f584909d4e4\") " pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:02:54.840189 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:54.839838    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 08:02:54.840189 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:54.839898    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret podName:4ddcaf19-3fc1-4058-a75d-1f584909d4e4 nodeName:}" failed. No retries permitted until 2026-07-28 08:03:02.839879935 +0000 UTC m=+18.027068044 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret") pod "global-pull-secret-syncer-84jc8" (UID: "4ddcaf19-3fc1-4058-a75d-1f584909d4e4") : object "kube-system"/"original-pull-secret" not registered
Jul 28 08:02:54.940903 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:54.940862    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs\") pod \"network-metrics-daemon-xphvp\" (UID: \"eb7a2f95-8714-4283-8dcf-66f1fb75b4e4\") " pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:02:54.941097 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:54.941013    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 08:02:54.941097 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:54.941079    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs podName:eb7a2f95-8714-4283-8dcf-66f1fb75b4e4 nodeName:}" failed. No retries permitted until 2026-07-28 08:03:02.941060181 +0000 UTC m=+18.128248308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs") pod "network-metrics-daemon-xphvp" (UID: "eb7a2f95-8714-4283-8dcf-66f1fb75b4e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 08:02:55.041253 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:55.041202    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sql9q\" (UniqueName: \"kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q\") pod \"network-check-target-jd9ts\" (UID: \"6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63\") " pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:02:55.041451 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:55.041434    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 08:02:55.041451 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:55.041453    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 08:02:55.041603 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:55.041466    2583 projected.go:196] Error preparing data for projected volume kube-api-access-sql9q for pod openshift-network-diagnostics/network-check-target-jd9ts: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 08:02:55.041603 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:55.041538    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q podName:6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63 nodeName:}" failed. No retries permitted until 2026-07-28 08:03:03.041522214 +0000 UTC m=+18.228710325 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sql9q" (UniqueName: "kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q") pod "network-check-target-jd9ts" (UID: "6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 08:02:55.329373 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:55.329270    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:02:55.329590 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:55.329394    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jd9ts" podUID="6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63"
Jul 28 08:02:55.329934 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:55.329911    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:02:55.330059 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:55.330036    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xphvp" podUID="eb7a2f95-8714-4283-8dcf-66f1fb75b4e4"
Jul 28 08:02:56.328912 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:56.328876    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:02:56.329347 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:56.329023    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84jc8" podUID="4ddcaf19-3fc1-4058-a75d-1f584909d4e4"
Jul 28 08:02:57.330293 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:57.329673    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:02:57.330293 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:57.329834    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jd9ts" podUID="6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63"
Jul 28 08:02:57.330293 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:57.329871    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:02:57.330293 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:57.330045    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xphvp" podUID="eb7a2f95-8714-4283-8dcf-66f1fb75b4e4"
Jul 28 08:02:58.328841 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:58.328806    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:02:58.328987 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:58.328911    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84jc8" podUID="4ddcaf19-3fc1-4058-a75d-1f584909d4e4"
Jul 28 08:02:59.329055 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:59.329025    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:02:59.329533 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:02:59.329097    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:02:59.329533 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:59.329203    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xphvp" podUID="eb7a2f95-8714-4283-8dcf-66f1fb75b4e4"
Jul 28 08:02:59.329533 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:02:59.329311    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jd9ts" podUID="6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63"
Jul 28 08:03:00.328932 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:00.328899    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:03:00.329123 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:00.329016    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84jc8" podUID="4ddcaf19-3fc1-4058-a75d-1f584909d4e4"
Jul 28 08:03:01.328812 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:01.328778    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:03:01.328976 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:01.328821    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:03:01.328976 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:01.328904    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jd9ts" podUID="6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63"
Jul 28 08:03:01.329333 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:01.329306    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xphvp" podUID="eb7a2f95-8714-4283-8dcf-66f1fb75b4e4"
Jul 28 08:03:02.328642 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:02.328611    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:03:02.328853 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:02.328720    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84jc8" podUID="4ddcaf19-3fc1-4058-a75d-1f584909d4e4"
Jul 28 08:03:02.901287 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:02.901244    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret\") pod \"global-pull-secret-syncer-84jc8\" (UID: \"4ddcaf19-3fc1-4058-a75d-1f584909d4e4\") " pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:03:02.901850 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:02.901382    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 08:03:02.901850 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:02.901477    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret podName:4ddcaf19-3fc1-4058-a75d-1f584909d4e4 nodeName:}" failed. No retries permitted until 2026-07-28 08:03:18.901457652 +0000 UTC m=+34.088645791 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret") pod "global-pull-secret-syncer-84jc8" (UID: "4ddcaf19-3fc1-4058-a75d-1f584909d4e4") : object "kube-system"/"original-pull-secret" not registered
Jul 28 08:03:03.001952 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:03.001921    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs\") pod \"network-metrics-daemon-xphvp\" (UID: \"eb7a2f95-8714-4283-8dcf-66f1fb75b4e4\") " pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:03:03.002129 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:03.002033    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 08:03:03.002129 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:03.002086    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs podName:eb7a2f95-8714-4283-8dcf-66f1fb75b4e4 nodeName:}" failed. No retries permitted until 2026-07-28 08:03:19.002072639 +0000 UTC m=+34.189260748 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs") pod "network-metrics-daemon-xphvp" (UID: "eb7a2f95-8714-4283-8dcf-66f1fb75b4e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 08:03:03.102466 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:03.102410    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sql9q\" (UniqueName: \"kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q\") pod \"network-check-target-jd9ts\" (UID: \"6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63\") " pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:03:03.102646 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:03.102597    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 08:03:03.102646 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:03.102627    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 08:03:03.102646 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:03.102639    2583 projected.go:196] Error preparing data for projected volume kube-api-access-sql9q for pod openshift-network-diagnostics/network-check-target-jd9ts: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 08:03:03.102809 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:03.102707    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q podName:6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63 nodeName:}" failed. No retries permitted until 2026-07-28 08:03:19.102689071 +0000 UTC m=+34.289877197 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sql9q" (UniqueName: "kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q") pod "network-check-target-jd9ts" (UID: "6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 08:03:03.328642 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:03.328607    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:03:03.328798 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:03.328612    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:03:03.328798 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:03.328725    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xphvp" podUID="eb7a2f95-8714-4283-8dcf-66f1fb75b4e4"
Jul 28 08:03:03.328798 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:03.328789    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jd9ts" podUID="6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63"
Jul 28 08:03:04.328438 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:04.328399    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:03:04.328930 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:04.328548    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84jc8" podUID="4ddcaf19-3fc1-4058-a75d-1f584909d4e4"
Jul 28 08:03:05.329122 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:05.329086    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:03:05.329623 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:05.329211    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xphvp" podUID="eb7a2f95-8714-4283-8dcf-66f1fb75b4e4"
Jul 28 08:03:05.329623 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:05.329251    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:03:05.329623 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:05.329302    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jd9ts" podUID="6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63"
Jul 28 08:03:06.329022 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:06.328981    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:03:06.329210 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:06.329105    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84jc8" podUID="4ddcaf19-3fc1-4058-a75d-1f584909d4e4"
Jul 28 08:03:07.328929 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:07.328890    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:03:07.329114 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:07.328996    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jd9ts" podUID="6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63"
Jul 28 08:03:07.329114 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:07.329067    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:03:07.329231 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:07.329156    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xphvp" podUID="eb7a2f95-8714-4283-8dcf-66f1fb75b4e4"
Jul 28 08:03:08.328795 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:08.328507    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:03:08.328921 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:08.328878    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84jc8" podUID="4ddcaf19-3fc1-4058-a75d-1f584909d4e4"
Jul 28 08:03:08.409400 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:08.409368    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7r5vh" event={"ID":"b8b607d7-a050-4231-a779-045d369abaf1","Type":"ContainerStarted","Data":"c88ee2b17f10556be6ddc24c3058113581880c405e7f020aa1e593129b00a6cf"}
Jul 28 08:03:08.412317 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:08.412298    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-acl-logging/0.log"
Jul 28 08:03:08.412663 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:08.412642    2583 generic.go:356] "Generic (PLEG): container finished" podID="e7b9b888-e51a-48c1-9ae4-f31a703c4521" containerID="3e6048fc66ef2e1aa13482c216bcd105faafd6df763c3ef7bf22d789080d2ba1" exitCode=1
Jul 28 08:03:08.412756 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:08.412715    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb" event={"ID":"e7b9b888-e51a-48c1-9ae4-f31a703c4521","Type":"ContainerStarted","Data":"072fd699b9fca6c524a2b54e99ba4c0238941f832af25b8cea5b06f5b1a1ca26"}
Jul 28 08:03:08.412801 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:08.412778    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb" event={"ID":"e7b9b888-e51a-48c1-9ae4-f31a703c4521","Type":"ContainerStarted","Data":"a74691450ae3ab1f0b869a5e5ff00c732030221a38b0766a793c96122513c310"}
Jul 28 08:03:08.412833 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:08.412818    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb" event={"ID":"e7b9b888-e51a-48c1-9ae4-f31a703c4521","Type":"ContainerDied","Data":"3e6048fc66ef2e1aa13482c216bcd105faafd6df763c3ef7bf22d789080d2ba1"}
Jul 28 08:03:08.412867 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:08.412852    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb" event={"ID":"e7b9b888-e51a-48c1-9ae4-f31a703c4521","Type":"ContainerStarted","Data":"0d269e4aa6deb26960a86cb2acea96b2927626d358c93976f7d34b6eaedec54c"}
Jul 28 08:03:08.414524 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:08.414487    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-46.ec2.internal" event={"ID":"a65f886f3c4206dc5fdaf20b8d13828e","Type":"ContainerStarted","Data":"47f2bc3206bff879b8a918bccc10274afd4e583a98678b85674bfcc24db79f23"}
Jul 28 08:03:08.421755 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:08.420046    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lhcb7" event={"ID":"e1bc071b-1927-435b-bea2-1b1d5265c8ae","Type":"ContainerStarted","Data":"b1b24488b4fde0635a41759ce550bba2ec6a3c8f8a30fd4a2376db3d39fedb90"}
Jul 28 08:03:08.434982 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:08.434921    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7r5vh" podStartSLOduration=1.744903337 podStartE2EDuration="22.434899557s" totalImagesPullingTime="20.68999622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 08:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:03:08.433814118 +0000 UTC m=+23.621002250" watchObservedRunningTime="2026-07-28 08:03:08.434899557 +0000 UTC m=+23.622087688"
Jul 28 08:03:08.480499 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:08.480425    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lhcb7" podStartSLOduration=2.206998268 podStartE2EDuration="22.480408756s" totalImagesPullingTime="20.273410488s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 08:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:03:08.456733322 +0000 UTC m=+23.643921453" watchObservedRunningTime="2026-07-28 08:03:08.480408756 +0000 UTC m=+23.667596885"
Jul 28 08:03:09.328507 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:09.328278    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:03:09.328670 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:09.328312    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:03:09.328670 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:09.328600    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xphvp" podUID="eb7a2f95-8714-4283-8dcf-66f1fb75b4e4"
Jul 28 08:03:09.328670 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:09.328652    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jd9ts" podUID="6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63"
Jul 28 08:03:09.424108 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:09.424017    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-22gll" event={"ID":"42846769-0c19-40cb-936c-0c8f3d7db4c5","Type":"ContainerStarted","Data":"1a05c5caa62adf1e7207450fc0f0b2702f42700ecd1f05c6163e68e440d802e9"}
Jul 28 08:03:09.425627 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:09.425603    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rcmfm" event={"ID":"157f719d-c569-403c-94e0-f34ee3f68ac8","Type":"ContainerStarted","Data":"962b2b4e272f1279b4444707920584b8d0aa45bc2dd68e8f00acd2a42dcd4882"}
Jul 28 08:03:09.426986 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:09.426966    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wvtsz" event={"ID":"2bbdbee2-0b11-417e-8a75-f52affa81a4a","Type":"ContainerStarted","Data":"eda5e14fce335662f50d7339d94ded2310490ec0e0ed515393f627eea9c8b033"}
Jul 28 08:03:09.429759 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:09.429742    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-acl-logging/0.log"
Jul 28 08:03:09.430168 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:09.430151    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb" event={"ID":"e7b9b888-e51a-48c1-9ae4-f31a703c4521","Type":"ContainerStarted","Data":"4cd80016065c3f678ead0cede41ced1a31fb9c1a9aebd2b5a072278258685306"}
Jul 28 08:03:09.430222 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:09.430202    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb" event={"ID":"e7b9b888-e51a-48c1-9ae4-f31a703c4521","Type":"ContainerStarted","Data":"c3dd64a4970335a0917838bd4e18653ed0e4a74ddc6b902046ad37fe365a5321"}
Jul 28 08:03:09.431513 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:09.431495    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v" event={"ID":"01ab6444-91e8-4b3b-b942-b81755e6574b","Type":"ContainerStarted","Data":"05547d0a09e1e9f52c21be536446880023c9383043e20cebe0fda301020be4ee"}
Jul 28 08:03:09.432831 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:09.432810    2583 generic.go:356] "Generic (PLEG): container finished" podID="e0c6e405082ae3c531b401ce1816ae32" containerID="c1ed8e0bc3d3aba2f360b4f5c5924b44c3eaffaeb3a8d6e0b580a4821a0bee3c" exitCode=0
Jul 28 08:03:09.432903 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:09.432879    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-46.ec2.internal" event={"ID":"e0c6e405082ae3c531b401ce1816ae32","Type":"ContainerDied","Data":"c1ed8e0bc3d3aba2f360b4f5c5924b44c3eaffaeb3a8d6e0b580a4821a0bee3c"}
Jul 28 08:03:09.434307 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:09.434287    2583 generic.go:356] "Generic (PLEG): container finished" podID="a5585cee-7829-4764-8f3e-387217b86dbe" containerID="53fe4eee27093a9bd9dfc6b2dc920a5071643939d92b2f05d8fe85feb075baa4" exitCode=0
Jul 28 08:03:09.434395 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:09.434365    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bncs5" event={"ID":"a5585cee-7829-4764-8f3e-387217b86dbe","Type":"ContainerDied","Data":"53fe4eee27093a9bd9dfc6b2dc920a5071643939d92b2f05d8fe85feb075baa4"}
Jul 28 08:03:09.435817 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:09.435795    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z7hg4" event={"ID":"2fdc640c-ac36-407b-8fe0-d497c4cc05c2","Type":"ContainerStarted","Data":"6248f97af22c7d6318b3e4f2126f059f4bf9e6b6e1833d6936e67ace4077f6cc"}
Jul 28 08:03:09.441968 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:09.441932    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-46.ec2.internal" podStartSLOduration=22.44192158 podStartE2EDuration="22.44192158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 08:02:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:03:08.481155577 +0000 UTC m=+23.668343707" watchObservedRunningTime="2026-07-28 08:03:09.44192158 +0000 UTC m=+24.629109710"
Jul 28 08:03:09.442390 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:09.442358    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-22gll" podStartSLOduration=3.152815031 podStartE2EDuration="23.442346426s" totalImagesPullingTime="20.289531395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 08:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:03:09.441809169 +0000 UTC m=+24.628997298" watchObservedRunningTime="2026-07-28 08:03:09.442346426 +0000 UTC m=+24.629534555"
Jul 28 08:03:09.497223 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:09.497178    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wvtsz" podStartSLOduration=3.197352067 podStartE2EDuration="23.497161545s" totalImagesPullingTime="20.299809478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 08:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:03:09.497047405 +0000 UTC m=+24.684235535" watchObservedRunningTime="2026-07-28 08:03:09.497161545 +0000 UTC m=+24.684349675"
Jul 28 08:03:09.514423 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:09.514383    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rcmfm" podStartSLOduration=11.575923244 podStartE2EDuration="23.514368119s" totalImagesPullingTime="11.938444875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:03:09.514054416 +0000 UTC m=+24.701242559" watchObservedRunningTime="2026-07-28 08:03:09.514368119 +0000 UTC m=+24.701556249"
Jul 28 08:03:09.527716 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:09.527679    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-z7hg4" podStartSLOduration=3.243970667 podStartE2EDuration="23.527665159s" totalImagesPullingTime="20.283694492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 08:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:03:09.527558709 +0000 UTC m=+24.714746839" watchObservedRunningTime="2026-07-28 08:03:09.527665159 +0000 UTC m=+24.714853289"
Jul 28 08:03:09.818137 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:09.818050    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rcmfm"
Jul 28 08:03:09.818663 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:09.818649    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rcmfm"
Jul 28 08:03:10.328995 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:10.328965    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:03:10.329140 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:10.329073    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84jc8" podUID="4ddcaf19-3fc1-4058-a75d-1f584909d4e4"
Jul 28 08:03:10.440070 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:10.440021    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-46.ec2.internal" event={"ID":"e0c6e405082ae3c531b401ce1816ae32","Type":"ContainerStarted","Data":"99540305019bd7404e776f6251ad30b21a665fc673f7257007c8dabbee23de9b"}
Jul 28 08:03:10.440671 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:10.440646    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rcmfm"
Jul 28 08:03:10.440928 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:10.440914    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rcmfm"
Jul 28 08:03:10.456524 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:10.456490    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-46.ec2.internal" podStartSLOduration=23.456479617 podStartE2EDuration="23.456479617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 08:02:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:03:10.45636917 +0000 UTC m=+25.643557300" watchObservedRunningTime="2026-07-28 08:03:10.456479617 +0000 UTC m=+25.643667741"
Jul 28 08:03:11.328843 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:11.328810    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:03:11.329038 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:11.328918    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jd9ts" podUID="6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63"
Jul 28 08:03:11.329038 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:11.328954    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:03:11.329038 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:11.329017    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xphvp" podUID="eb7a2f95-8714-4283-8dcf-66f1fb75b4e4"
Jul 28 08:03:11.444732 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:11.444705    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-acl-logging/0.log"
Jul 28 08:03:11.445176 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:11.445044    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb" event={"ID":"e7b9b888-e51a-48c1-9ae4-f31a703c4521","Type":"ContainerStarted","Data":"2ef85819eaa69f931fe34c52cc2556bdd27434269d7137333a98916a15c3ed91"}
Jul 28 08:03:12.084344 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:12.084324    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 08:03:12.253685 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:12.253523    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T08:03:12.084340833Z","UUID":"5511e613-5e1e-4bff-8085-d52aaa36c8a0","Handler":null,"Name":"","Endpoint":""}
Jul 28 08:03:12.256205 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:12.256184    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 08:03:12.256348 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:12.256228    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 08:03:12.328611 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:12.328576    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:03:12.328765 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:12.328684    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84jc8" podUID="4ddcaf19-3fc1-4058-a75d-1f584909d4e4"
Jul 28 08:03:12.448652 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:12.448617    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v" event={"ID":"01ab6444-91e8-4b3b-b942-b81755e6574b","Type":"ContainerStarted","Data":"d29e6b07fcef354cea2e15b75572068eed7bf630d8388a63e29f324dada3ab23"}
Jul 28 08:03:13.329198 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:13.328893    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:03:13.329342 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:13.329260    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jd9ts" podUID="6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63"
Jul 28 08:03:13.329722 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:13.328958    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:03:13.329876 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:13.329830    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xphvp" podUID="eb7a2f95-8714-4283-8dcf-66f1fb75b4e4"
Jul 28 08:03:13.456030 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:13.456000    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-acl-logging/0.log"
Jul 28 08:03:13.456798 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:13.456492    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb" event={"ID":"e7b9b888-e51a-48c1-9ae4-f31a703c4521","Type":"ContainerStarted","Data":"493736cb615d45cbaab3f42c98995a69b5cb7ee4fbf6dc0ef40923d310037d07"}
Jul 28 08:03:13.456904 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:13.456796    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:03:13.456954 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:13.456903    2583 scope.go:117] "RemoveContainer" containerID="3e6048fc66ef2e1aa13482c216bcd105faafd6df763c3ef7bf22d789080d2ba1"
Jul 28 08:03:13.459760 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:13.459729    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v" event={"ID":"01ab6444-91e8-4b3b-b942-b81755e6574b","Type":"ContainerStarted","Data":"22eaa5096a42c7cf5b4c3ab3d58e8c50b29289aaec681a1ca19525f95dd80722"}
Jul 28 08:03:13.475712 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:13.475688    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:03:13.524843 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:13.524796    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sv86v" podStartSLOduration=7.486196006 podStartE2EDuration="27.524775872s" totalImagesPullingTime="20.038579866s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 08:02:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:03:13.524682935 +0000 UTC m=+28.711871064" watchObservedRunningTime="2026-07-28 08:03:13.524775872 +0000 UTC m=+28.711964003"
Jul 28 08:03:14.328724 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:14.328697    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:03:14.328887 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:14.328804    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84jc8" podUID="4ddcaf19-3fc1-4058-a75d-1f584909d4e4"
Jul 28 08:03:14.467349 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:14.467318    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-acl-logging/0.log"
Jul 28 08:03:14.467976 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:14.467828    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb" event={"ID":"e7b9b888-e51a-48c1-9ae4-f31a703c4521","Type":"ContainerStarted","Data":"9fed1d81ad3466a53f33a22ccd3f41b57375cc16af53dcd86feae14c5473390b"}
Jul 28 08:03:14.468181 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:14.468048    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:03:14.468181 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:14.468106    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:03:14.485389 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:14.485365    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:03:14.504073 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:14.502184    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb" podStartSLOduration=8.15699426 podStartE2EDuration="28.502152234s" totalImagesPullingTime="20.345157974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 08:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:03:14.501073885 +0000 UTC m=+29.688262008" watchObservedRunningTime="2026-07-28 08:03:14.502152234 +0000 UTC m=+29.689340364"
Jul 28 08:03:15.010182 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:15.009313    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-84jc8"]
Jul 28 08:03:15.010182 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:15.009747    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:03:15.010182 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:15.009864    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84jc8" podUID="4ddcaf19-3fc1-4058-a75d-1f584909d4e4"
Jul 28 08:03:15.012344 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:15.012315    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jd9ts"]
Jul 28 08:03:15.012495 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:15.012425    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:03:15.012617 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:15.012588    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jd9ts" podUID="6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63"
Jul 28 08:03:15.026056 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:15.026007    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xphvp"]
Jul 28 08:03:15.026243 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:15.026147    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:03:15.026299 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:15.026267    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xphvp" podUID="eb7a2f95-8714-4283-8dcf-66f1fb75b4e4"
Jul 28 08:03:16.329016 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:16.328982    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:03:16.329016 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:16.329010    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:03:16.329441 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:16.329146    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xphvp" podUID="eb7a2f95-8714-4283-8dcf-66f1fb75b4e4"
Jul 28 08:03:16.329441 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:16.329260    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84jc8" podUID="4ddcaf19-3fc1-4058-a75d-1f584909d4e4"
Jul 28 08:03:17.329341 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:17.329311    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:03:17.329776 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:17.329459    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jd9ts" podUID="6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63"
Jul 28 08:03:17.477106 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:17.477039    2583 generic.go:356] "Generic (PLEG): container finished" podID="a5585cee-7829-4764-8f3e-387217b86dbe" containerID="84fce11f7b53470d6cef5d9f21c36fcb1d80cbe0ace9ade9c486c195ab09e863" exitCode=0
Jul 28 08:03:17.477106 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:17.477083    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bncs5" event={"ID":"a5585cee-7829-4764-8f3e-387217b86dbe","Type":"ContainerDied","Data":"84fce11f7b53470d6cef5d9f21c36fcb1d80cbe0ace9ade9c486c195ab09e863"}
Jul 28 08:03:18.328220 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:18.328193    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:03:18.328378 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:18.328302    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xphvp" podUID="eb7a2f95-8714-4283-8dcf-66f1fb75b4e4"
Jul 28 08:03:18.328482 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:18.328440    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:03:18.328625 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:18.328598    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84jc8" podUID="4ddcaf19-3fc1-4058-a75d-1f584909d4e4"
Jul 28 08:03:18.920585 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:18.920502    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret\") pod \"global-pull-secret-syncer-84jc8\" (UID: \"4ddcaf19-3fc1-4058-a75d-1f584909d4e4\") " pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:03:18.920930 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:18.920640    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 08:03:18.920930 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:18.920699    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret podName:4ddcaf19-3fc1-4058-a75d-1f584909d4e4 nodeName:}" failed. No retries permitted until 2026-07-28 08:03:50.920684132 +0000 UTC m=+66.107872241 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret") pod "global-pull-secret-syncer-84jc8" (UID: "4ddcaf19-3fc1-4058-a75d-1f584909d4e4") : object "kube-system"/"original-pull-secret" not registered
Jul 28 08:03:19.021878 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:19.021848    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs\") pod \"network-metrics-daemon-xphvp\" (UID: \"eb7a2f95-8714-4283-8dcf-66f1fb75b4e4\") " pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:03:19.022010 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:19.021983    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 08:03:19.022044 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:19.022033    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs podName:eb7a2f95-8714-4283-8dcf-66f1fb75b4e4 nodeName:}" failed. No retries permitted until 2026-07-28 08:03:51.022019297 +0000 UTC m=+66.209207405 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs") pod "network-metrics-daemon-xphvp" (UID: "eb7a2f95-8714-4283-8dcf-66f1fb75b4e4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 08:03:19.123071 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:19.123045    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sql9q\" (UniqueName: \"kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q\") pod \"network-check-target-jd9ts\" (UID: \"6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63\") " pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:03:19.123218 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:19.123205    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 08:03:19.123254 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:19.123224    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 08:03:19.123254 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:19.123233    2583 projected.go:196] Error preparing data for projected volume kube-api-access-sql9q for pod openshift-network-diagnostics/network-check-target-jd9ts: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 08:03:19.123308 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:19.123286    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q podName:6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63 nodeName:}" failed. No retries permitted until 2026-07-28 08:03:51.123270742 +0000 UTC m=+66.310458861 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sql9q" (UniqueName: "kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q") pod "network-check-target-jd9ts" (UID: "6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 08:03:19.329212 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:19.329135    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:03:19.329354 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:19.329235    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jd9ts" podUID="6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63"
Jul 28 08:03:19.483392 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:19.483360    2583 generic.go:356] "Generic (PLEG): container finished" podID="a5585cee-7829-4764-8f3e-387217b86dbe" containerID="14beaf456a416b8396e7e0120f12e5b0a4776200d53eecbb6b5530f6ad5ee6c5" exitCode=0
Jul 28 08:03:19.483547 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:19.483417    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bncs5" event={"ID":"a5585cee-7829-4764-8f3e-387217b86dbe","Type":"ContainerDied","Data":"14beaf456a416b8396e7e0120f12e5b0a4776200d53eecbb6b5530f6ad5ee6c5"}
Jul 28 08:03:20.328319 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:20.328286    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:03:20.328319 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:20.328310    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:03:20.328843 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:20.328415    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84jc8" podUID="4ddcaf19-3fc1-4058-a75d-1f584909d4e4"
Jul 28 08:03:20.328843 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:20.328561    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xphvp" podUID="eb7a2f95-8714-4283-8dcf-66f1fb75b4e4"
Jul 28 08:03:21.141190 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.141161    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-46.ec2.internal" event="NodeReady"
Jul 28 08:03:21.141418 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.141286    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 08:03:21.172469 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.172423    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"]
Jul 28 08:03:21.189391 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.189367    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78b87f4567-ck6j9"]
Jul 28 08:03:21.189800 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.189505    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"
Jul 28 08:03:21.192166 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.192146    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 28 08:03:21.192166 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.192159    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 28 08:03:21.192435 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.192190    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-t9sx7\""
Jul 28 08:03:21.203328 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.203308    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bffhp"]
Jul 28 08:03:21.203439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.203423    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.205934 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.205915    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 08:03:21.206052 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.205951    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q9jvm\""
Jul 28 08:03:21.206052 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.205955    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 08:03:21.206052 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.205918    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 08:03:21.211783 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.211761    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 08:03:21.221359 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.221325    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"]
Jul 28 08:03:21.221359 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.221362    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jvr4z"]
Jul 28 08:03:21.221532 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.221441    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bffhp"
Jul 28 08:03:21.223588 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.223572    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 08:03:21.223749 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.223730    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 08:03:21.223798 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.223763    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zjhxs\""
Jul 28 08:03:21.243647 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.243622    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78b87f4567-ck6j9"]
Jul 28 08:03:21.243647 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.243651    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bffhp"]
Jul 28 08:03:21.243784 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.243674    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jvr4z"]
Jul 28 08:03:21.243784 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.243730    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jvr4z"
Jul 28 08:03:21.246034 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.246017    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 08:03:21.246160 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.246142    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 08:03:21.246221 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.246142    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dq5hr\""
Jul 28 08:03:21.246221 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.246147    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 08:03:21.329212 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.329181    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:03:21.331532 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.331510    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 08:03:21.331713 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.331658    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 08:03:21.331713 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.331677    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nqkh2\""
Jul 28 08:03:21.335711 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.335678    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ed157823-a341-4114-a7ad-c3e9290cbcf5-installation-pull-secrets\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.335859 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.335718    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntbns\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-kube-api-access-ntbns\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.335859 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.335751    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-certificates\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.335859 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.335776    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf8rt\" (UniqueName: \"kubernetes.io/projected/b88d5c13-e028-44d4-9844-fdc5359b9852-kube-api-access-tf8rt\") pod \"ingress-canary-jvr4z\" (UID: \"b88d5c13-e028-44d4-9844-fdc5359b9852\") " pod="openshift-ingress-canary/ingress-canary-jvr4z"
Jul 28 08:03:21.335859 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.335799    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9498a46-5dad-42a4-908a-eadc84f02430-tmp-dir\") pod \"dns-default-bffhp\" (UID: \"f9498a46-5dad-42a4-908a-eadc84f02430\") " pod="openshift-dns/dns-default-bffhp"
Jul 28 08:03:21.335859 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.335821    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn9lc\" (UniqueName: \"kubernetes.io/projected/f9498a46-5dad-42a4-908a-eadc84f02430-kube-api-access-sn9lc\") pod \"dns-default-bffhp\" (UID: \"f9498a46-5dad-42a4-908a-eadc84f02430\") " pod="openshift-dns/dns-default-bffhp"
Jul 28 08:03:21.335859 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.335851    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9498a46-5dad-42a4-908a-eadc84f02430-config-volume\") pod \"dns-default-bffhp\" (UID: \"f9498a46-5dad-42a4-908a-eadc84f02430\") " pod="openshift-dns/dns-default-bffhp"
Jul 28 08:03:21.336079 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.335878    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls\") pod \"dns-default-bffhp\" (UID: \"f9498a46-5dad-42a4-908a-eadc84f02430\") " pod="openshift-dns/dns-default-bffhp"
Jul 28 08:03:21.336079 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.335909    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ed157823-a341-4114-a7ad-c3e9290cbcf5-image-registry-private-configuration\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.336079 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.335992    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ed157823-a341-4114-a7ad-c3e9290cbcf5-ca-trust-extracted\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.336079 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.336022    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ed157823-a341-4114-a7ad-c3e9290cbcf5-trusted-ca\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.336079 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.336053    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-bound-sa-token\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.336237 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.336077    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/539630ec-45ae-4b70-bbce-d390e08afecd-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-5wjpt\" (UID: \"539630ec-45ae-4b70-bbce-d390e08afecd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"
Jul 28 08:03:21.336237 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.336103    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b88d5c13-e028-44d4-9844-fdc5359b9852-cert\") pod \"ingress-canary-jvr4z\" (UID: \"b88d5c13-e028-44d4-9844-fdc5359b9852\") " pod="openshift-ingress-canary/ingress-canary-jvr4z"
Jul 28 08:03:21.336237 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.336120    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.336237 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.336140    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-5wjpt\" (UID: \"539630ec-45ae-4b70-bbce-d390e08afecd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"
Jul 28 08:03:21.437484 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.437374    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ed157823-a341-4114-a7ad-c3e9290cbcf5-installation-pull-secrets\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.437484 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.437409    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntbns\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-kube-api-access-ntbns\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.437484 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.437428    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-certificates\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.437753 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.437525    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf8rt\" (UniqueName: \"kubernetes.io/projected/b88d5c13-e028-44d4-9844-fdc5359b9852-kube-api-access-tf8rt\") pod \"ingress-canary-jvr4z\" (UID: \"b88d5c13-e028-44d4-9844-fdc5359b9852\") " pod="openshift-ingress-canary/ingress-canary-jvr4z"
Jul 28 08:03:21.437753 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.437566    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9498a46-5dad-42a4-908a-eadc84f02430-tmp-dir\") pod \"dns-default-bffhp\" (UID: \"f9498a46-5dad-42a4-908a-eadc84f02430\") " pod="openshift-dns/dns-default-bffhp"
Jul 28 08:03:21.437753 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.437593    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn9lc\" (UniqueName: \"kubernetes.io/projected/f9498a46-5dad-42a4-908a-eadc84f02430-kube-api-access-sn9lc\") pod \"dns-default-bffhp\" (UID: \"f9498a46-5dad-42a4-908a-eadc84f02430\") " pod="openshift-dns/dns-default-bffhp"
Jul 28 08:03:21.437753 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.437628    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9498a46-5dad-42a4-908a-eadc84f02430-config-volume\") pod \"dns-default-bffhp\" (UID: \"f9498a46-5dad-42a4-908a-eadc84f02430\") " pod="openshift-dns/dns-default-bffhp"
Jul 28 08:03:21.437753 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.437653    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls\") pod \"dns-default-bffhp\" (UID: \"f9498a46-5dad-42a4-908a-eadc84f02430\") " pod="openshift-dns/dns-default-bffhp"
Jul 28 08:03:21.437753 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.437679    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ed157823-a341-4114-a7ad-c3e9290cbcf5-image-registry-private-configuration\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.437753 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.437732    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ed157823-a341-4114-a7ad-c3e9290cbcf5-ca-trust-extracted\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.437753 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.437754    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ed157823-a341-4114-a7ad-c3e9290cbcf5-trusted-ca\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.438234 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.437800    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-bound-sa-token\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.438234 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:21.437805    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 08:03:21.438234 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.437824    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/539630ec-45ae-4b70-bbce-d390e08afecd-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-5wjpt\" (UID: \"539630ec-45ae-4b70-bbce-d390e08afecd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"
Jul 28 08:03:21.438234 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.437858    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b88d5c13-e028-44d4-9844-fdc5359b9852-cert\") pod \"ingress-canary-jvr4z\" (UID: \"b88d5c13-e028-44d4-9844-fdc5359b9852\") " pod="openshift-ingress-canary/ingress-canary-jvr4z"
Jul 28 08:03:21.438234 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:21.437883    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls podName:f9498a46-5dad-42a4-908a-eadc84f02430 nodeName:}" failed. No retries permitted until 2026-07-28 08:03:21.937861314 +0000 UTC m=+37.125049421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls") pod "dns-default-bffhp" (UID: "f9498a46-5dad-42a4-908a-eadc84f02430") : secret "dns-default-metrics-tls" not found
Jul 28 08:03:21.438234 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.437923    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.438234 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.437954    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-5wjpt\" (UID: \"539630ec-45ae-4b70-bbce-d390e08afecd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"
Jul 28 08:03:21.438234 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.438058    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9498a46-5dad-42a4-908a-eadc84f02430-tmp-dir\") pod \"dns-default-bffhp\" (UID: \"f9498a46-5dad-42a4-908a-eadc84f02430\") " pod="openshift-dns/dns-default-bffhp"
Jul 28 08:03:21.438234 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:21.438074    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 08:03:21.438234 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:21.438117    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert podName:539630ec-45ae-4b70-bbce-d390e08afecd nodeName:}" failed. No retries permitted until 2026-07-28 08:03:21.93810347 +0000 UTC m=+37.125291594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-5wjpt" (UID: "539630ec-45ae-4b70-bbce-d390e08afecd") : secret "networking-console-plugin-cert" not found
Jul 28 08:03:21.438234 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:21.438178    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 08:03:21.438234 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.438177    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ed157823-a341-4114-a7ad-c3e9290cbcf5-ca-trust-extracted\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.438234 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:21.438189    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b87f4567-ck6j9: secret "image-registry-tls" not found
Jul 28 08:03:21.438234 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:21.438222    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls podName:ed157823-a341-4114-a7ad-c3e9290cbcf5 nodeName:}" failed. No retries permitted until 2026-07-28 08:03:21.938211464 +0000 UTC m=+37.125399574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls") pod "image-registry-78b87f4567-ck6j9" (UID: "ed157823-a341-4114-a7ad-c3e9290cbcf5") : secret "image-registry-tls" not found
Jul 28 08:03:21.438940 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.438302    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-certificates\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.438940 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.438684    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9498a46-5dad-42a4-908a-eadc84f02430-config-volume\") pod \"dns-default-bffhp\" (UID: \"f9498a46-5dad-42a4-908a-eadc84f02430\") " pod="openshift-dns/dns-default-bffhp"
Jul 28 08:03:21.438940 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.438788    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/539630ec-45ae-4b70-bbce-d390e08afecd-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-5wjpt\" (UID: \"539630ec-45ae-4b70-bbce-d390e08afecd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"
Jul 28 08:03:21.439069 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.439034    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ed157823-a341-4114-a7ad-c3e9290cbcf5-trusted-ca\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.442263 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.442236    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ed157823-a341-4114-a7ad-c3e9290cbcf5-installation-pull-secrets\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.442359 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.442279    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ed157823-a341-4114-a7ad-c3e9290cbcf5-image-registry-private-configuration\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.442359 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.442310    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b88d5c13-e028-44d4-9844-fdc5359b9852-cert\") pod \"ingress-canary-jvr4z\" (UID: \"b88d5c13-e028-44d4-9844-fdc5359b9852\") " pod="openshift-ingress-canary/ingress-canary-jvr4z"
Jul 28 08:03:21.445972 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.445950    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-bound-sa-token\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.446241 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.446211    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn9lc\" (UniqueName: \"kubernetes.io/projected/f9498a46-5dad-42a4-908a-eadc84f02430-kube-api-access-sn9lc\") pod \"dns-default-bffhp\" (UID: \"f9498a46-5dad-42a4-908a-eadc84f02430\") " pod="openshift-dns/dns-default-bffhp"
Jul 28 08:03:21.446349 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.446334    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf8rt\" (UniqueName: \"kubernetes.io/projected/b88d5c13-e028-44d4-9844-fdc5359b9852-kube-api-access-tf8rt\") pod \"ingress-canary-jvr4z\" (UID: \"b88d5c13-e028-44d4-9844-fdc5359b9852\") " pod="openshift-ingress-canary/ingress-canary-jvr4z"
Jul 28 08:03:21.457686 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.457665    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntbns\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-kube-api-access-ntbns\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.489955 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.489918    2583 generic.go:356] "Generic (PLEG): container finished" podID="a5585cee-7829-4764-8f3e-387217b86dbe" containerID="887b168a5b518648fdadebccbde702c9159241c55950de2df39768b260c94780" exitCode=0
Jul 28 08:03:21.490079 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.489968    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bncs5" event={"ID":"a5585cee-7829-4764-8f3e-387217b86dbe","Type":"ContainerDied","Data":"887b168a5b518648fdadebccbde702c9159241c55950de2df39768b260c94780"}
Jul 28 08:03:21.552601 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.552564    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jvr4z"
Jul 28 08:03:21.705018 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.704853    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rcmfm_157f719d-c569-403c-94e0-f34ee3f68ac8/konnectivity-agent/0.log" limit=1024
Jul 28 08:03:21.721137 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.721111    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jvr4z"]
Jul 28 08:03:21.724099 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:03:21.724070    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb88d5c13_e028_44d4_9844_fdc5359b9852.slice/crio-db84cdb188f91aefe98ee30aa48645a7fe4393157ba822b55a47946b1a2ee992 WatchSource:0}: Error finding container db84cdb188f91aefe98ee30aa48645a7fe4393157ba822b55a47946b1a2ee992: Status 404 returned error can't find the container with id db84cdb188f91aefe98ee30aa48645a7fe4393157ba822b55a47946b1a2ee992
Jul 28 08:03:21.799925 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.799894    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rcmfm_157f719d-c569-403c-94e0-f34ee3f68ac8/konnectivity-agent/0.log" limit=1024
Jul 28 08:03:21.941611 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.941572    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls\") pod \"dns-default-bffhp\" (UID: \"f9498a46-5dad-42a4-908a-eadc84f02430\") " pod="openshift-dns/dns-default-bffhp"
Jul 28 08:03:21.941817 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.941639    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:21.941817 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:21.941661    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-5wjpt\" (UID: \"539630ec-45ae-4b70-bbce-d390e08afecd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"
Jul 28 08:03:21.941817 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:21.941718    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 08:03:21.941817 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:21.941736    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 08:03:21.941817 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:21.941740    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 08:03:21.941817 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:21.941752    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b87f4567-ck6j9: secret "image-registry-tls" not found
Jul 28 08:03:21.941817 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:21.941793    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls podName:f9498a46-5dad-42a4-908a-eadc84f02430 nodeName:}" failed. No retries permitted until 2026-07-28 08:03:22.941777046 +0000 UTC m=+38.128965167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls") pod "dns-default-bffhp" (UID: "f9498a46-5dad-42a4-908a-eadc84f02430") : secret "dns-default-metrics-tls" not found
Jul 28 08:03:21.941817 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:21.941820    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls podName:ed157823-a341-4114-a7ad-c3e9290cbcf5 nodeName:}" failed. No retries permitted until 2026-07-28 08:03:22.941800857 +0000 UTC m=+38.128988979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls") pod "image-registry-78b87f4567-ck6j9" (UID: "ed157823-a341-4114-a7ad-c3e9290cbcf5") : secret "image-registry-tls" not found
Jul 28 08:03:21.942097 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:21.941838    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert podName:539630ec-45ae-4b70-bbce-d390e08afecd nodeName:}" failed. No retries permitted until 2026-07-28 08:03:22.941828242 +0000 UTC m=+38.129016388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-5wjpt" (UID: "539630ec-45ae-4b70-bbce-d390e08afecd") : secret "networking-console-plugin-cert" not found
Jul 28 08:03:22.328796 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:22.328763    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:03:22.328981 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:22.328763    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:03:22.331435 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:22.331407    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 08:03:22.332231 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:22.331474    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 08:03:22.332231 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:22.331515    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kk5fx\""
Jul 28 08:03:22.494055 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:22.494018    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jvr4z" event={"ID":"b88d5c13-e028-44d4-9844-fdc5359b9852","Type":"ContainerStarted","Data":"db84cdb188f91aefe98ee30aa48645a7fe4393157ba822b55a47946b1a2ee992"}
Jul 28 08:03:22.952219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:22.951255    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls\") pod \"dns-default-bffhp\" (UID: \"f9498a46-5dad-42a4-908a-eadc84f02430\") " pod="openshift-dns/dns-default-bffhp"
Jul 28 08:03:22.952219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:22.951347    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:22.952219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:22.951377    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-5wjpt\" (UID: \"539630ec-45ae-4b70-bbce-d390e08afecd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"
Jul 28 08:03:22.952219 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:22.951558    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 08:03:22.952219 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:22.951628    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert podName:539630ec-45ae-4b70-bbce-d390e08afecd nodeName:}" failed. No retries permitted until 2026-07-28 08:03:24.951606268 +0000 UTC m=+40.138794376 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-5wjpt" (UID: "539630ec-45ae-4b70-bbce-d390e08afecd") : secret "networking-console-plugin-cert" not found
Jul 28 08:03:22.952219 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:22.952021    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 08:03:22.952219 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:22.952069    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls podName:f9498a46-5dad-42a4-908a-eadc84f02430 nodeName:}" failed. No retries permitted until 2026-07-28 08:03:24.952053712 +0000 UTC m=+40.139241876 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls") pod "dns-default-bffhp" (UID: "f9498a46-5dad-42a4-908a-eadc84f02430") : secret "dns-default-metrics-tls" not found
Jul 28 08:03:22.952219 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:22.952141    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 08:03:22.952219 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:22.952153    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b87f4567-ck6j9: secret "image-registry-tls" not found
Jul 28 08:03:22.952219 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:22.952187    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls podName:ed157823-a341-4114-a7ad-c3e9290cbcf5 nodeName:}" failed. No retries permitted until 2026-07-28 08:03:24.952175258 +0000 UTC m=+40.139363380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls") pod "image-registry-78b87f4567-ck6j9" (UID: "ed157823-a341-4114-a7ad-c3e9290cbcf5") : secret "image-registry-tls" not found
Jul 28 08:03:24.970091 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:24.969861    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:24.970595 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:24.970127    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-5wjpt\" (UID: \"539630ec-45ae-4b70-bbce-d390e08afecd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"
Jul 28 08:03:24.970595 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:24.970008    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 08:03:24.970595 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:24.970201    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls\") pod \"dns-default-bffhp\" (UID: \"f9498a46-5dad-42a4-908a-eadc84f02430\") " pod="openshift-dns/dns-default-bffhp"
Jul 28 08:03:24.970595 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:24.970200    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b87f4567-ck6j9: secret "image-registry-tls" not found
Jul 28 08:03:24.970595 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:24.970288    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls podName:ed157823-a341-4114-a7ad-c3e9290cbcf5 nodeName:}" failed. No retries permitted until 2026-07-28 08:03:28.970269896 +0000 UTC m=+44.157458005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls") pod "image-registry-78b87f4567-ck6j9" (UID: "ed157823-a341-4114-a7ad-c3e9290cbcf5") : secret "image-registry-tls" not found
Jul 28 08:03:24.970595 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:24.970308    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 08:03:24.970595 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:24.970320    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 08:03:24.970595 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:24.970345    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls podName:f9498a46-5dad-42a4-908a-eadc84f02430 nodeName:}" failed. No retries permitted until 2026-07-28 08:03:28.970334607 +0000 UTC m=+44.157522718 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls") pod "dns-default-bffhp" (UID: "f9498a46-5dad-42a4-908a-eadc84f02430") : secret "dns-default-metrics-tls" not found
Jul 28 08:03:24.970595 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:24.970387    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert podName:539630ec-45ae-4b70-bbce-d390e08afecd nodeName:}" failed. No retries permitted until 2026-07-28 08:03:28.970366036 +0000 UTC m=+44.157554177 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-5wjpt" (UID: "539630ec-45ae-4b70-bbce-d390e08afecd") : secret "networking-console-plugin-cert" not found
Jul 28 08:03:26.258101 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:26.258069    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rcmfm_157f719d-c569-403c-94e0-f34ee3f68ac8/konnectivity-agent/0.log" limit=1024
Jul 28 08:03:27.508863 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:27.508825    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jvr4z" event={"ID":"b88d5c13-e028-44d4-9844-fdc5359b9852","Type":"ContainerStarted","Data":"c9bacdcf4c52c8467d7da767e6bb07fa856dabf59b4c06b6941509409dd086c0"}
Jul 28 08:03:27.514127 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:27.514100    2583 generic.go:356] "Generic (PLEG): container finished" podID="a5585cee-7829-4764-8f3e-387217b86dbe" containerID="796ad3dcc4603f62ce79da61ebbf58d99a815f83e1df0eee1a8fffcccda37880" exitCode=0
Jul 28 08:03:27.514266 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:27.514151    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bncs5" event={"ID":"a5585cee-7829-4764-8f3e-387217b86dbe","Type":"ContainerDied","Data":"796ad3dcc4603f62ce79da61ebbf58d99a815f83e1df0eee1a8fffcccda37880"}
Jul 28 08:03:27.533412 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:27.533361    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jvr4z" podStartSLOduration=1.204240549 podStartE2EDuration="6.533345795s" totalImagesPullingTime="5.329105246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:03:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:03:27.533073009 +0000 UTC m=+42.720261138" watchObservedRunningTime="2026-07-28 08:03:27.533345795 +0000 UTC m=+42.720533918"
Jul 28 08:03:28.399153 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:28.399110    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rcmfm_157f719d-c569-403c-94e0-f34ee3f68ac8/konnectivity-agent/0.log" limit=1024
Jul 28 08:03:28.454524 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:28.454490    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rcmfm_157f719d-c569-403c-94e0-f34ee3f68ac8/konnectivity-agent/0.log" limit=1024
Jul 28 08:03:28.518941 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:28.518912    2583 generic.go:356] "Generic (PLEG): container finished" podID="a5585cee-7829-4764-8f3e-387217b86dbe" containerID="12e5fd2248bff45db48d64faade1b6ab76c6ecf290b62abc57ff589cd6746f8d" exitCode=0
Jul 28 08:03:28.519320 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:28.518991    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bncs5" event={"ID":"a5585cee-7829-4764-8f3e-387217b86dbe","Type":"ContainerDied","Data":"12e5fd2248bff45db48d64faade1b6ab76c6ecf290b62abc57ff589cd6746f8d"}
Jul 28 08:03:29.005740 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:29.005696    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls\") pod \"dns-default-bffhp\" (UID: \"f9498a46-5dad-42a4-908a-eadc84f02430\") " pod="openshift-dns/dns-default-bffhp"
Jul 28 08:03:29.005948 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:29.005801    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:29.005948 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:29.005831    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-5wjpt\" (UID: \"539630ec-45ae-4b70-bbce-d390e08afecd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"
Jul 28 08:03:29.005948 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:29.005838    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 08:03:29.005948 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:29.005899    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls podName:f9498a46-5dad-42a4-908a-eadc84f02430 nodeName:}" failed. No retries permitted until 2026-07-28 08:03:37.005883899 +0000 UTC m=+52.193072007 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls") pod "dns-default-bffhp" (UID: "f9498a46-5dad-42a4-908a-eadc84f02430") : secret "dns-default-metrics-tls" not found
Jul 28 08:03:29.005948 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:29.005935    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 08:03:29.006161 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:29.005954    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b87f4567-ck6j9: secret "image-registry-tls" not found
Jul 28 08:03:29.006161 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:29.005957    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 08:03:29.006161 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:29.006007    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls podName:ed157823-a341-4114-a7ad-c3e9290cbcf5 nodeName:}" failed. No retries permitted until 2026-07-28 08:03:37.005992674 +0000 UTC m=+52.193180798 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls") pod "image-registry-78b87f4567-ck6j9" (UID: "ed157823-a341-4114-a7ad-c3e9290cbcf5") : secret "image-registry-tls" not found
Jul 28 08:03:29.006161 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:29.006020    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert podName:539630ec-45ae-4b70-bbce-d390e08afecd nodeName:}" failed. No retries permitted until 2026-07-28 08:03:37.006014407 +0000 UTC m=+52.193202514 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-5wjpt" (UID: "539630ec-45ae-4b70-bbce-d390e08afecd") : secret "networking-console-plugin-cert" not found
Jul 28 08:03:29.524906 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:29.524871    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bncs5" event={"ID":"a5585cee-7829-4764-8f3e-387217b86dbe","Type":"ContainerStarted","Data":"8d8964633b99914ed1780093d77af2703fca2cfe16b251fe9a6e0eec5ee7179e"}
Jul 28 08:03:29.547060 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:29.547012    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bncs5" podStartSLOduration=8.087640277 podStartE2EDuration="43.54699728s" totalImagesPullingTime="35.459357003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 08:02:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:03:29.546080372 +0000 UTC m=+44.733268501" watchObservedRunningTime="2026-07-28 08:03:29.54699728 +0000 UTC m=+44.734185409"
Jul 28 08:03:29.668067 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:29.668031    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rcmfm_157f719d-c569-403c-94e0-f34ee3f68ac8/konnectivity-agent/0.log" limit=1024
Jul 28 08:03:29.770484 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:29.770437    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rcmfm_157f719d-c569-403c-94e0-f34ee3f68ac8/konnectivity-agent/0.log" limit=1024
Jul 28 08:03:37.067806 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:37.067766    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:37.067806 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:37.067810    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-5wjpt\" (UID: \"539630ec-45ae-4b70-bbce-d390e08afecd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"
Jul 28 08:03:37.068319 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:37.067874    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls\") pod \"dns-default-bffhp\" (UID: \"f9498a46-5dad-42a4-908a-eadc84f02430\") " pod="openshift-dns/dns-default-bffhp"
Jul 28 08:03:37.068319 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:37.067929    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 08:03:37.068319 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:37.067947    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b87f4567-ck6j9: secret "image-registry-tls" not found
Jul 28 08:03:37.068319 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:37.068003    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls podName:ed157823-a341-4114-a7ad-c3e9290cbcf5 nodeName:}" failed. No retries permitted until 2026-07-28 08:03:53.067986294 +0000 UTC m=+68.255174405 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls") pod "image-registry-78b87f4567-ck6j9" (UID: "ed157823-a341-4114-a7ad-c3e9290cbcf5") : secret "image-registry-tls" not found
Jul 28 08:03:37.068319 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:37.068002    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 08:03:37.068319 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:37.068002    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 08:03:37.068319 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:37.068051    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls podName:f9498a46-5dad-42a4-908a-eadc84f02430 nodeName:}" failed. No retries permitted until 2026-07-28 08:03:53.068039311 +0000 UTC m=+68.255227419 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls") pod "dns-default-bffhp" (UID: "f9498a46-5dad-42a4-908a-eadc84f02430") : secret "dns-default-metrics-tls" not found
Jul 28 08:03:37.068319 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:37.068105    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert podName:539630ec-45ae-4b70-bbce-d390e08afecd nodeName:}" failed. No retries permitted until 2026-07-28 08:03:53.068091199 +0000 UTC m=+68.255279310 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-5wjpt" (UID: "539630ec-45ae-4b70-bbce-d390e08afecd") : secret "networking-console-plugin-cert" not found
Jul 28 08:03:46.483677 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:46.483650    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6jpqb"
Jul 28 08:03:50.969360 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:50.969316    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret\") pod \"global-pull-secret-syncer-84jc8\" (UID: \"4ddcaf19-3fc1-4058-a75d-1f584909d4e4\") " pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:03:50.971778 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:50.971753    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 08:03:50.982788 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:50.982753    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ddcaf19-3fc1-4058-a75d-1f584909d4e4-original-pull-secret\") pod \"global-pull-secret-syncer-84jc8\" (UID: \"4ddcaf19-3fc1-4058-a75d-1f584909d4e4\") " pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:03:51.070150 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:51.070107    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs\") pod \"network-metrics-daemon-xphvp\" (UID: \"eb7a2f95-8714-4283-8dcf-66f1fb75b4e4\") " pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:03:51.072531 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:51.072511    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 08:03:51.081291 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:51.081270    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 08:03:51.081360 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:51.081341    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs podName:eb7a2f95-8714-4283-8dcf-66f1fb75b4e4 nodeName:}" failed. No retries permitted until 2026-07-28 08:04:55.081318363 +0000 UTC m=+130.268506485 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs") pod "network-metrics-daemon-xphvp" (UID: "eb7a2f95-8714-4283-8dcf-66f1fb75b4e4") : secret "metrics-daemon-secret" not found
Jul 28 08:03:51.146169 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:51.146133    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84jc8"
Jul 28 08:03:51.171304 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:51.171271    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sql9q\" (UniqueName: \"kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q\") pod \"network-check-target-jd9ts\" (UID: \"6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63\") " pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:03:51.174381 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:51.174366    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 08:03:51.184266 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:51.184242    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 08:03:51.196224 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:51.194933    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sql9q\" (UniqueName: \"kubernetes.io/projected/6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63-kube-api-access-sql9q\") pod \"network-check-target-jd9ts\" (UID: \"6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63\") " pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:03:51.290118 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:51.290083    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-84jc8"]
Jul 28 08:03:51.293998 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:03:51.293972    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ddcaf19_3fc1_4058_a75d_1f584909d4e4.slice/crio-5e6a9f7d49cfd590b89ced79694bb32ba2c586562ecbf231da30aff3db95a5a2 WatchSource:0}: Error finding container 5e6a9f7d49cfd590b89ced79694bb32ba2c586562ecbf231da30aff3db95a5a2: Status 404 returned error can't find the container with id 5e6a9f7d49cfd590b89ced79694bb32ba2c586562ecbf231da30aff3db95a5a2
Jul 28 08:03:51.340998 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:51.340974    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nqkh2\""
Jul 28 08:03:51.348966 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:51.348952    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:03:51.467693 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:51.467662    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jd9ts"]
Jul 28 08:03:51.471237 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:03:51.471202    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ffd4d79_2e8e_42e6_86a3_8bfba1c35d63.slice/crio-97ecba49f6edfbec4eb51f272c02dd871871663fd3aaca86a6ea49b436f88549 WatchSource:0}: Error finding container 97ecba49f6edfbec4eb51f272c02dd871871663fd3aaca86a6ea49b436f88549: Status 404 returned error can't find the container with id 97ecba49f6edfbec4eb51f272c02dd871871663fd3aaca86a6ea49b436f88549
Jul 28 08:03:51.576207 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:51.576112    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jd9ts" event={"ID":"6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63","Type":"ContainerStarted","Data":"97ecba49f6edfbec4eb51f272c02dd871871663fd3aaca86a6ea49b436f88549"}
Jul 28 08:03:51.577197 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:51.577174    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-84jc8" event={"ID":"4ddcaf19-3fc1-4058-a75d-1f584909d4e4","Type":"ContainerStarted","Data":"5e6a9f7d49cfd590b89ced79694bb32ba2c586562ecbf231da30aff3db95a5a2"}
Jul 28 08:03:53.087535 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:53.087499    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:03:53.088067 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:53.087544    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-5wjpt\" (UID: \"539630ec-45ae-4b70-bbce-d390e08afecd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"
Jul 28 08:03:53.088067 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:53.087609    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls\") pod \"dns-default-bffhp\" (UID: \"f9498a46-5dad-42a4-908a-eadc84f02430\") " pod="openshift-dns/dns-default-bffhp"
Jul 28 08:03:53.088067 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:53.087703    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 08:03:53.088067 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:53.087714    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 08:03:53.088067 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:53.087728    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b87f4567-ck6j9: secret "image-registry-tls" not found
Jul 28 08:03:53.088067 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:53.087713    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 08:03:53.088067 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:53.087783    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert podName:539630ec-45ae-4b70-bbce-d390e08afecd nodeName:}" failed. No retries permitted until 2026-07-28 08:04:25.08776444 +0000 UTC m=+100.274952583 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-5wjpt" (UID: "539630ec-45ae-4b70-bbce-d390e08afecd") : secret "networking-console-plugin-cert" not found
Jul 28 08:03:53.088067 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:53.087801    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls podName:ed157823-a341-4114-a7ad-c3e9290cbcf5 nodeName:}" failed. No retries permitted until 2026-07-28 08:04:25.087792375 +0000 UTC m=+100.274980485 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls") pod "image-registry-78b87f4567-ck6j9" (UID: "ed157823-a341-4114-a7ad-c3e9290cbcf5") : secret "image-registry-tls" not found
Jul 28 08:03:53.088067 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:03:53.087828    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls podName:f9498a46-5dad-42a4-908a-eadc84f02430 nodeName:}" failed. No retries permitted until 2026-07-28 08:04:25.087807564 +0000 UTC m=+100.274995675 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls") pod "dns-default-bffhp" (UID: "f9498a46-5dad-42a4-908a-eadc84f02430") : secret "dns-default-metrics-tls" not found
Jul 28 08:03:57.595483 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:57.595433    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jd9ts" event={"ID":"6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63","Type":"ContainerStarted","Data":"0447a21db249048295ae8845bdba4a0617a3a80a8870e7359ccd05b2e654ac5a"}
Jul 28 08:03:57.595884 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:57.595555    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:03:57.596940 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:57.596915    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-84jc8" event={"ID":"4ddcaf19-3fc1-4058-a75d-1f584909d4e4","Type":"ContainerStarted","Data":"1d57b4922342a86d058fc79960240cbe5f2139a7d56a6552520db02c4e562acf"}
Jul 28 08:03:57.610817 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:57.610768    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jd9ts" podStartSLOduration=66.420674862 podStartE2EDuration="1m11.610754019s" totalImagesPullingTime="5.190079157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:03:57.610421158 +0000 UTC m=+72.797609290" watchObservedRunningTime="2026-07-28 08:03:57.610754019 +0000 UTC m=+72.797942126"
Jul 28 08:03:57.624634 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:03:57.624591    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-84jc8" podStartSLOduration=66.245388468 podStartE2EDuration="1m11.624575445s" totalImagesPullingTime="5.379186977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 08:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:03:57.623891837 +0000 UTC m=+72.811079971" watchObservedRunningTime="2026-07-28 08:03:57.624575445 +0000 UTC m=+72.811763574"
Jul 28 08:04:25.118498 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:04:25.118433    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:04:25.118498 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:04:25.118501    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-5wjpt\" (UID: \"539630ec-45ae-4b70-bbce-d390e08afecd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"
Jul 28 08:04:25.119021 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:04:25.118554    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls\") pod \"dns-default-bffhp\" (UID: \"f9498a46-5dad-42a4-908a-eadc84f02430\") " pod="openshift-dns/dns-default-bffhp"
Jul 28 08:04:25.119021 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:04:25.118582    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 08:04:25.119021 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:04:25.118600    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b87f4567-ck6j9: secret "image-registry-tls" not found
Jul 28 08:04:25.119021 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:04:25.118641    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 08:04:25.119021 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:04:25.118652    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 08:04:25.119021 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:04:25.118657    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls podName:ed157823-a341-4114-a7ad-c3e9290cbcf5 nodeName:}" failed. No retries permitted until 2026-07-28 08:05:29.118641026 +0000 UTC m=+164.305829135 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls") pod "image-registry-78b87f4567-ck6j9" (UID: "ed157823-a341-4114-a7ad-c3e9290cbcf5") : secret "image-registry-tls" not found
Jul 28 08:04:25.119021 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:04:25.118722    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls podName:f9498a46-5dad-42a4-908a-eadc84f02430 nodeName:}" failed. No retries permitted until 2026-07-28 08:05:29.118705685 +0000 UTC m=+164.305893794 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls") pod "dns-default-bffhp" (UID: "f9498a46-5dad-42a4-908a-eadc84f02430") : secret "dns-default-metrics-tls" not found
Jul 28 08:04:25.119021 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:04:25.118740    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert podName:539630ec-45ae-4b70-bbce-d390e08afecd nodeName:}" failed. No retries permitted until 2026-07-28 08:05:29.118728189 +0000 UTC m=+164.305916304 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-5wjpt" (UID: "539630ec-45ae-4b70-bbce-d390e08afecd") : secret "networking-console-plugin-cert" not found
Jul 28 08:04:28.602621 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:04:28.602584    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jd9ts"
Jul 28 08:04:55.135600 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:04:55.135563    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs\") pod \"network-metrics-daemon-xphvp\" (UID: \"eb7a2f95-8714-4283-8dcf-66f1fb75b4e4\") " pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:04:55.136090 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:04:55.135688    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 08:04:55.136090 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:04:55.135741    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs podName:eb7a2f95-8714-4283-8dcf-66f1fb75b4e4 nodeName:}" failed. No retries permitted until 2026-07-28 08:06:57.135727032 +0000 UTC m=+252.322915139 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs") pod "network-metrics-daemon-xphvp" (UID: "eb7a2f95-8714-4283-8dcf-66f1fb75b4e4") : secret "metrics-daemon-secret" not found
Jul 28 08:05:24.199327 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:05:24.199270    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt" podUID="539630ec-45ae-4b70-bbce-d390e08afecd"
Jul 28 08:05:24.213503 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:05:24.213441    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-78b87f4567-ck6j9" podUID="ed157823-a341-4114-a7ad-c3e9290cbcf5"
Jul 28 08:05:24.229616 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:05:24.229574    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bffhp" podUID="f9498a46-5dad-42a4-908a-eadc84f02430"
Jul 28 08:05:24.809513 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:05:24.809428    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:05:24.809672 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:05:24.809429    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bffhp"
Jul 28 08:05:24.809672 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:05:24.809429    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"
Jul 28 08:05:25.340175 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:05:25.340136    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xphvp" podUID="eb7a2f95-8714-4283-8dcf-66f1fb75b4e4"
Jul 28 08:05:29.173523 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:05:29.173476    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:05:29.173523 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:05:29.173528    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-5wjpt\" (UID: \"539630ec-45ae-4b70-bbce-d390e08afecd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"
Jul 28 08:05:29.174050 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:05:29.173630    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 08:05:29.174050 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:05:29.173640    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 08:05:29.174050 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:05:29.173653    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b87f4567-ck6j9: secret "image-registry-tls" not found
Jul 28 08:05:29.174050 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:05:29.173722    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert podName:539630ec-45ae-4b70-bbce-d390e08afecd nodeName:}" failed. No retries permitted until 2026-07-28 08:07:31.173703738 +0000 UTC m=+286.360891846 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-5wjpt" (UID: "539630ec-45ae-4b70-bbce-d390e08afecd") : secret "networking-console-plugin-cert" not found
Jul 28 08:05:29.174050 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:05:29.173780    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls podName:ed157823-a341-4114-a7ad-c3e9290cbcf5 nodeName:}" failed. No retries permitted until 2026-07-28 08:07:31.173767035 +0000 UTC m=+286.360955142 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls") pod "image-registry-78b87f4567-ck6j9" (UID: "ed157823-a341-4114-a7ad-c3e9290cbcf5") : secret "image-registry-tls" not found
Jul 28 08:05:29.174050 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:05:29.173798    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls\") pod \"dns-default-bffhp\" (UID: \"f9498a46-5dad-42a4-908a-eadc84f02430\") " pod="openshift-dns/dns-default-bffhp"
Jul 28 08:05:29.174050 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:05:29.173873    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 08:05:29.174050 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:05:29.173902    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls podName:f9498a46-5dad-42a4-908a-eadc84f02430 nodeName:}" failed. No retries permitted until 2026-07-28 08:07:31.173894705 +0000 UTC m=+286.361082813 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls") pod "dns-default-bffhp" (UID: "f9498a46-5dad-42a4-908a-eadc84f02430") : secret "dns-default-metrics-tls" not found
Jul 28 08:05:38.328442 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:05:38.328354    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:06:57.197986 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:06:57.197931    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs\") pod \"network-metrics-daemon-xphvp\" (UID: \"eb7a2f95-8714-4283-8dcf-66f1fb75b4e4\") " pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:06:57.198626 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:06:57.198106    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 08:06:57.198626 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:06:57.198203    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs podName:eb7a2f95-8714-4283-8dcf-66f1fb75b4e4 nodeName:}" failed. No retries permitted until 2026-07-28 08:08:59.198179671 +0000 UTC m=+374.385367782 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs") pod "network-metrics-daemon-xphvp" (UID: "eb7a2f95-8714-4283-8dcf-66f1fb75b4e4") : secret "metrics-daemon-secret" not found
Jul 28 08:07:00.122839 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.122807    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hlrq7"]
Jul 28 08:07:00.124591 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.124575    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hlrq7"
Jul 28 08:07:00.129905 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.127735    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 28 08:07:00.129905 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.128323    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7k2hf\""
Jul 28 08:07:00.129905 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.128810    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 28 08:07:00.129905 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.129008    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9tqt"]
Jul 28 08:07:00.133214 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.133063    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9llkf"]
Jul 28 08:07:00.133298 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.133200    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9tqt"
Jul 28 08:07:00.134876 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.134855    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-667869f59f-tbzsl"]
Jul 28 08:07:00.135004 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.134965    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9llkf"
Jul 28 08:07:00.136512 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.136495    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:00.138472 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.138436    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 28 08:07:00.138472 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.138469    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 28 08:07:00.138686 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.138501    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 28 08:07:00.138686 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.138469    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 28 08:07:00.138814 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.138799    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 28 08:07:00.138874 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.138831    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hqc26\""
Jul 28 08:07:00.138929 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.138880    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 28 08:07:00.138929 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.138906    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 28 08:07:00.139841 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.139815    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 28 08:07:00.139943 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.139854    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 08:07:00.139943 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.139861    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xnqt4\""
Jul 28 08:07:00.139943 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.139929    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vr7ts\""
Jul 28 08:07:00.140073 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.139958    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 28 08:07:00.140173 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.140160    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 08:07:00.140239 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.140172    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 28 08:07:00.140239 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.140162    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 28 08:07:00.154170 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.154147    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hlrq7"]
Jul 28 08:07:00.156160 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.156132    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9tqt"]
Jul 28 08:07:00.160098 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.160073    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-667869f59f-tbzsl"]
Jul 28 08:07:00.160928 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.160901    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9llkf"]
Jul 28 08:07:00.218276 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.218244    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a460ccbd-d2f1-4f6f-ab12-5306cec5d28d-config\") pod \"service-ca-operator-5d6c75f84f-k9tqt\" (UID: \"a460ccbd-d2f1-4f6f-ab12-5306cec5d28d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9tqt"
Jul 28 08:07:00.218276 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.218277    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-metrics-certs\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:00.218506 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.218298    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7r9d\" (UniqueName: \"kubernetes.io/projected/2c3b6449-e276-4abf-ac2f-fb97f667dd4e-kube-api-access-q7r9d\") pod \"volume-data-source-validator-549c6d54cf-hlrq7\" (UID: \"2c3b6449-e276-4abf-ac2f-fb97f667dd4e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hlrq7"
Jul 28 08:07:00.218506 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.218332    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-default-certificate\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:00.218506 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.218350    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4108bb49-e103-4124-8453-90f648061d8f-service-ca-bundle\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:00.218506 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.218365    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-9llkf\" (UID: \"82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9llkf"
Jul 28 08:07:00.218506 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.218436    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6qx2\" (UniqueName: \"kubernetes.io/projected/4108bb49-e103-4124-8453-90f648061d8f-kube-api-access-v6qx2\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:00.218655 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.218513    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a460ccbd-d2f1-4f6f-ab12-5306cec5d28d-serving-cert\") pod \"service-ca-operator-5d6c75f84f-k9tqt\" (UID: \"a460ccbd-d2f1-4f6f-ab12-5306cec5d28d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9tqt"
Jul 28 08:07:00.218655 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.218532    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4n5m\" (UniqueName: \"kubernetes.io/projected/82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9-kube-api-access-z4n5m\") pod \"cluster-samples-operator-6748489656-9llkf\" (UID: \"82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9llkf"
Jul 28 08:07:00.218655 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.218549    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-stats-auth\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:00.218655 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.218564    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zf68\" (UniqueName: \"kubernetes.io/projected/a460ccbd-d2f1-4f6f-ab12-5306cec5d28d-kube-api-access-8zf68\") pod \"service-ca-operator-5d6c75f84f-k9tqt\" (UID: \"a460ccbd-d2f1-4f6f-ab12-5306cec5d28d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9tqt"
Jul 28 08:07:00.220333 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.220309    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-vgzf4"]
Jul 28 08:07:00.222173 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.222159    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4"
Jul 28 08:07:00.224856 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.224826    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 28 08:07:00.225022 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.224858    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 28 08:07:00.225022 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.224908    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-g56sl\""
Jul 28 08:07:00.225186 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.225142    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 28 08:07:00.225186 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.225165    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 28 08:07:00.229773 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.229752    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 28 08:07:00.239174 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.239153    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-vgzf4"]
Jul 28 08:07:00.319419 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.319385    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-9llkf\" (UID: \"82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9llkf"
Jul 28 08:07:00.319614 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.319462    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6qx2\" (UniqueName: \"kubernetes.io/projected/4108bb49-e103-4124-8453-90f648061d8f-kube-api-access-v6qx2\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:00.319614 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.319486    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pdkx\" (UniqueName: \"kubernetes.io/projected/dcf82623-a4f7-4511-aed0-7248950f1ca1-kube-api-access-8pdkx\") pod \"console-operator-584dcb6b54-vgzf4\" (UID: \"dcf82623-a4f7-4511-aed0-7248950f1ca1\") " pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4"
Jul 28 08:07:00.319614 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.319549    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a460ccbd-d2f1-4f6f-ab12-5306cec5d28d-serving-cert\") pod \"service-ca-operator-5d6c75f84f-k9tqt\" (UID: \"a460ccbd-d2f1-4f6f-ab12-5306cec5d28d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9tqt"
Jul 28 08:07:00.319614 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.319568    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4n5m\" (UniqueName: \"kubernetes.io/projected/82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9-kube-api-access-z4n5m\") pod \"cluster-samples-operator-6748489656-9llkf\" (UID: \"82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9llkf"
Jul 28 08:07:00.319614 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:00.319581    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 08:07:00.319865 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.319585    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-stats-auth\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:00.319865 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:00.319648    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9-samples-operator-tls podName:82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9 nodeName:}" failed. No retries permitted until 2026-07-28 08:07:00.819627487 +0000 UTC m=+256.006815615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9-samples-operator-tls") pod "cluster-samples-operator-6748489656-9llkf" (UID: "82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9") : secret "samples-operator-tls" not found
Jul 28 08:07:00.319865 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.319704    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zf68\" (UniqueName: \"kubernetes.io/projected/a460ccbd-d2f1-4f6f-ab12-5306cec5d28d-kube-api-access-8zf68\") pod \"service-ca-operator-5d6c75f84f-k9tqt\" (UID: \"a460ccbd-d2f1-4f6f-ab12-5306cec5d28d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9tqt"
Jul 28 08:07:00.319865 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.319737    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a460ccbd-d2f1-4f6f-ab12-5306cec5d28d-config\") pod \"service-ca-operator-5d6c75f84f-k9tqt\" (UID: \"a460ccbd-d2f1-4f6f-ab12-5306cec5d28d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9tqt"
Jul 28 08:07:00.319865 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.319774    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dcf82623-a4f7-4511-aed0-7248950f1ca1-trusted-ca\") pod \"console-operator-584dcb6b54-vgzf4\" (UID: \"dcf82623-a4f7-4511-aed0-7248950f1ca1\") " pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4"
Jul 28 08:07:00.319865 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.319804    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-metrics-certs\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:00.319865 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.319836    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7r9d\" (UniqueName: \"kubernetes.io/projected/2c3b6449-e276-4abf-ac2f-fb97f667dd4e-kube-api-access-q7r9d\") pod \"volume-data-source-validator-549c6d54cf-hlrq7\" (UID: \"2c3b6449-e276-4abf-ac2f-fb97f667dd4e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hlrq7"
Jul 28 08:07:00.320204 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.319872    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dcf82623-a4f7-4511-aed0-7248950f1ca1-config\") pod \"console-operator-584dcb6b54-vgzf4\" (UID: \"dcf82623-a4f7-4511-aed0-7248950f1ca1\") " pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4"
Jul 28 08:07:00.320204 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:00.319892    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 08:07:00.320204 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.319910    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dcf82623-a4f7-4511-aed0-7248950f1ca1-serving-cert\") pod \"console-operator-584dcb6b54-vgzf4\" (UID: \"dcf82623-a4f7-4511-aed0-7248950f1ca1\") " pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4"
Jul 28 08:07:00.320204 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:00.319939    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-metrics-certs podName:4108bb49-e103-4124-8453-90f648061d8f nodeName:}" failed. No retries permitted until 2026-07-28 08:07:00.819924132 +0000 UTC m=+256.007112247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-metrics-certs") pod "router-default-667869f59f-tbzsl" (UID: "4108bb49-e103-4124-8453-90f648061d8f") : secret "router-metrics-certs-default" not found
Jul 28 08:07:00.320204 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.319982    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-default-certificate\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:00.320204 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.320014    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4108bb49-e103-4124-8453-90f648061d8f-service-ca-bundle\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:00.320204 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:00.320116    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4108bb49-e103-4124-8453-90f648061d8f-service-ca-bundle podName:4108bb49-e103-4124-8453-90f648061d8f nodeName:}" failed. No retries permitted until 2026-07-28 08:07:00.820097113 +0000 UTC m=+256.007285233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4108bb49-e103-4124-8453-90f648061d8f-service-ca-bundle") pod "router-default-667869f59f-tbzsl" (UID: "4108bb49-e103-4124-8453-90f648061d8f") : configmap references non-existent config key: service-ca.crt
Jul 28 08:07:00.320510 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.320311    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a460ccbd-d2f1-4f6f-ab12-5306cec5d28d-config\") pod \"service-ca-operator-5d6c75f84f-k9tqt\" (UID: \"a460ccbd-d2f1-4f6f-ab12-5306cec5d28d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9tqt"
Jul 28 08:07:00.322259 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.322235    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a460ccbd-d2f1-4f6f-ab12-5306cec5d28d-serving-cert\") pod \"service-ca-operator-5d6c75f84f-k9tqt\" (UID: \"a460ccbd-d2f1-4f6f-ab12-5306cec5d28d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9tqt"
Jul 28 08:07:00.322417 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.322400    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-default-certificate\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:00.322491 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.322416    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-stats-auth\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:00.329279 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.329254    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zf68\" (UniqueName: \"kubernetes.io/projected/a460ccbd-d2f1-4f6f-ab12-5306cec5d28d-kube-api-access-8zf68\") pod \"service-ca-operator-5d6c75f84f-k9tqt\" (UID: \"a460ccbd-d2f1-4f6f-ab12-5306cec5d28d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9tqt"
Jul 28 08:07:00.329877 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.329852    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6qx2\" (UniqueName: \"kubernetes.io/projected/4108bb49-e103-4124-8453-90f648061d8f-kube-api-access-v6qx2\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:00.329969 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.329957    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7r9d\" (UniqueName: \"kubernetes.io/projected/2c3b6449-e276-4abf-ac2f-fb97f667dd4e-kube-api-access-q7r9d\") pod \"volume-data-source-validator-549c6d54cf-hlrq7\" (UID: \"2c3b6449-e276-4abf-ac2f-fb97f667dd4e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hlrq7"
Jul 28 08:07:00.330360 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.330344    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4n5m\" (UniqueName: \"kubernetes.io/projected/82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9-kube-api-access-z4n5m\") pod \"cluster-samples-operator-6748489656-9llkf\" (UID: \"82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9llkf"
Jul 28 08:07:00.420752 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.420662    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dcf82623-a4f7-4511-aed0-7248950f1ca1-trusted-ca\") pod \"console-operator-584dcb6b54-vgzf4\" (UID: \"dcf82623-a4f7-4511-aed0-7248950f1ca1\") " pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4"
Jul 28 08:07:00.420752 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.420710    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dcf82623-a4f7-4511-aed0-7248950f1ca1-config\") pod \"console-operator-584dcb6b54-vgzf4\" (UID: \"dcf82623-a4f7-4511-aed0-7248950f1ca1\") " pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4"
Jul 28 08:07:00.420752 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.420740    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dcf82623-a4f7-4511-aed0-7248950f1ca1-serving-cert\") pod \"console-operator-584dcb6b54-vgzf4\" (UID: \"dcf82623-a4f7-4511-aed0-7248950f1ca1\") " pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4"
Jul 28 08:07:00.421026 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.420824    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pdkx\" (UniqueName: \"kubernetes.io/projected/dcf82623-a4f7-4511-aed0-7248950f1ca1-kube-api-access-8pdkx\") pod \"console-operator-584dcb6b54-vgzf4\" (UID: \"dcf82623-a4f7-4511-aed0-7248950f1ca1\") " pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4"
Jul 28 08:07:00.421420 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.421396    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dcf82623-a4f7-4511-aed0-7248950f1ca1-config\") pod \"console-operator-584dcb6b54-vgzf4\" (UID: \"dcf82623-a4f7-4511-aed0-7248950f1ca1\") " pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4"
Jul 28 08:07:00.421648 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.421620    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dcf82623-a4f7-4511-aed0-7248950f1ca1-trusted-ca\") pod \"console-operator-584dcb6b54-vgzf4\" (UID: \"dcf82623-a4f7-4511-aed0-7248950f1ca1\") " pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4"
Jul 28 08:07:00.423247 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.423215    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dcf82623-a4f7-4511-aed0-7248950f1ca1-serving-cert\") pod \"console-operator-584dcb6b54-vgzf4\" (UID: \"dcf82623-a4f7-4511-aed0-7248950f1ca1\") " pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4"
Jul 28 08:07:00.429686 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.429662    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pdkx\" (UniqueName: \"kubernetes.io/projected/dcf82623-a4f7-4511-aed0-7248950f1ca1-kube-api-access-8pdkx\") pod \"console-operator-584dcb6b54-vgzf4\" (UID: \"dcf82623-a4f7-4511-aed0-7248950f1ca1\") " pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4"
Jul 28 08:07:00.436471 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.436439    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hlrq7"
Jul 28 08:07:00.444059 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.444044    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9tqt"
Jul 28 08:07:00.531639 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.531605    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4"
Jul 28 08:07:00.574394 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.574350    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hlrq7"]
Jul 28 08:07:00.578572 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:07:00.578529    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3b6449_e276_4abf_ac2f_fb97f667dd4e.slice/crio-6959f2a278e30b66df692e815c84697d8b715007651198319fb52d7e21b527e7 WatchSource:0}: Error finding container 6959f2a278e30b66df692e815c84697d8b715007651198319fb52d7e21b527e7: Status 404 returned error can't find the container with id 6959f2a278e30b66df692e815c84697d8b715007651198319fb52d7e21b527e7
Jul 28 08:07:00.630562 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:07:00.630521    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda460ccbd_d2f1_4f6f_ab12_5306cec5d28d.slice/crio-6633875e8ef7e8fbd3829a51b2a71c42917a3e95080393ee89471a86b284bd7e WatchSource:0}: Error finding container 6633875e8ef7e8fbd3829a51b2a71c42917a3e95080393ee89471a86b284bd7e: Status 404 returned error can't find the container with id 6633875e8ef7e8fbd3829a51b2a71c42917a3e95080393ee89471a86b284bd7e
Jul 28 08:07:00.631581 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.631343    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9tqt"]
Jul 28 08:07:00.667003 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.666976    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-vgzf4"]
Jul 28 08:07:00.669928 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:07:00.669904    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcf82623_a4f7_4511_aed0_7248950f1ca1.slice/crio-dc3038043e05daf909b0e24b8a84c9421edc42f4dac9ebb44aaf3153f3826571 WatchSource:0}: Error finding container dc3038043e05daf909b0e24b8a84c9421edc42f4dac9ebb44aaf3153f3826571: Status 404 returned error can't find the container with id dc3038043e05daf909b0e24b8a84c9421edc42f4dac9ebb44aaf3153f3826571
Jul 28 08:07:00.824665 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.824629    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-metrics-certs\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:00.824810 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.824686    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4108bb49-e103-4124-8453-90f648061d8f-service-ca-bundle\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:00.824810 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:00.824708    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-9llkf\" (UID: \"82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9llkf"
Jul 28 08:07:00.824899 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:00.824814    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 08:07:00.824899 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:00.824856    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4108bb49-e103-4124-8453-90f648061d8f-service-ca-bundle podName:4108bb49-e103-4124-8453-90f648061d8f nodeName:}" failed. No retries permitted until 2026-07-28 08:07:01.824838969 +0000 UTC m=+257.012027077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4108bb49-e103-4124-8453-90f648061d8f-service-ca-bundle") pod "router-default-667869f59f-tbzsl" (UID: "4108bb49-e103-4124-8453-90f648061d8f") : configmap references non-existent config key: service-ca.crt
Jul 28 08:07:00.824899 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:00.824889    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-metrics-certs podName:4108bb49-e103-4124-8453-90f648061d8f nodeName:}" failed. No retries permitted until 2026-07-28 08:07:01.824874348 +0000 UTC m=+257.012062456 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-metrics-certs") pod "router-default-667869f59f-tbzsl" (UID: "4108bb49-e103-4124-8453-90f648061d8f") : secret "router-metrics-certs-default" not found
Jul 28 08:07:00.824899 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:00.824820    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 08:07:00.825031 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:00.824937    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9-samples-operator-tls podName:82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9 nodeName:}" failed. No retries permitted until 2026-07-28 08:07:01.824926396 +0000 UTC m=+257.012114524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9-samples-operator-tls") pod "cluster-samples-operator-6748489656-9llkf" (UID: "82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9") : secret "samples-operator-tls" not found
Jul 28 08:07:01.034893 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:01.034800    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9tqt" event={"ID":"a460ccbd-d2f1-4f6f-ab12-5306cec5d28d","Type":"ContainerStarted","Data":"6633875e8ef7e8fbd3829a51b2a71c42917a3e95080393ee89471a86b284bd7e"}
Jul 28 08:07:01.035793 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:01.035761    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4" event={"ID":"dcf82623-a4f7-4511-aed0-7248950f1ca1","Type":"ContainerStarted","Data":"dc3038043e05daf909b0e24b8a84c9421edc42f4dac9ebb44aaf3153f3826571"}
Jul 28 08:07:01.036759 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:01.036737    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hlrq7" event={"ID":"2c3b6449-e276-4abf-ac2f-fb97f667dd4e","Type":"ContainerStarted","Data":"6959f2a278e30b66df692e815c84697d8b715007651198319fb52d7e21b527e7"}
Jul 28 08:07:01.833899 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:01.833859    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-metrics-certs\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:01.834286 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:01.833937    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4108bb49-e103-4124-8453-90f648061d8f-service-ca-bundle\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:01.834286 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:01.833965    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-9llkf\" (UID: \"82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9llkf"
Jul 28 08:07:01.834286 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:01.834037    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 08:07:01.834286 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:01.834073    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 08:07:01.834286 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:01.834117    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4108bb49-e103-4124-8453-90f648061d8f-service-ca-bundle podName:4108bb49-e103-4124-8453-90f648061d8f nodeName:}" failed. No retries permitted until 2026-07-28 08:07:03.834091718 +0000 UTC m=+259.021279843 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4108bb49-e103-4124-8453-90f648061d8f-service-ca-bundle") pod "router-default-667869f59f-tbzsl" (UID: "4108bb49-e103-4124-8453-90f648061d8f") : configmap references non-existent config key: service-ca.crt
Jul 28 08:07:01.834286 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:01.834148    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-metrics-certs podName:4108bb49-e103-4124-8453-90f648061d8f nodeName:}" failed. No retries permitted until 2026-07-28 08:07:03.834127795 +0000 UTC m=+259.021315952 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-metrics-certs") pod "router-default-667869f59f-tbzsl" (UID: "4108bb49-e103-4124-8453-90f648061d8f") : secret "router-metrics-certs-default" not found
Jul 28 08:07:01.834286 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:01.834170    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9-samples-operator-tls podName:82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9 nodeName:}" failed. No retries permitted until 2026-07-28 08:07:03.834160098 +0000 UTC m=+259.021348205 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9-samples-operator-tls") pod "cluster-samples-operator-6748489656-9llkf" (UID: "82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9") : secret "samples-operator-tls" not found
Jul 28 08:07:02.040902 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:02.040822    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hlrq7" event={"ID":"2c3b6449-e276-4abf-ac2f-fb97f667dd4e","Type":"ContainerStarted","Data":"9524369248d05e036282812c11637bba27d21b2a9da87ea5aba277d33dc5b657"}
Jul 28 08:07:02.057488 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:02.057396    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hlrq7" podStartSLOduration=1.008326436 podStartE2EDuration="2.057376407s" totalImagesPullingTime="1.049049971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:07:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:07:02.05653882 +0000 UTC m=+257.243726963" watchObservedRunningTime="2026-07-28 08:07:02.057376407 +0000 UTC m=+257.244564538"
Jul 28 08:07:03.601066 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:03.600983    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-d5sw9"]
Jul 28 08:07:03.603220 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:03.603203    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-d5sw9"
Jul 28 08:07:03.605777 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:03.605754    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hwdgq\""
Jul 28 08:07:03.606201 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:03.606187    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 28 08:07:03.606439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:03.606427    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 28 08:07:03.613529 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:03.613507    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-d5sw9"]
Jul 28 08:07:03.650421 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:03.650385    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kptm4\" (UniqueName: \"kubernetes.io/projected/14f21adb-dc0c-449f-adf2-cb73d60156ac-kube-api-access-kptm4\") pod \"migrator-6865c9967-d5sw9\" (UID: \"14f21adb-dc0c-449f-adf2-cb73d60156ac\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-d5sw9"
Jul 28 08:07:03.750912 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:03.750869    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kptm4\" (UniqueName: \"kubernetes.io/projected/14f21adb-dc0c-449f-adf2-cb73d60156ac-kube-api-access-kptm4\") pod \"migrator-6865c9967-d5sw9\" (UID: \"14f21adb-dc0c-449f-adf2-cb73d60156ac\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-d5sw9"
Jul 28 08:07:03.759266 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:03.759237    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kptm4\" (UniqueName: \"kubernetes.io/projected/14f21adb-dc0c-449f-adf2-cb73d60156ac-kube-api-access-kptm4\") pod \"migrator-6865c9967-d5sw9\" (UID: \"14f21adb-dc0c-449f-adf2-cb73d60156ac\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-d5sw9"
Jul 28 08:07:03.851861 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:03.851765    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-metrics-certs\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:03.851861 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:03.851823    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4108bb49-e103-4124-8453-90f648061d8f-service-ca-bundle\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:03.851861 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:03.851847    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-9llkf\" (UID: \"82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9llkf"
Jul 28 08:07:03.852143 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:03.851949    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 08:07:03.852143 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:03.851968    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4108bb49-e103-4124-8453-90f648061d8f-service-ca-bundle podName:4108bb49-e103-4124-8453-90f648061d8f nodeName:}" failed. No retries permitted until 2026-07-28 08:07:07.851949746 +0000 UTC m=+263.039137881 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4108bb49-e103-4124-8453-90f648061d8f-service-ca-bundle") pod "router-default-667869f59f-tbzsl" (UID: "4108bb49-e103-4124-8453-90f648061d8f") : configmap references non-existent config key: service-ca.crt
Jul 28 08:07:03.852143 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:03.852010    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-metrics-certs podName:4108bb49-e103-4124-8453-90f648061d8f nodeName:}" failed. No retries permitted until 2026-07-28 08:07:07.851995538 +0000 UTC m=+263.039183646 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-metrics-certs") pod "router-default-667869f59f-tbzsl" (UID: "4108bb49-e103-4124-8453-90f648061d8f") : secret "router-metrics-certs-default" not found
Jul 28 08:07:03.852143 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:03.852040    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 08:07:03.852143 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:03.852118    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9-samples-operator-tls podName:82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9 nodeName:}" failed. No retries permitted until 2026-07-28 08:07:07.852100223 +0000 UTC m=+263.039288348 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9-samples-operator-tls") pod "cluster-samples-operator-6748489656-9llkf" (UID: "82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9") : secret "samples-operator-tls" not found
Jul 28 08:07:03.912692 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:03.912654    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-d5sw9"
Jul 28 08:07:04.040651 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.040620    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-d5sw9"]
Jul 28 08:07:04.043850 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:07:04.043802    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f21adb_dc0c_449f_adf2_cb73d60156ac.slice/crio-0d36f4f9d528f620a640812f33aa6b749c9979ce2d3e4a38c17a4c2767fd0b22 WatchSource:0}: Error finding container 0d36f4f9d528f620a640812f33aa6b749c9979ce2d3e4a38c17a4c2767fd0b22: Status 404 returned error can't find the container with id 0d36f4f9d528f620a640812f33aa6b749c9979ce2d3e4a38c17a4c2767fd0b22
Jul 28 08:07:04.051276 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.051246    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9tqt" event={"ID":"a460ccbd-d2f1-4f6f-ab12-5306cec5d28d","Type":"ContainerStarted","Data":"685b7dd43b7c96766d0ae3eaa4935e8bf83e3272de05def5c9e5e647180a5c6b"}
Jul 28 08:07:04.052787 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.052769    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vgzf4_dcf82623-a4f7-4511-aed0-7248950f1ca1/console-operator/0.log"
Jul 28 08:07:04.052870 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.052807    2583 generic.go:356] "Generic (PLEG): container finished" podID="dcf82623-a4f7-4511-aed0-7248950f1ca1" containerID="b1541e3259163885d3d6197b7478aa2845402a779a5ed9c837a0694d8ef1e8d1" exitCode=255
Jul 28 08:07:04.052870 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.052837    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4" event={"ID":"dcf82623-a4f7-4511-aed0-7248950f1ca1","Type":"ContainerDied","Data":"b1541e3259163885d3d6197b7478aa2845402a779a5ed9c837a0694d8ef1e8d1"}
Jul 28 08:07:04.053048 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.053035    2583 scope.go:117] "RemoveContainer" containerID="b1541e3259163885d3d6197b7478aa2845402a779a5ed9c837a0694d8ef1e8d1"
Jul 28 08:07:04.065529 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.065350    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9tqt" podStartSLOduration=1.355939052 podStartE2EDuration="4.065335893s" totalImagesPullingTime="2.709396841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:07:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:07:04.06491064 +0000 UTC m=+259.252098772" watchObservedRunningTime="2026-07-28 08:07:04.065335893 +0000 UTC m=+259.252524023"
Jul 28 08:07:04.591219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.591180    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-747k4"]
Jul 28 08:07:04.593367 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.593341    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:04.595762 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.595737    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 08:07:04.595762 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.595733    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 08:07:04.595762 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.595755    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 08:07:04.596003 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.595851    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lkgvf\""
Jul 28 08:07:04.596468 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.596438    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 08:07:04.606331 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.606300    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-747k4"]
Jul 28 08:07:04.658928 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.658880    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h89v\" (UniqueName: \"kubernetes.io/projected/2e3105ee-0942-48f2-b7bf-751b948a1189-kube-api-access-9h89v\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:04.658928 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.658937    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e3105ee-0942-48f2-b7bf-751b948a1189-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:04.659189 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.658993    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e3105ee-0942-48f2-b7bf-751b948a1189-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:04.659189 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.659083    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e3105ee-0942-48f2-b7bf-751b948a1189-crio-socket\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:04.659189 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.659166    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e3105ee-0942-48f2-b7bf-751b948a1189-data-volume\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:04.759757 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.759704    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e3105ee-0942-48f2-b7bf-751b948a1189-data-volume\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:04.759757 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.759773    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h89v\" (UniqueName: \"kubernetes.io/projected/2e3105ee-0942-48f2-b7bf-751b948a1189-kube-api-access-9h89v\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:04.760023 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.759808    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e3105ee-0942-48f2-b7bf-751b948a1189-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:04.760023 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.759833    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e3105ee-0942-48f2-b7bf-751b948a1189-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:04.760023 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.759865    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e3105ee-0942-48f2-b7bf-751b948a1189-crio-socket\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:04.760023 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.759950    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e3105ee-0942-48f2-b7bf-751b948a1189-crio-socket\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:04.760023 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:04.759958    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 08:07:04.760023 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:04.759975    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 08:07:04.760023 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:04.760023    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e3105ee-0942-48f2-b7bf-751b948a1189-insights-runtime-extractor-tls podName:2e3105ee-0942-48f2-b7bf-751b948a1189 nodeName:}" failed. No retries permitted until 2026-07-28 08:07:05.260008701 +0000 UTC m=+260.447196809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e3105ee-0942-48f2-b7bf-751b948a1189-insights-runtime-extractor-tls") pod "insights-runtime-extractor-747k4" (UID: "2e3105ee-0942-48f2-b7bf-751b948a1189") : secret "insights-runtime-extractor-tls" not found
Jul 28 08:07:04.760355 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:04.760039    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e3105ee-0942-48f2-b7bf-751b948a1189-kube-rbac-proxy-cm podName:2e3105ee-0942-48f2-b7bf-751b948a1189 nodeName:}" failed. No retries permitted until 2026-07-28 08:07:05.260031086 +0000 UTC m=+260.447219194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2e3105ee-0942-48f2-b7bf-751b948a1189-kube-rbac-proxy-cm") pod "insights-runtime-extractor-747k4" (UID: "2e3105ee-0942-48f2-b7bf-751b948a1189") : configmap "kube-rbac-proxy" not found
Jul 28 08:07:04.760355 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.760047    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e3105ee-0942-48f2-b7bf-751b948a1189-data-volume\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:04.768096 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:04.768075    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h89v\" (UniqueName: \"kubernetes.io/projected/2e3105ee-0942-48f2-b7bf-751b948a1189-kube-api-access-9h89v\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:05.058032 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:05.057994    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-d5sw9" event={"ID":"14f21adb-dc0c-449f-adf2-cb73d60156ac","Type":"ContainerStarted","Data":"0d36f4f9d528f620a640812f33aa6b749c9979ce2d3e4a38c17a4c2767fd0b22"}
Jul 28 08:07:05.059661 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:05.059629    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vgzf4_dcf82623-a4f7-4511-aed0-7248950f1ca1/console-operator/1.log"
Jul 28 08:07:05.060059 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:05.060039    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vgzf4_dcf82623-a4f7-4511-aed0-7248950f1ca1/console-operator/0.log"
Jul 28 08:07:05.060162 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:05.060082    2583 generic.go:356] "Generic (PLEG): container finished" podID="dcf82623-a4f7-4511-aed0-7248950f1ca1" containerID="bd3a493ec815719f3a5353a04ba31154f58115264a12d00b8ba14fa0b55a4421" exitCode=255
Jul 28 08:07:05.060162 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:05.060154    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4" event={"ID":"dcf82623-a4f7-4511-aed0-7248950f1ca1","Type":"ContainerDied","Data":"bd3a493ec815719f3a5353a04ba31154f58115264a12d00b8ba14fa0b55a4421"}
Jul 28 08:07:05.060268 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:05.060215    2583 scope.go:117] "RemoveContainer" containerID="b1541e3259163885d3d6197b7478aa2845402a779a5ed9c837a0694d8ef1e8d1"
Jul 28 08:07:05.060461 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:05.060428    2583 scope.go:117] "RemoveContainer" containerID="bd3a493ec815719f3a5353a04ba31154f58115264a12d00b8ba14fa0b55a4421"
Jul 28 08:07:05.060651 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:05.060626    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-vgzf4_openshift-console-operator(dcf82623-a4f7-4511-aed0-7248950f1ca1)\"" pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4" podUID="dcf82623-a4f7-4511-aed0-7248950f1ca1"
Jul 28 08:07:05.264298 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:05.264255    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e3105ee-0942-48f2-b7bf-751b948a1189-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:05.264298 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:05.264306    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e3105ee-0942-48f2-b7bf-751b948a1189-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:05.264546 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:05.264412    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 08:07:05.264546 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:05.264438    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 08:07:05.264546 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:05.264503    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e3105ee-0942-48f2-b7bf-751b948a1189-kube-rbac-proxy-cm podName:2e3105ee-0942-48f2-b7bf-751b948a1189 nodeName:}" failed. No retries permitted until 2026-07-28 08:07:06.264490201 +0000 UTC m=+261.451678309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2e3105ee-0942-48f2-b7bf-751b948a1189-kube-rbac-proxy-cm") pod "insights-runtime-extractor-747k4" (UID: "2e3105ee-0942-48f2-b7bf-751b948a1189") : configmap "kube-rbac-proxy" not found
Jul 28 08:07:05.264546 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:05.264516    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e3105ee-0942-48f2-b7bf-751b948a1189-insights-runtime-extractor-tls podName:2e3105ee-0942-48f2-b7bf-751b948a1189 nodeName:}" failed. No retries permitted until 2026-07-28 08:07:06.264510298 +0000 UTC m=+261.451698405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e3105ee-0942-48f2-b7bf-751b948a1189-insights-runtime-extractor-tls") pod "insights-runtime-extractor-747k4" (UID: "2e3105ee-0942-48f2-b7bf-751b948a1189") : secret "insights-runtime-extractor-tls" not found
Jul 28 08:07:06.066198 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:06.066116    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vgzf4_dcf82623-a4f7-4511-aed0-7248950f1ca1/console-operator/1.log"
Jul 28 08:07:06.066567 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:06.066545    2583 scope.go:117] "RemoveContainer" containerID="bd3a493ec815719f3a5353a04ba31154f58115264a12d00b8ba14fa0b55a4421"
Jul 28 08:07:06.066745 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:06.066724    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-vgzf4_openshift-console-operator(dcf82623-a4f7-4511-aed0-7248950f1ca1)\"" pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4" podUID="dcf82623-a4f7-4511-aed0-7248950f1ca1"
Jul 28 08:07:06.273553 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:06.273516    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e3105ee-0942-48f2-b7bf-751b948a1189-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:06.273725 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:06.273581    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e3105ee-0942-48f2-b7bf-751b948a1189-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:06.273725 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:06.273682    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 08:07:06.273725 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:06.273716    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 08:07:06.273876 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:06.273759    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e3105ee-0942-48f2-b7bf-751b948a1189-insights-runtime-extractor-tls podName:2e3105ee-0942-48f2-b7bf-751b948a1189 nodeName:}" failed. No retries permitted until 2026-07-28 08:07:08.273739 +0000 UTC m=+263.460927110 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e3105ee-0942-48f2-b7bf-751b948a1189-insights-runtime-extractor-tls") pod "insights-runtime-extractor-747k4" (UID: "2e3105ee-0942-48f2-b7bf-751b948a1189") : secret "insights-runtime-extractor-tls" not found
Jul 28 08:07:06.273876 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:06.273786    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e3105ee-0942-48f2-b7bf-751b948a1189-kube-rbac-proxy-cm podName:2e3105ee-0942-48f2-b7bf-751b948a1189 nodeName:}" failed. No retries permitted until 2026-07-28 08:07:08.273766214 +0000 UTC m=+263.460954336 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2e3105ee-0942-48f2-b7bf-751b948a1189-kube-rbac-proxy-cm") pod "insights-runtime-extractor-747k4" (UID: "2e3105ee-0942-48f2-b7bf-751b948a1189") : configmap "kube-rbac-proxy" not found
Jul 28 08:07:07.071094 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:07.071054    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-d5sw9" event={"ID":"14f21adb-dc0c-449f-adf2-cb73d60156ac","Type":"ContainerStarted","Data":"b504fb2a13792e12334c4b48188a1b26299940a88b8ec6165fb08352afd332b6"}
Jul 28 08:07:07.071510 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:07.071110    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-d5sw9" event={"ID":"14f21adb-dc0c-449f-adf2-cb73d60156ac","Type":"ContainerStarted","Data":"e928274432fad0fd0599bdadbba9869d9858d2620996ede7c27f16e36e5b7362"}
Jul 28 08:07:07.173932 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:07.173903    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-22gll_42846769-0c19-40cb-936c-0c8f3d7db4c5/dns-node-resolver/0.log"
Jul 28 08:07:07.888975 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:07.888927    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-metrics-certs\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:07.889178 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:07.888999    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4108bb49-e103-4124-8453-90f648061d8f-service-ca-bundle\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:07.889178 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:07.889038    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-9llkf\" (UID: \"82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9llkf"
Jul 28 08:07:07.889178 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:07.889096    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 08:07:07.889178 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:07.889140    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4108bb49-e103-4124-8453-90f648061d8f-service-ca-bundle podName:4108bb49-e103-4124-8453-90f648061d8f nodeName:}" failed. No retries permitted until 2026-07-28 08:07:15.889120114 +0000 UTC m=+271.076308244 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4108bb49-e103-4124-8453-90f648061d8f-service-ca-bundle") pod "router-default-667869f59f-tbzsl" (UID: "4108bb49-e103-4124-8453-90f648061d8f") : configmap references non-existent config key: service-ca.crt
Jul 28 08:07:07.889178 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:07.889160    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-metrics-certs podName:4108bb49-e103-4124-8453-90f648061d8f nodeName:}" failed. No retries permitted until 2026-07-28 08:07:15.889153426 +0000 UTC m=+271.076341533 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-metrics-certs") pod "router-default-667869f59f-tbzsl" (UID: "4108bb49-e103-4124-8453-90f648061d8f") : secret "router-metrics-certs-default" not found
Jul 28 08:07:07.889400 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:07.889189    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 08:07:07.889400 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:07.889256    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9-samples-operator-tls podName:82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9 nodeName:}" failed. No retries permitted until 2026-07-28 08:07:15.889237634 +0000 UTC m=+271.076425750 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9-samples-operator-tls") pod "cluster-samples-operator-6748489656-9llkf" (UID: "82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9") : secret "samples-operator-tls" not found
Jul 28 08:07:08.293639 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:08.293529    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e3105ee-0942-48f2-b7bf-751b948a1189-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:08.294076 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:08.293696    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e3105ee-0942-48f2-b7bf-751b948a1189-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:08.294076 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:08.293708    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 08:07:08.294076 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:08.293905    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e3105ee-0942-48f2-b7bf-751b948a1189-insights-runtime-extractor-tls podName:2e3105ee-0942-48f2-b7bf-751b948a1189 nodeName:}" failed. No retries permitted until 2026-07-28 08:07:12.293883859 +0000 UTC m=+267.481071970 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e3105ee-0942-48f2-b7bf-751b948a1189-insights-runtime-extractor-tls") pod "insights-runtime-extractor-747k4" (UID: "2e3105ee-0942-48f2-b7bf-751b948a1189") : secret "insights-runtime-extractor-tls" not found
Jul 28 08:07:08.294076 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:08.293768    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 08:07:08.294076 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:08.294002    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e3105ee-0942-48f2-b7bf-751b948a1189-kube-rbac-proxy-cm podName:2e3105ee-0942-48f2-b7bf-751b948a1189 nodeName:}" failed. No retries permitted until 2026-07-28 08:07:12.293983158 +0000 UTC m=+267.481171269 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2e3105ee-0942-48f2-b7bf-751b948a1189-kube-rbac-proxy-cm") pod "insights-runtime-extractor-747k4" (UID: "2e3105ee-0942-48f2-b7bf-751b948a1189") : configmap "kube-rbac-proxy" not found
Jul 28 08:07:08.573729 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:08.573657    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z7hg4_2fdc640c-ac36-407b-8fe0-d497c4cc05c2/node-ca/0.log"
Jul 28 08:07:09.174600 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:09.174572    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jvr4z_b88d5c13-e028-44d4-9844-fdc5359b9852/serve-healthcheck-canary/0.log"
Jul 28 08:07:09.574631 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:09.574559    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-d5sw9_14f21adb-dc0c-449f-adf2-cb73d60156ac/migrator/0.log"
Jul 28 08:07:09.774139 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:09.774112    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-d5sw9_14f21adb-dc0c-449f-adf2-cb73d60156ac/graceful-termination/0.log"
Jul 28 08:07:10.532322 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:10.532240    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4"
Jul 28 08:07:10.532322 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:10.532299    2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4"
Jul 28 08:07:10.532685 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:10.532671    2583 scope.go:117] "RemoveContainer" containerID="bd3a493ec815719f3a5353a04ba31154f58115264a12d00b8ba14fa0b55a4421"
Jul 28 08:07:10.532847 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:10.532829    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-vgzf4_openshift-console-operator(dcf82623-a4f7-4511-aed0-7248950f1ca1)\"" pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4" podUID="dcf82623-a4f7-4511-aed0-7248950f1ca1"
Jul 28 08:07:12.332391 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:12.332354    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e3105ee-0942-48f2-b7bf-751b948a1189-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:12.332786 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:12.332400    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e3105ee-0942-48f2-b7bf-751b948a1189-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:12.332786 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:12.332533    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 08:07:12.332786 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:12.332548    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 08:07:12.332786 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:12.332612    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e3105ee-0942-48f2-b7bf-751b948a1189-insights-runtime-extractor-tls podName:2e3105ee-0942-48f2-b7bf-751b948a1189 nodeName:}" failed. No retries permitted until 2026-07-28 08:07:20.332595251 +0000 UTC m=+275.519783360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e3105ee-0942-48f2-b7bf-751b948a1189-insights-runtime-extractor-tls") pod "insights-runtime-extractor-747k4" (UID: "2e3105ee-0942-48f2-b7bf-751b948a1189") : secret "insights-runtime-extractor-tls" not found
Jul 28 08:07:12.332786 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:12.332626    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e3105ee-0942-48f2-b7bf-751b948a1189-kube-rbac-proxy-cm podName:2e3105ee-0942-48f2-b7bf-751b948a1189 nodeName:}" failed. No retries permitted until 2026-07-28 08:07:20.332619897 +0000 UTC m=+275.519808005 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2e3105ee-0942-48f2-b7bf-751b948a1189-kube-rbac-proxy-cm") pod "insights-runtime-extractor-747k4" (UID: "2e3105ee-0942-48f2-b7bf-751b948a1189") : configmap "kube-rbac-proxy" not found
Jul 28 08:07:15.964803 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:15.964767    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-metrics-certs\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:15.965199 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:15.964835    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4108bb49-e103-4124-8453-90f648061d8f-service-ca-bundle\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:15.965199 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:15.964861    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-9llkf\" (UID: \"82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9llkf"
Jul 28 08:07:15.965199 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:15.965040    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4108bb49-e103-4124-8453-90f648061d8f-service-ca-bundle podName:4108bb49-e103-4124-8453-90f648061d8f nodeName:}" failed. No retries permitted until 2026-07-28 08:07:31.965018972 +0000 UTC m=+287.152207090 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4108bb49-e103-4124-8453-90f648061d8f-service-ca-bundle") pod "router-default-667869f59f-tbzsl" (UID: "4108bb49-e103-4124-8453-90f648061d8f") : configmap references non-existent config key: service-ca.crt
Jul 28 08:07:15.967353 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:15.967333    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-9llkf\" (UID: \"82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9llkf"
Jul 28 08:07:15.967416 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:15.967377    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4108bb49-e103-4124-8453-90f648061d8f-metrics-certs\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:16.050415 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:16.050380    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9llkf"
Jul 28 08:07:16.175539 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:16.175479    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-d5sw9" podStartSLOduration=10.851169708 podStartE2EDuration="13.175432626s" totalImagesPullingTime="2.324262918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:07:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:07:07.085827507 +0000 UTC m=+262.273015637" watchObservedRunningTime="2026-07-28 08:07:16.175432626 +0000 UTC m=+271.362620782"
Jul 28 08:07:16.176808 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:16.176782    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9llkf"]
Jul 28 08:07:17.100029 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:17.099993    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9llkf" event={"ID":"82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9","Type":"ContainerStarted","Data":"43aaea497e35437e6b3279f35c569e146f9ffb5b2b713195398b617de47396e0"}
Jul 28 08:07:20.110983 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:20.110940    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9llkf" event={"ID":"82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9","Type":"ContainerStarted","Data":"2b767726817a7457cca101931dd4e0678de429392884e654a756e34dfe5808c0"}
Jul 28 08:07:20.111563 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:20.111046    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9llkf" event={"ID":"82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9","Type":"ContainerStarted","Data":"b36d409ffa32b759a1c4d7061b1c8537e2970a8c19dc238550d09e33a849ebdc"}
Jul 28 08:07:20.128134 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:20.128085    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9llkf" podStartSLOduration=17.013549166 podStartE2EDuration="20.128068163s" totalImagesPullingTime="3.114518997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:07:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:07:20.127067524 +0000 UTC m=+275.314255647" watchObservedRunningTime="2026-07-28 08:07:20.128068163 +0000 UTC m=+275.315256293"
Jul 28 08:07:20.404025 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:20.403983    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e3105ee-0942-48f2-b7bf-751b948a1189-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:20.404247 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:20.404036    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e3105ee-0942-48f2-b7bf-751b948a1189-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:20.404247 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:20.404148    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 08:07:20.404247 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:20.404236    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e3105ee-0942-48f2-b7bf-751b948a1189-insights-runtime-extractor-tls podName:2e3105ee-0942-48f2-b7bf-751b948a1189 nodeName:}" failed. No retries permitted until 2026-07-28 08:07:36.404214166 +0000 UTC m=+291.591402276 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e3105ee-0942-48f2-b7bf-751b948a1189-insights-runtime-extractor-tls") pod "insights-runtime-extractor-747k4" (UID: "2e3105ee-0942-48f2-b7bf-751b948a1189") : secret "insights-runtime-extractor-tls" not found
Jul 28 08:07:20.404575 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:20.404557    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e3105ee-0942-48f2-b7bf-751b948a1189-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:21.329186 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:21.329156    2583 scope.go:117] "RemoveContainer" containerID="bd3a493ec815719f3a5353a04ba31154f58115264a12d00b8ba14fa0b55a4421"
Jul 28 08:07:22.120245 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:22.120217    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vgzf4_dcf82623-a4f7-4511-aed0-7248950f1ca1/console-operator/1.log"
Jul 28 08:07:22.120421 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:22.120269    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4" event={"ID":"dcf82623-a4f7-4511-aed0-7248950f1ca1","Type":"ContainerStarted","Data":"e5c94c36351b7ce6ef26153c5d1ec4b9abfa48a7b8a18b75117f6ba3590a5145"}
Jul 28 08:07:22.120528 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:22.120512    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4"
Jul 28 08:07:22.125287 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:22.125261    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4"
Jul 28 08:07:22.138228 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:22.138171    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-vgzf4" podStartSLOduration=19.468442143 podStartE2EDuration="22.13815725s" totalImagesPullingTime="2.669715107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:07:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:07:22.137169595 +0000 UTC m=+277.324357724" watchObservedRunningTime="2026-07-28 08:07:22.13815725 +0000 UTC m=+277.325345380"
Jul 28 08:07:27.629401 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:27.629363    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-g9x5p"]
Jul 28 08:07:27.635305 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:27.635278    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-g9x5p"
Jul 28 08:07:27.639304 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:27.639267    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 28 08:07:27.639304 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:27.639290    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 28 08:07:27.639570 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:27.639327    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bspk9\""
Jul 28 08:07:27.646076 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:27.646053    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-g9x5p"]
Jul 28 08:07:27.767764 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:27.767727    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8rrn\" (UniqueName: \"kubernetes.io/projected/39fd1727-9f68-4b65-b66a-0576025b6564-kube-api-access-s8rrn\") pod \"downloads-7c97dc4555-g9x5p\" (UID: \"39fd1727-9f68-4b65-b66a-0576025b6564\") " pod="openshift-console/downloads-7c97dc4555-g9x5p"
Jul 28 08:07:27.810610 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:27.810568    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt" podUID="539630ec-45ae-4b70-bbce-d390e08afecd"
Jul 28 08:07:27.810781 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:27.810568    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bffhp" podUID="f9498a46-5dad-42a4-908a-eadc84f02430"
Jul 28 08:07:27.810781 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:27.810576    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-78b87f4567-ck6j9" podUID="ed157823-a341-4114-a7ad-c3e9290cbcf5"
Jul 28 08:07:27.868500 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:27.868437    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8rrn\" (UniqueName: \"kubernetes.io/projected/39fd1727-9f68-4b65-b66a-0576025b6564-kube-api-access-s8rrn\") pod \"downloads-7c97dc4555-g9x5p\" (UID: \"39fd1727-9f68-4b65-b66a-0576025b6564\") " pod="openshift-console/downloads-7c97dc4555-g9x5p"
Jul 28 08:07:27.878662 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:27.878631    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8rrn\" (UniqueName: \"kubernetes.io/projected/39fd1727-9f68-4b65-b66a-0576025b6564-kube-api-access-s8rrn\") pod \"downloads-7c97dc4555-g9x5p\" (UID: \"39fd1727-9f68-4b65-b66a-0576025b6564\") " pod="openshift-console/downloads-7c97dc4555-g9x5p"
Jul 28 08:07:27.944070 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:27.943977    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-g9x5p"
Jul 28 08:07:28.077142 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:28.077005    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-g9x5p"]
Jul 28 08:07:28.079551 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:07:28.079516    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39fd1727_9f68_4b65_b66a_0576025b6564.slice/crio-59b793470578dc8812cb6cf9fd0ba0baf2af61dc3971af79fceb2da55125cab0 WatchSource:0}: Error finding container 59b793470578dc8812cb6cf9fd0ba0baf2af61dc3971af79fceb2da55125cab0: Status 404 returned error can't find the container with id 59b793470578dc8812cb6cf9fd0ba0baf2af61dc3971af79fceb2da55125cab0
Jul 28 08:07:28.139829 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:28.139789    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-g9x5p" event={"ID":"39fd1727-9f68-4b65-b66a-0576025b6564","Type":"ContainerStarted","Data":"59b793470578dc8812cb6cf9fd0ba0baf2af61dc3971af79fceb2da55125cab0"}
Jul 28 08:07:28.139829 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:28.139829    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bffhp"
Jul 28 08:07:28.140034 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:28.139845    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"
Jul 28 08:07:28.140034 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:28.139828    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:07:31.198434 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:31.198398    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-5wjpt\" (UID: \"539630ec-45ae-4b70-bbce-d390e08afecd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"
Jul 28 08:07:31.199006 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:31.198539    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:07:31.199006 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:31.198615    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls\") pod \"dns-default-bffhp\" (UID: \"f9498a46-5dad-42a4-908a-eadc84f02430\") " pod="openshift-dns/dns-default-bffhp"
Jul 28 08:07:31.202475 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:31.202422    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls\") pod \"image-registry-78b87f4567-ck6j9\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") " pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:07:31.205657 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:31.205625    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9498a46-5dad-42a4-908a-eadc84f02430-metrics-tls\") pod \"dns-default-bffhp\" (UID: \"f9498a46-5dad-42a4-908a-eadc84f02430\") " pod="openshift-dns/dns-default-bffhp"
Jul 28 08:07:31.205942 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:31.205913    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/539630ec-45ae-4b70-bbce-d390e08afecd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-5wjpt\" (UID: \"539630ec-45ae-4b70-bbce-d390e08afecd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"
Jul 28 08:07:31.444801 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:31.444762    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q9jvm\""
Jul 28 08:07:31.444801 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:31.444790    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-t9sx7\""
Jul 28 08:07:31.445046 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:31.444767    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zjhxs\""
Jul 28 08:07:31.451284 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:31.451195    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:07:31.451284 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:31.451217    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"
Jul 28 08:07:31.451284 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:31.451241    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bffhp"
Jul 28 08:07:31.651048 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:31.650933    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78b87f4567-ck6j9"]
Jul 28 08:07:31.654100 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:07:31.654066    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded157823_a341_4114_a7ad_c3e9290cbcf5.slice/crio-a2edb6d84dcab8e56768421b0d31ed3e39ef8e5fe7b68660f85cd0babbe85d48 WatchSource:0}: Error finding container a2edb6d84dcab8e56768421b0d31ed3e39ef8e5fe7b68660f85cd0babbe85d48: Status 404 returned error can't find the container with id a2edb6d84dcab8e56768421b0d31ed3e39ef8e5fe7b68660f85cd0babbe85d48
Jul 28 08:07:31.665094 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:31.665065    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bffhp"]
Jul 28 08:07:31.669009 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:07:31.668978    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9498a46_5dad_42a4_908a_eadc84f02430.slice/crio-7dfc6355b30a8ba55d7d590da9cb815a622a84be23753abc9d745e312399e91d WatchSource:0}: Error finding container 7dfc6355b30a8ba55d7d590da9cb815a622a84be23753abc9d745e312399e91d: Status 404 returned error can't find the container with id 7dfc6355b30a8ba55d7d590da9cb815a622a84be23753abc9d745e312399e91d
Jul 28 08:07:31.863469 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:31.863419    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt"]
Jul 28 08:07:31.866563 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:07:31.866535    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod539630ec_45ae_4b70_bbce_d390e08afecd.slice/crio-30b7b7f2cf319e92cf40ab0219a3089e64dd359dd533df6447238b4fa968866c WatchSource:0}: Error finding container 30b7b7f2cf319e92cf40ab0219a3089e64dd359dd533df6447238b4fa968866c: Status 404 returned error can't find the container with id 30b7b7f2cf319e92cf40ab0219a3089e64dd359dd533df6447238b4fa968866c
Jul 28 08:07:32.010785 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:32.010699    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4108bb49-e103-4124-8453-90f648061d8f-service-ca-bundle\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:32.011424 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:32.011391    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4108bb49-e103-4124-8453-90f648061d8f-service-ca-bundle\") pod \"router-default-667869f59f-tbzsl\" (UID: \"4108bb49-e103-4124-8453-90f648061d8f\") " pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:32.155348 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:32.155308    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bffhp" event={"ID":"f9498a46-5dad-42a4-908a-eadc84f02430","Type":"ContainerStarted","Data":"7dfc6355b30a8ba55d7d590da9cb815a622a84be23753abc9d745e312399e91d"}
Jul 28 08:07:32.156839 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:32.156808    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt" event={"ID":"539630ec-45ae-4b70-bbce-d390e08afecd","Type":"ContainerStarted","Data":"30b7b7f2cf319e92cf40ab0219a3089e64dd359dd533df6447238b4fa968866c"}
Jul 28 08:07:32.158626 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:32.158585    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b87f4567-ck6j9" event={"ID":"ed157823-a341-4114-a7ad-c3e9290cbcf5","Type":"ContainerStarted","Data":"01d80f0e7118ec7b73b8360184f2b0de4eccf1beb6cd10c52403f2ece524255c"}
Jul 28 08:07:32.158730 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:32.158632    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b87f4567-ck6j9" event={"ID":"ed157823-a341-4114-a7ad-c3e9290cbcf5","Type":"ContainerStarted","Data":"a2edb6d84dcab8e56768421b0d31ed3e39ef8e5fe7b68660f85cd0babbe85d48"}
Jul 28 08:07:32.158808 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:32.158742    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:07:32.184276 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:32.184217    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78b87f4567-ck6j9" podStartSLOduration=286.18420065 podStartE2EDuration="4m46.18420065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:02:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:07:32.18204825 +0000 UTC m=+287.369236404" watchObservedRunningTime="2026-07-28 08:07:32.18420065 +0000 UTC m=+287.371388758"
Jul 28 08:07:32.256688 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:32.256646    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:32.413468 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:32.413410    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-667869f59f-tbzsl"]
Jul 28 08:07:32.416347 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:07:32.416305    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4108bb49_e103_4124_8453_90f648061d8f.slice/crio-74bbaa608864a585b69ee670e912640ba8bff44f5e349933d2c916ca32f774e3 WatchSource:0}: Error finding container 74bbaa608864a585b69ee670e912640ba8bff44f5e349933d2c916ca32f774e3: Status 404 returned error can't find the container with id 74bbaa608864a585b69ee670e912640ba8bff44f5e349933d2c916ca32f774e3
Jul 28 08:07:33.164827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:33.164794    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-667869f59f-tbzsl" event={"ID":"4108bb49-e103-4124-8453-90f648061d8f","Type":"ContainerStarted","Data":"6f59362cc919c138434c8c498f7a9539dd847afbff8827e7fd527b1241169772"}
Jul 28 08:07:33.165027 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:33.164853    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-667869f59f-tbzsl" event={"ID":"4108bb49-e103-4124-8453-90f648061d8f","Type":"ContainerStarted","Data":"74bbaa608864a585b69ee670e912640ba8bff44f5e349933d2c916ca32f774e3"}
Jul 28 08:07:33.257387 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:33.257349    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:33.260954 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:33.260924    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:33.280352 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:33.279913    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-667869f59f-tbzsl" podStartSLOduration=33.279892713 podStartE2EDuration="33.279892713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:07:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:07:33.184799333 +0000 UTC m=+288.371987463" watchObservedRunningTime="2026-07-28 08:07:33.279892713 +0000 UTC m=+288.467080844"
Jul 28 08:07:34.171017 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:34.170987    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:34.172549 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:34.172525    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-667869f59f-tbzsl"
Jul 28 08:07:35.156879 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:35.156840    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-558jm"]
Jul 28 08:07:35.160002 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:35.159977    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-558jm"
Jul 28 08:07:35.162666 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:35.162631    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 28 08:07:35.162814 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:35.162634    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9fhjj\""
Jul 28 08:07:35.169615 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:35.169586    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-558jm"]
Jul 28 08:07:35.177315 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:35.177275    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bffhp" event={"ID":"f9498a46-5dad-42a4-908a-eadc84f02430","Type":"ContainerStarted","Data":"bab8549db96f0eae95d98245861e29c1a0e87070021064a7c059a94287ec4a9a"}
Jul 28 08:07:35.177493 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:35.177350    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bffhp" event={"ID":"f9498a46-5dad-42a4-908a-eadc84f02430","Type":"ContainerStarted","Data":"ba29dbb1ae95577a5455db98a3fedaa9e19a7819df949dbb99f500a85314de55"}
Jul 28 08:07:35.177493 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:35.177387    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bffhp"
Jul 28 08:07:35.179479 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:35.179427    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt" event={"ID":"539630ec-45ae-4b70-bbce-d390e08afecd","Type":"ContainerStarted","Data":"9701a3190e83f719e583acb2634ae8b037dcce534b697a5066f902f663342ca0"}
Jul 28 08:07:35.198199 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:35.198137    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-5wjpt" podStartSLOduration=264.840859706 podStartE2EDuration="4m27.198116454s" totalImagesPullingTime="2.357256748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:07:35.197768813 +0000 UTC m=+290.384956948" watchObservedRunningTime="2026-07-28 08:07:35.198116454 +0000 UTC m=+290.385304591"
Jul 28 08:07:35.214938 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:35.214880    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bffhp" podStartSLOduration=251.654650583 podStartE2EDuration="4m14.214860197s" totalImagesPullingTime="2.560209614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:03:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:07:35.21399034 +0000 UTC m=+290.401178476" watchObservedRunningTime="2026-07-28 08:07:35.214860197 +0000 UTC m=+290.402048328"
Jul 28 08:07:35.340387 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:35.340335    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/46c32b4c-c005-4fb0-a091-91c6c33890fd-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-558jm\" (UID: \"46c32b4c-c005-4fb0-a091-91c6c33890fd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-558jm"
Jul 28 08:07:35.441656 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:35.441571    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/46c32b4c-c005-4fb0-a091-91c6c33890fd-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-558jm\" (UID: \"46c32b4c-c005-4fb0-a091-91c6c33890fd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-558jm"
Jul 28 08:07:35.441802 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:35.441748    2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 28 08:07:35.441857 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:35.441830    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c32b4c-c005-4fb0-a091-91c6c33890fd-tls-certificates podName:46c32b4c-c005-4fb0-a091-91c6c33890fd nodeName:}" failed. No retries permitted until 2026-07-28 08:07:35.941808634 +0000 UTC m=+291.128996742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/46c32b4c-c005-4fb0-a091-91c6c33890fd-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-558jm" (UID: "46c32b4c-c005-4fb0-a091-91c6c33890fd") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 28 08:07:35.946268 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:35.946223    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/46c32b4c-c005-4fb0-a091-91c6c33890fd-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-558jm\" (UID: \"46c32b4c-c005-4fb0-a091-91c6c33890fd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-558jm"
Jul 28 08:07:35.949216 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:35.949182    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/46c32b4c-c005-4fb0-a091-91c6c33890fd-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-558jm\" (UID: \"46c32b4c-c005-4fb0-a091-91c6c33890fd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-558jm"
Jul 28 08:07:36.071669 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:36.071633    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-558jm"
Jul 28 08:07:36.235807 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:36.235721    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-558jm"]
Jul 28 08:07:36.239330 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:07:36.239300    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c32b4c_c005_4fb0_a091_91c6c33890fd.slice/crio-dbcc4f8bf7b79dc8fb69cc51e2c5e7158818d713ac7e86ad974b3679ebcd8779 WatchSource:0}: Error finding container dbcc4f8bf7b79dc8fb69cc51e2c5e7158818d713ac7e86ad974b3679ebcd8779: Status 404 returned error can't find the container with id dbcc4f8bf7b79dc8fb69cc51e2c5e7158818d713ac7e86ad974b3679ebcd8779
Jul 28 08:07:36.451670 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:36.451633    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e3105ee-0942-48f2-b7bf-751b948a1189-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:36.454647 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:36.454616    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e3105ee-0942-48f2-b7bf-751b948a1189-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-747k4\" (UID: \"2e3105ee-0942-48f2-b7bf-751b948a1189\") " pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:36.702840 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:36.702808    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-747k4"
Jul 28 08:07:36.862189 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:36.862150    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-747k4"]
Jul 28 08:07:36.866718 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:07:36.866686    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e3105ee_0942_48f2_b7bf_751b948a1189.slice/crio-76825dddc1beb15ed0b3098a2132dee8c8d89ccc001bb614eb998709df1bb1c8 WatchSource:0}: Error finding container 76825dddc1beb15ed0b3098a2132dee8c8d89ccc001bb614eb998709df1bb1c8: Status 404 returned error can't find the container with id 76825dddc1beb15ed0b3098a2132dee8c8d89ccc001bb614eb998709df1bb1c8
Jul 28 08:07:37.189345 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:37.189305    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-747k4" event={"ID":"2e3105ee-0942-48f2-b7bf-751b948a1189","Type":"ContainerStarted","Data":"76825dddc1beb15ed0b3098a2132dee8c8d89ccc001bb614eb998709df1bb1c8"}
Jul 28 08:07:37.190875 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:37.190841    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-558jm" event={"ID":"46c32b4c-c005-4fb0-a091-91c6c33890fd","Type":"ContainerStarted","Data":"dbcc4f8bf7b79dc8fb69cc51e2c5e7158818d713ac7e86ad974b3679ebcd8779"}
Jul 28 08:07:38.200309 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:38.200266    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-558jm" event={"ID":"46c32b4c-c005-4fb0-a091-91c6c33890fd","Type":"ContainerStarted","Data":"0c21877b9d365118cdf7182dbd3413129c8797c20cf398dbef1fd50c59303003"}
Jul 28 08:07:38.200740 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:38.200654    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-558jm"
Jul 28 08:07:38.206685 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:38.206659    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-558jm"
Jul 28 08:07:38.221022 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:38.220955    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-558jm" podStartSLOduration=1.9647674400000001 podStartE2EDuration="3.220932306s" totalImagesPullingTime="1.256164866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:07:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:07:38.220132415 +0000 UTC m=+293.407320546" watchObservedRunningTime="2026-07-28 08:07:38.220932306 +0000 UTC m=+293.408120489"
Jul 28 08:07:41.328878 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:41.328822    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xphvp" podUID="eb7a2f95-8714-4283-8dcf-66f1fb75b4e4"
Jul 28 08:07:45.186236 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:45.186203    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bffhp"
Jul 28 08:07:48.482923 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.482896    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vgzf4_dcf82623-a4f7-4511-aed0-7248950f1ca1/console-operator/1.log"
Jul 28 08:07:48.483314 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.482942    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vgzf4_dcf82623-a4f7-4511-aed0-7248950f1ca1/console-operator/1.log"
Jul 28 08:07:48.491291 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.491267    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-acl-logging/0.log"
Jul 28 08:07:48.491417 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.491390    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-acl-logging/0.log"
Jul 28 08:07:48.494914 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.494893    2583 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 08:07:48.566054 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.566016    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj"]
Jul 28 08:07:48.570360 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.570337    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj"
Jul 28 08:07:48.573488 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.573439    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 08:07:48.573656 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.573550    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-t4l8f\""
Jul 28 08:07:48.573656 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.573639    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 28 08:07:48.573784 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.573663    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 08:07:48.574209 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.574195    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 08:07:48.574294 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.574227    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 28 08:07:48.584695 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.584672    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj"]
Jul 28 08:07:48.595405 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.595385    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 08:07:48.599641 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.599613    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f9fh8"]
Jul 28 08:07:48.606075 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.606043    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.608374 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.608351    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 08:07:48.608533 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.608351    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 08:07:48.608533 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.608394    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b2tf7\""
Jul 28 08:07:48.608749 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.608733    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 08:07:48.663704 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.663670    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a979677e-ccd2-4a6a-8f73-33de147b511c-sys\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.663896 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.663716    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a979677e-ccd2-4a6a-8f73-33de147b511c-metrics-client-ca\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.663896 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.663742    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a979677e-ccd2-4a6a-8f73-33de147b511c-node-exporter-wtmp\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.663896 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.663807    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x2ct\" (UniqueName: \"kubernetes.io/projected/a979677e-ccd2-4a6a-8f73-33de147b511c-kube-api-access-7x2ct\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.663896 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.663860    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6aacc162-bab5-4d4f-92e8-22812cef76ea-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-wjmzj\" (UID: \"6aacc162-bab5-4d4f-92e8-22812cef76ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj"
Jul 28 08:07:48.664087 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.663904    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a979677e-ccd2-4a6a-8f73-33de147b511c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.664087 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.663928    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a979677e-ccd2-4a6a-8f73-33de147b511c-node-exporter-textfile\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.664087 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.663963    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a979677e-ccd2-4a6a-8f73-33de147b511c-node-exporter-tls\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.664087 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.664021    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a979677e-ccd2-4a6a-8f73-33de147b511c-root\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.664087 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.664072    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6aacc162-bab5-4d4f-92e8-22812cef76ea-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-wjmzj\" (UID: \"6aacc162-bab5-4d4f-92e8-22812cef76ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj"
Jul 28 08:07:48.664328 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.664128    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a979677e-ccd2-4a6a-8f73-33de147b511c-node-exporter-accelerators-collector-config\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.664328 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.664171    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkzmt\" (UniqueName: \"kubernetes.io/projected/6aacc162-bab5-4d4f-92e8-22812cef76ea-kube-api-access-bkzmt\") pod \"openshift-state-metrics-b8f49f5c6-wjmzj\" (UID: \"6aacc162-bab5-4d4f-92e8-22812cef76ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj"
Jul 28 08:07:48.664328 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.664191    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6aacc162-bab5-4d4f-92e8-22812cef76ea-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-wjmzj\" (UID: \"6aacc162-bab5-4d4f-92e8-22812cef76ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj"
Jul 28 08:07:48.765090 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.764999    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a979677e-ccd2-4a6a-8f73-33de147b511c-node-exporter-accelerators-collector-config\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.765090 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.765061    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkzmt\" (UniqueName: \"kubernetes.io/projected/6aacc162-bab5-4d4f-92e8-22812cef76ea-kube-api-access-bkzmt\") pod \"openshift-state-metrics-b8f49f5c6-wjmzj\" (UID: \"6aacc162-bab5-4d4f-92e8-22812cef76ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj"
Jul 28 08:07:48.765308 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.765093    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6aacc162-bab5-4d4f-92e8-22812cef76ea-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-wjmzj\" (UID: \"6aacc162-bab5-4d4f-92e8-22812cef76ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj"
Jul 28 08:07:48.765308 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.765120    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a979677e-ccd2-4a6a-8f73-33de147b511c-sys\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.765308 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.765145    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a979677e-ccd2-4a6a-8f73-33de147b511c-metrics-client-ca\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.765308 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.765172    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a979677e-ccd2-4a6a-8f73-33de147b511c-node-exporter-wtmp\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.765308 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.765199    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x2ct\" (UniqueName: \"kubernetes.io/projected/a979677e-ccd2-4a6a-8f73-33de147b511c-kube-api-access-7x2ct\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.765308 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.765230    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6aacc162-bab5-4d4f-92e8-22812cef76ea-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-wjmzj\" (UID: \"6aacc162-bab5-4d4f-92e8-22812cef76ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj"
Jul 28 08:07:48.765308 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.765278    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a979677e-ccd2-4a6a-8f73-33de147b511c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.765308 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.765308    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a979677e-ccd2-4a6a-8f73-33de147b511c-node-exporter-textfile\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.765838 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.765357    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a979677e-ccd2-4a6a-8f73-33de147b511c-node-exporter-tls\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.765838 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.765400    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a979677e-ccd2-4a6a-8f73-33de147b511c-root\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.765838 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.765429    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6aacc162-bab5-4d4f-92e8-22812cef76ea-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-wjmzj\" (UID: \"6aacc162-bab5-4d4f-92e8-22812cef76ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj"
Jul 28 08:07:48.765838 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.765576    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a979677e-ccd2-4a6a-8f73-33de147b511c-node-exporter-accelerators-collector-config\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.765838 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:48.765607    2583 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 28 08:07:48.765838 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:48.765654    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aacc162-bab5-4d4f-92e8-22812cef76ea-openshift-state-metrics-tls podName:6aacc162-bab5-4d4f-92e8-22812cef76ea nodeName:}" failed. No retries permitted until 2026-07-28 08:07:49.265641776 +0000 UTC m=+304.452829886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6aacc162-bab5-4d4f-92e8-22812cef76ea-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-wjmzj" (UID: "6aacc162-bab5-4d4f-92e8-22812cef76ea") : secret "openshift-state-metrics-tls" not found
Jul 28 08:07:48.766161 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.765932    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a979677e-ccd2-4a6a-8f73-33de147b511c-node-exporter-wtmp\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.766161 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.765971    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a979677e-ccd2-4a6a-8f73-33de147b511c-node-exporter-textfile\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.766161 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.765994    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a979677e-ccd2-4a6a-8f73-33de147b511c-sys\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.766161 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.766040    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a979677e-ccd2-4a6a-8f73-33de147b511c-root\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.766161 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.766142    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a979677e-ccd2-4a6a-8f73-33de147b511c-metrics-client-ca\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.766391 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:48.766264    2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 28 08:07:48.766391 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.766279    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6aacc162-bab5-4d4f-92e8-22812cef76ea-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-wjmzj\" (UID: \"6aacc162-bab5-4d4f-92e8-22812cef76ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj"
Jul 28 08:07:48.766391 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:48.766336    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a979677e-ccd2-4a6a-8f73-33de147b511c-node-exporter-tls podName:a979677e-ccd2-4a6a-8f73-33de147b511c nodeName:}" failed. No retries permitted until 2026-07-28 08:07:49.266317629 +0000 UTC m=+304.453505744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a979677e-ccd2-4a6a-8f73-33de147b511c-node-exporter-tls") pod "node-exporter-f9fh8" (UID: "a979677e-ccd2-4a6a-8f73-33de147b511c") : secret "node-exporter-tls" not found
Jul 28 08:07:48.768628 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.768581    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a979677e-ccd2-4a6a-8f73-33de147b511c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:48.768935 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.768917    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6aacc162-bab5-4d4f-92e8-22812cef76ea-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-wjmzj\" (UID: \"6aacc162-bab5-4d4f-92e8-22812cef76ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj"
Jul 28 08:07:48.775846 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.775817    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkzmt\" (UniqueName: \"kubernetes.io/projected/6aacc162-bab5-4d4f-92e8-22812cef76ea-kube-api-access-bkzmt\") pod \"openshift-state-metrics-b8f49f5c6-wjmzj\" (UID: \"6aacc162-bab5-4d4f-92e8-22812cef76ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj"
Jul 28 08:07:48.776048 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:48.776020    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x2ct\" (UniqueName: \"kubernetes.io/projected/a979677e-ccd2-4a6a-8f73-33de147b511c-kube-api-access-7x2ct\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:49.249682 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.249331    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-g9x5p" event={"ID":"39fd1727-9f68-4b65-b66a-0576025b6564","Type":"ContainerStarted","Data":"5adaceb5d1cf934f254db132fc9611f5b430444d83f878ce5b25e5d522bd5138"}
Jul 28 08:07:49.249682 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.249566    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-g9x5p"
Jul 28 08:07:49.251657 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.251322    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-747k4" event={"ID":"2e3105ee-0942-48f2-b7bf-751b948a1189","Type":"ContainerStarted","Data":"34bfa1437d36a8e4d0eb4b7d2ec37ca1f26d009ee800d3146f8a5206b3364359"}
Jul 28 08:07:49.265001 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.264931    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-g9x5p"
Jul 28 08:07:49.270339 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.269976    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6aacc162-bab5-4d4f-92e8-22812cef76ea-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-wjmzj\" (UID: \"6aacc162-bab5-4d4f-92e8-22812cef76ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj"
Jul 28 08:07:49.270339 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.270072    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a979677e-ccd2-4a6a-8f73-33de147b511c-node-exporter-tls\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:49.271063 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:49.270639    2583 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 28 08:07:49.271063 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:07:49.270703    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aacc162-bab5-4d4f-92e8-22812cef76ea-openshift-state-metrics-tls podName:6aacc162-bab5-4d4f-92e8-22812cef76ea nodeName:}" failed. No retries permitted until 2026-07-28 08:07:50.270685219 +0000 UTC m=+305.457873340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6aacc162-bab5-4d4f-92e8-22812cef76ea-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-wjmzj" (UID: "6aacc162-bab5-4d4f-92e8-22812cef76ea") : secret "openshift-state-metrics-tls" not found
Jul 28 08:07:49.273279 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.273107    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-g9x5p" podStartSLOduration=1.882561059 podStartE2EDuration="22.2730867s" totalImagesPullingTime="20.390525641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:07:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:07:49.269548222 +0000 UTC m=+304.456736353" watchObservedRunningTime="2026-07-28 08:07:49.2730867 +0000 UTC m=+304.460274831"
Jul 28 08:07:49.279143 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.277913    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a979677e-ccd2-4a6a-8f73-33de147b511c-node-exporter-tls\") pod \"node-exporter-f9fh8\" (UID: \"a979677e-ccd2-4a6a-8f73-33de147b511c\") " pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:49.521370 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.519249    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f9fh8"
Jul 28 08:07:49.672139 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.670024    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 08:07:49.678860 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.678833    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.683267 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.683237    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 28 08:07:49.684721 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.683547    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 28 08:07:49.684721 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.683864    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 28 08:07:49.684721 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.683959    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 28 08:07:49.684721 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.684083    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 28 08:07:49.684721 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.684157    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 28 08:07:49.684721 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.684330    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 28 08:07:49.684721 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.684344    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nlwcs\""
Jul 28 08:07:49.684721 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.684508    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 28 08:07:49.684721 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.684578    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 28 08:07:49.694966 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.694924    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 08:07:49.774898 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.774813    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-web-config\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.774898 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.774865    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74ff06fa-1322-4638-a0fd-a46dc6029cde-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.775125 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.774917    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74ff06fa-1322-4638-a0fd-a46dc6029cde-tls-assets\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.775125 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.774940    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.775125 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.774984    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74ff06fa-1322-4638-a0fd-a46dc6029cde-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.775125 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.775016    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74ff06fa-1322-4638-a0fd-a46dc6029cde-config-out\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.775125 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.775034    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-config-volume\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.775125 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.775059    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.775125 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.775082    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5twzd\" (UniqueName: \"kubernetes.io/projected/74ff06fa-1322-4638-a0fd-a46dc6029cde-kube-api-access-5twzd\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.775125 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.775103    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74ff06fa-1322-4638-a0fd-a46dc6029cde-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.775125 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.775123    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.775525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.775138    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.775525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.775157    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.876643 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.875916    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-web-config\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.876643 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.875972    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74ff06fa-1322-4638-a0fd-a46dc6029cde-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.876643 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.876016    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74ff06fa-1322-4638-a0fd-a46dc6029cde-tls-assets\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.876643 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.876036    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.876643 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.876056    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74ff06fa-1322-4638-a0fd-a46dc6029cde-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.876643 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.876091    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74ff06fa-1322-4638-a0fd-a46dc6029cde-config-out\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.876643 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.876110    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-config-volume\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.876643 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.876134    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.876643 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.876166    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5twzd\" (UniqueName: \"kubernetes.io/projected/74ff06fa-1322-4638-a0fd-a46dc6029cde-kube-api-access-5twzd\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.876643 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.876190    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74ff06fa-1322-4638-a0fd-a46dc6029cde-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.876643 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.876207    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.876643 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.876222    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.876643 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.876250    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.885236 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.883204    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74ff06fa-1322-4638-a0fd-a46dc6029cde-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.885236 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.883692    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74ff06fa-1322-4638-a0fd-a46dc6029cde-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.886682 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.885911    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-web-config\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.886682 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.886281    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-config-volume\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.889474 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.889176    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74ff06fa-1322-4638-a0fd-a46dc6029cde-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.890966 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.890940    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.891328 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.891260    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74ff06fa-1322-4638-a0fd-a46dc6029cde-config-out\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.891497 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.891395    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.892219 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.892195    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.894004 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.893199    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.894004 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.893553    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74ff06fa-1322-4638-a0fd-a46dc6029cde-tls-assets\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.894004 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.893957    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.899057 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.899028    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5twzd\" (UniqueName: \"kubernetes.io/projected/74ff06fa-1322-4638-a0fd-a46dc6029cde-kube-api-access-5twzd\") pod \"alertmanager-main-0\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:49.994058 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:49.993975    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:07:50.037193 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:50.036270    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78b87f4567-ck6j9"]
Jul 28 08:07:50.045884 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:50.045562    2583 patch_prober.go:28] interesting pod/image-registry-78b87f4567-ck6j9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 08:07:50.045884 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:50.045626    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-78b87f4567-ck6j9" podUID="ed157823-a341-4114-a7ad-c3e9290cbcf5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 08:07:50.222072 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:50.222033    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 08:07:50.226824 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:07:50.226773    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74ff06fa_1322_4638_a0fd_a46dc6029cde.slice/crio-673cbd609ca48879dfa566b8736ca9bb0b90b750b1dd935fb29c0ae9d86ee345 WatchSource:0}: Error finding container 673cbd609ca48879dfa566b8736ca9bb0b90b750b1dd935fb29c0ae9d86ee345: Status 404 returned error can't find the container with id 673cbd609ca48879dfa566b8736ca9bb0b90b750b1dd935fb29c0ae9d86ee345
Jul 28 08:07:50.258830 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:50.258793    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74ff06fa-1322-4638-a0fd-a46dc6029cde","Type":"ContainerStarted","Data":"673cbd609ca48879dfa566b8736ca9bb0b90b750b1dd935fb29c0ae9d86ee345"}
Jul 28 08:07:50.260737 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:50.260705    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f9fh8" event={"ID":"a979677e-ccd2-4a6a-8f73-33de147b511c","Type":"ContainerStarted","Data":"948b690c7f8106dbc0f2ed9e134d4dd47fa4fc05b3947959dc1bad2c9cfbfc1c"}
Jul 28 08:07:50.280302 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:50.280266    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6aacc162-bab5-4d4f-92e8-22812cef76ea-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-wjmzj\" (UID: \"6aacc162-bab5-4d4f-92e8-22812cef76ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj"
Jul 28 08:07:50.285590 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:50.285561    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6aacc162-bab5-4d4f-92e8-22812cef76ea-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-wjmzj\" (UID: \"6aacc162-bab5-4d4f-92e8-22812cef76ea\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj"
Jul 28 08:07:50.384677 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:50.384639    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj"
Jul 28 08:07:50.592751 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:50.592710    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj"]
Jul 28 08:07:50.600267 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:07:50.600234    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aacc162_bab5_4d4f_92e8_22812cef76ea.slice/crio-62d2959f553aa15e90d7e01a3d12e3292e5a67b41e676e28e7f98f6e8eef51ab WatchSource:0}: Error finding container 62d2959f553aa15e90d7e01a3d12e3292e5a67b41e676e28e7f98f6e8eef51ab: Status 404 returned error can't find the container with id 62d2959f553aa15e90d7e01a3d12e3292e5a67b41e676e28e7f98f6e8eef51ab
Jul 28 08:07:51.266890 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:51.266848    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj" event={"ID":"6aacc162-bab5-4d4f-92e8-22812cef76ea","Type":"ContainerStarted","Data":"62d2959f553aa15e90d7e01a3d12e3292e5a67b41e676e28e7f98f6e8eef51ab"}
Jul 28 08:07:51.645131 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:51.645087    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-fbd8798f5-qcd29"]
Jul 28 08:07:51.772395 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:51.772356    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-fbd8798f5-qcd29"]
Jul 28 08:07:51.772613 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:51.772523    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:51.775571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:51.775428    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 28 08:07:51.775571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:51.775471    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3ju4ck6j07hpc\""
Jul 28 08:07:51.775776 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:51.775756    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 28 08:07:51.775986 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:51.775959    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 28 08:07:51.776193 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:51.776074    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 28 08:07:51.776955 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:51.775961    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-sjn8s\""
Jul 28 08:07:51.776955 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:51.776409    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 28 08:07:51.902640 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:51.902557    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh22m\" (UniqueName: \"kubernetes.io/projected/0495e4fd-9ea1-4182-b9e2-77594860160c-kube-api-access-wh22m\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:51.902640 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:51.902637    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0495e4fd-9ea1-4182-b9e2-77594860160c-secret-grpc-tls\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:51.902846 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:51.902663    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0495e4fd-9ea1-4182-b9e2-77594860160c-metrics-client-ca\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:51.902846 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:51.902691    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0495e4fd-9ea1-4182-b9e2-77594860160c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:51.902846 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:51.902718    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0495e4fd-9ea1-4182-b9e2-77594860160c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:51.902846 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:51.902734    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0495e4fd-9ea1-4182-b9e2-77594860160c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:51.902846 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:51.902767    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0495e4fd-9ea1-4182-b9e2-77594860160c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:51.902846 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:51.902804    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0495e4fd-9ea1-4182-b9e2-77594860160c-secret-thanos-querier-tls\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:52.003844 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:52.003806    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh22m\" (UniqueName: \"kubernetes.io/projected/0495e4fd-9ea1-4182-b9e2-77594860160c-kube-api-access-wh22m\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:52.004046 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:52.003894    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0495e4fd-9ea1-4182-b9e2-77594860160c-secret-grpc-tls\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:52.004046 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:52.003926    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0495e4fd-9ea1-4182-b9e2-77594860160c-metrics-client-ca\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:52.004046 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:52.003959    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0495e4fd-9ea1-4182-b9e2-77594860160c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:52.004046 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:52.003986    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0495e4fd-9ea1-4182-b9e2-77594860160c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:52.004046 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:52.004012    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0495e4fd-9ea1-4182-b9e2-77594860160c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:52.004335 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:52.004048    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0495e4fd-9ea1-4182-b9e2-77594860160c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:52.004335 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:52.004089    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0495e4fd-9ea1-4182-b9e2-77594860160c-secret-thanos-querier-tls\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:52.005841 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:52.005787    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0495e4fd-9ea1-4182-b9e2-77594860160c-metrics-client-ca\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:52.008492 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:52.008421    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0495e4fd-9ea1-4182-b9e2-77594860160c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:52.010236 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:52.010183    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0495e4fd-9ea1-4182-b9e2-77594860160c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:52.010351 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:52.010291    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0495e4fd-9ea1-4182-b9e2-77594860160c-secret-thanos-querier-tls\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:52.010497 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:52.010472    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0495e4fd-9ea1-4182-b9e2-77594860160c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:52.011095 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:52.011072    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0495e4fd-9ea1-4182-b9e2-77594860160c-secret-grpc-tls\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:52.013059 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:52.013030    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0495e4fd-9ea1-4182-b9e2-77594860160c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:52.013278 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:52.013252    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh22m\" (UniqueName: \"kubernetes.io/projected/0495e4fd-9ea1-4182-b9e2-77594860160c-kube-api-access-wh22m\") pod \"thanos-querier-fbd8798f5-qcd29\" (UID: \"0495e4fd-9ea1-4182-b9e2-77594860160c\") " pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:52.087488 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:52.087347    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:07:53.331781 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:53.329018    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:07:53.765175 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:53.765053    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-fbd8798f5-qcd29"]
Jul 28 08:07:53.779015 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:07:53.778984    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0495e4fd_9ea1_4182_b9e2_77594860160c.slice/crio-16566ed0230cae97f2f8babd77df16383ba6cd8c72316da8cd0fee40a867f755 WatchSource:0}: Error finding container 16566ed0230cae97f2f8babd77df16383ba6cd8c72316da8cd0fee40a867f755: Status 404 returned error can't find the container with id 16566ed0230cae97f2f8babd77df16383ba6cd8c72316da8cd0fee40a867f755
Jul 28 08:07:54.282020 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:54.281858    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29" event={"ID":"0495e4fd-9ea1-4182-b9e2-77594860160c","Type":"ContainerStarted","Data":"16566ed0230cae97f2f8babd77df16383ba6cd8c72316da8cd0fee40a867f755"}
Jul 28 08:07:54.284897 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:54.284853    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj" event={"ID":"6aacc162-bab5-4d4f-92e8-22812cef76ea","Type":"ContainerStarted","Data":"4e26a03f5242dd64ccf834abae1ce3e4f5089ec19bee3ace6c235cc9fe72ba2f"}
Jul 28 08:07:54.285179 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:54.284926    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj" event={"ID":"6aacc162-bab5-4d4f-92e8-22812cef76ea","Type":"ContainerStarted","Data":"82990c253df8ce4df76e3f21ac1683cc2f965c656fb319eba81e5cac081f2c0f"}
Jul 28 08:07:54.784547 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:54.784508    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cd69c557b-x4p5c"]
Jul 28 08:07:54.800948 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:54.800911    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:54.801189 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:54.801156    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cd69c557b-x4p5c"]
Jul 28 08:07:54.803328 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:54.803298    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 08:07:54.804078 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:54.804055    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 08:07:54.804199 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:54.804126    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 08:07:54.804318 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:54.804296    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2zwlv\""
Jul 28 08:07:54.805622 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:54.805600    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 08:07:54.805746 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:54.805727    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 08:07:54.810427 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:54.810406    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 28 08:07:54.932812 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:54.932781    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg6xd\" (UniqueName: \"kubernetes.io/projected/becf2df2-9333-4adb-aba6-d74566a50328-kube-api-access-kg6xd\") pod \"console-7cd69c557b-x4p5c\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") " pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:54.933008 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:54.932818    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/becf2df2-9333-4adb-aba6-d74566a50328-console-serving-cert\") pod \"console-7cd69c557b-x4p5c\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") " pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:54.933008 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:54.932840    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-console-config\") pod \"console-7cd69c557b-x4p5c\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") " pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:54.933008 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:54.932912    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-trusted-ca-bundle\") pod \"console-7cd69c557b-x4p5c\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") " pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:54.933008 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:54.932935    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-oauth-serving-cert\") pod \"console-7cd69c557b-x4p5c\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") " pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:54.933199 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:54.933013    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-service-ca\") pod \"console-7cd69c557b-x4p5c\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") " pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:54.933199 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:54.933113    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/becf2df2-9333-4adb-aba6-d74566a50328-console-oauth-config\") pod \"console-7cd69c557b-x4p5c\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") " pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:55.033813 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:55.033773    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-trusted-ca-bundle\") pod \"console-7cd69c557b-x4p5c\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") " pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:55.033813 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:55.033813    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-oauth-serving-cert\") pod \"console-7cd69c557b-x4p5c\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") " pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:55.034072 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:55.033851    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-service-ca\") pod \"console-7cd69c557b-x4p5c\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") " pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:55.034072 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:55.033994    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/becf2df2-9333-4adb-aba6-d74566a50328-console-oauth-config\") pod \"console-7cd69c557b-x4p5c\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") " pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:55.034187 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:55.034123    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg6xd\" (UniqueName: \"kubernetes.io/projected/becf2df2-9333-4adb-aba6-d74566a50328-kube-api-access-kg6xd\") pod \"console-7cd69c557b-x4p5c\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") " pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:55.034187 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:55.034177    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/becf2df2-9333-4adb-aba6-d74566a50328-console-serving-cert\") pod \"console-7cd69c557b-x4p5c\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") " pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:55.034297 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:55.034214    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-console-config\") pod \"console-7cd69c557b-x4p5c\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") " pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:55.034844 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:55.034775    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-service-ca\") pod \"console-7cd69c557b-x4p5c\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") " pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:55.034844 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:55.034782    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-oauth-serving-cert\") pod \"console-7cd69c557b-x4p5c\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") " pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:55.035014 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:55.034982    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-console-config\") pod \"console-7cd69c557b-x4p5c\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") " pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:55.035276 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:55.035249    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-trusted-ca-bundle\") pod \"console-7cd69c557b-x4p5c\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") " pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:55.037358 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:55.037335    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/becf2df2-9333-4adb-aba6-d74566a50328-console-oauth-config\") pod \"console-7cd69c557b-x4p5c\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") " pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:55.037549 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:55.037522    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/becf2df2-9333-4adb-aba6-d74566a50328-console-serving-cert\") pod \"console-7cd69c557b-x4p5c\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") " pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:55.042434 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:55.042414    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg6xd\" (UniqueName: \"kubernetes.io/projected/becf2df2-9333-4adb-aba6-d74566a50328-kube-api-access-kg6xd\") pod \"console-7cd69c557b-x4p5c\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") " pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:55.114973 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:55.114328    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:07:55.449438 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:55.449382    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cd69c557b-x4p5c"]
Jul 28 08:07:55.455004 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:07:55.454965    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbecf2df2_9333_4adb_aba6_d74566a50328.slice/crio-74860c00c8cf45ba08b75d85ca35ac84ec241184b77fc7047e3b30346cd198c3 WatchSource:0}: Error finding container 74860c00c8cf45ba08b75d85ca35ac84ec241184b77fc7047e3b30346cd198c3: Status 404 returned error can't find the container with id 74860c00c8cf45ba08b75d85ca35ac84ec241184b77fc7047e3b30346cd198c3
Jul 28 08:07:56.309957 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:56.309778    2583 generic.go:356] "Generic (PLEG): container finished" podID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerID="cda762bd450f3ed9278e57899c78b7dbcbccabe53e92f22e9eac11e9613baec7" exitCode=0
Jul 28 08:07:56.309957 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:56.309942    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74ff06fa-1322-4638-a0fd-a46dc6029cde","Type":"ContainerDied","Data":"cda762bd450f3ed9278e57899c78b7dbcbccabe53e92f22e9eac11e9613baec7"}
Jul 28 08:07:56.314115 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:56.313334    2583 generic.go:356] "Generic (PLEG): container finished" podID="a979677e-ccd2-4a6a-8f73-33de147b511c" containerID="99819ea861b68c935f05bf5a26c154432614b5877dce76ee74c032fbf5c63436" exitCode=0
Jul 28 08:07:56.314115 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:56.313996    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f9fh8" event={"ID":"a979677e-ccd2-4a6a-8f73-33de147b511c","Type":"ContainerDied","Data":"99819ea861b68c935f05bf5a26c154432614b5877dce76ee74c032fbf5c63436"}
Jul 28 08:07:56.317587 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:56.317248    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cd69c557b-x4p5c" event={"ID":"becf2df2-9333-4adb-aba6-d74566a50328","Type":"ContainerStarted","Data":"74860c00c8cf45ba08b75d85ca35ac84ec241184b77fc7047e3b30346cd198c3"}
Jul 28 08:07:56.321258 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:56.321123    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-747k4" event={"ID":"2e3105ee-0942-48f2-b7bf-751b948a1189","Type":"ContainerStarted","Data":"fffe34f017c387727386f44bb8b113530893c69beb91da765f371a06dd5758c1"}
Jul 28 08:07:57.335476 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:57.335411    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f9fh8" event={"ID":"a979677e-ccd2-4a6a-8f73-33de147b511c","Type":"ContainerStarted","Data":"8b996e808eccdaac87d1da58e4f995cf1111dcb98c192e7f1a23006b6ddc8aca"}
Jul 28 08:07:58.341742 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:58.341654    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f9fh8" event={"ID":"a979677e-ccd2-4a6a-8f73-33de147b511c","Type":"ContainerStarted","Data":"3b9ddb33a3cdddcb03cd8f58eb77d1752cf4c0a8993661f939cd77ef5d306757"}
Jul 28 08:07:58.347677 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:58.347586    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj" event={"ID":"6aacc162-bab5-4d4f-92e8-22812cef76ea","Type":"ContainerStarted","Data":"bf8482fd34d7ba8516b7fbaa7ac3f04c71f7594cfbf004e8cd3560866bf8cab4"}
Jul 28 08:07:58.351031 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:58.350849    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29" event={"ID":"0495e4fd-9ea1-4182-b9e2-77594860160c","Type":"ContainerStarted","Data":"645fb61500aac29f88fc9efd7867ab0ec71cf72e5c94abb18ad276dbda41aaa9"}
Jul 28 08:07:58.351031 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:58.350935    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29" event={"ID":"0495e4fd-9ea1-4182-b9e2-77594860160c","Type":"ContainerStarted","Data":"62562f346470d259f8a1d78e21e66c53c7992a2f419f6af0a8e8f4b5bb2875ed"}
Jul 28 08:07:58.351031 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:58.350976    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29" event={"ID":"0495e4fd-9ea1-4182-b9e2-77594860160c","Type":"ContainerStarted","Data":"c0e57e044c60373a3923043fc572a470f9257094d5a7020820ed0b3c3b75104c"}
Jul 28 08:07:58.368589 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:58.368119    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f9fh8" podStartSLOduration=4.533468539 podStartE2EDuration="10.368098882s" totalImagesPullingTime="5.717070595s" totalInitContainerRuntime="117.559748ms" isStatefulPod=true podCreationTimestamp="2026-07-28 08:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:07:58.366781239 +0000 UTC m=+313.553969371" watchObservedRunningTime="2026-07-28 08:07:58.368098882 +0000 UTC m=+313.555287013"
Jul 28 08:07:58.386694 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:07:58.386629    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wjmzj" podStartSLOduration=6.881523977 podStartE2EDuration="10.386605154s" totalImagesPullingTime="3.505081177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:07:58.384763317 +0000 UTC m=+313.571951448" watchObservedRunningTime="2026-07-28 08:07:58.386605154 +0000 UTC m=+313.573793288"
Jul 28 08:08:00.042896 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:00.042862    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:08:03.376985 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:03.376946    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cd69c557b-x4p5c" event={"ID":"becf2df2-9333-4adb-aba6-d74566a50328","Type":"ContainerStarted","Data":"279e13f43ed08e5652c2451707cbcfdd61979aae0e043cc80a3683f9418d5c82"}
Jul 28 08:08:03.379355 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:03.379321    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-747k4" event={"ID":"2e3105ee-0942-48f2-b7bf-751b948a1189","Type":"ContainerStarted","Data":"7f39263f8181a8129085bc9fe46fb10a6e2063d8e60128313e038d996347460a"}
Jul 28 08:08:03.382938 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:03.382904    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74ff06fa-1322-4638-a0fd-a46dc6029cde","Type":"ContainerStarted","Data":"fec6bcac707edf7b8204c359d0f9c01c8193a8558fb37da33670de71969b4ecb"}
Jul 28 08:08:03.383066 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:03.382968    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74ff06fa-1322-4638-a0fd-a46dc6029cde","Type":"ContainerStarted","Data":"51720289a2872dafb8dca781a0c8331a2bf2408b617c01e3cf4ecd80a91d208d"}
Jul 28 08:08:03.383066 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:03.382996    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74ff06fa-1322-4638-a0fd-a46dc6029cde","Type":"ContainerStarted","Data":"7736eacaf0fd9f0bb7b8d91132d6478095cb4f3ea3d3a3914e3af66a7d8e49b3"}
Jul 28 08:08:03.383066 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:03.383021    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74ff06fa-1322-4638-a0fd-a46dc6029cde","Type":"ContainerStarted","Data":"1c9bdb33a69877cb52b6b720a5ec61f0e76bdaea2d485eb1f957b4dd72bf2541"}
Jul 28 08:08:03.383066 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:03.383043    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74ff06fa-1322-4638-a0fd-a46dc6029cde","Type":"ContainerStarted","Data":"5c3f4a7cfb6ae76b5538caaff5f6b013137d6dd4ecef59bc9221c91f7a65285a"}
Jul 28 08:08:03.394081 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:03.394022    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cd69c557b-x4p5c" podStartSLOduration=2.185837357 podStartE2EDuration="9.394001125s" totalImagesPullingTime="7.208163768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:08:03.393220653 +0000 UTC m=+318.580408794" watchObservedRunningTime="2026-07-28 08:08:03.394001125 +0000 UTC m=+318.581189289"
Jul 28 08:08:03.412263 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:03.412213    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-747k4" podStartSLOduration=33.907719714 podStartE2EDuration="59.412193088s" totalImagesPullingTime="25.504473374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 08:07:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:08:03.411170107 +0000 UTC m=+318.598358240" watchObservedRunningTime="2026-07-28 08:08:03.412193088 +0000 UTC m=+318.599381219"
Jul 28 08:08:04.396869 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:04.396765    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74ff06fa-1322-4638-a0fd-a46dc6029cde","Type":"ContainerStarted","Data":"0fb73fb9611141d19de898397d5d27f673a0eb2fe01cf7e1d948734e060b15e1"}
Jul 28 08:08:04.399516 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:04.399485    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29" event={"ID":"0495e4fd-9ea1-4182-b9e2-77594860160c","Type":"ContainerStarted","Data":"24f16326b29593bd3a0495702ebe41c10540fba27c5af1d4dc3f73f881293d8c"}
Jul 28 08:08:04.399656 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:04.399564    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29" event={"ID":"0495e4fd-9ea1-4182-b9e2-77594860160c","Type":"ContainerStarted","Data":"7516760a94ba6f99e27e60bf75e0eb54b1661d31c7c30375165ddc54c94b74e9"}
Jul 28 08:08:04.399935 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:04.399915    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:08:04.400011 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:04.399977    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29" event={"ID":"0495e4fd-9ea1-4182-b9e2-77594860160c","Type":"ContainerStarted","Data":"d0c5c10ba34c562cf2776cd542e2c1d9a33f5eccb249621a65a0d7d6ff4fcabf"}
Jul 28 08:08:04.405392 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:04.405372    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29"
Jul 28 08:08:04.429641 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:04.429595    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.224129289 podStartE2EDuration="15.429579775s" totalImagesPullingTime="12.187349894s" totalInitContainerRuntime="18.100592ms" isStatefulPod=false podCreationTimestamp="2026-07-28 08:07:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:08:04.427943983 +0000 UTC m=+319.615132138" watchObservedRunningTime="2026-07-28 08:08:04.429579775 +0000 UTC m=+319.616767906"
Jul 28 08:08:04.451269 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:04.451212    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-fbd8798f5-qcd29" podStartSLOduration=3.806660521 podStartE2EDuration="13.451196348s" totalImagesPullingTime="9.644535827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:07:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:08:04.449542579 +0000 UTC m=+319.636730709" watchObservedRunningTime="2026-07-28 08:08:04.451196348 +0000 UTC m=+319.638384480"
Jul 28 08:08:05.114772 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:05.114733    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:08:05.115026 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:05.114790    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:08:05.119611 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:05.119579    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:08:05.407516 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:05.407490    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:08:14.655440 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:14.655411    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bffhp_f9498a46-5dad-42a4-908a-eadc84f02430/dns/0.log"
Jul 28 08:08:14.665169 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:14.665143    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bffhp_f9498a46-5dad-42a4-908a-eadc84f02430/kube-rbac-proxy/0.log"
Jul 28 08:08:14.745912 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:14.745881    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-22gll_42846769-0c19-40cb-936c-0c8f3d7db4c5/dns-node-resolver/0.log"
Jul 28 08:08:15.074542 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.074458    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-78b87f4567-ck6j9" podUID="ed157823-a341-4114-a7ad-c3e9290cbcf5" containerName="registry" containerID="cri-o://01d80f0e7118ec7b73b8360184f2b0de4eccf1beb6cd10c52403f2ece524255c" gracePeriod=30
Jul 28 08:08:15.356386 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.356359    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:08:15.442105 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.442067    2583 generic.go:356] "Generic (PLEG): container finished" podID="ed157823-a341-4114-a7ad-c3e9290cbcf5" containerID="01d80f0e7118ec7b73b8360184f2b0de4eccf1beb6cd10c52403f2ece524255c" exitCode=0
Jul 28 08:08:15.442264 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.442120    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b87f4567-ck6j9"
Jul 28 08:08:15.442264 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.442152    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b87f4567-ck6j9" event={"ID":"ed157823-a341-4114-a7ad-c3e9290cbcf5","Type":"ContainerDied","Data":"01d80f0e7118ec7b73b8360184f2b0de4eccf1beb6cd10c52403f2ece524255c"}
Jul 28 08:08:15.442264 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.442206    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b87f4567-ck6j9" event={"ID":"ed157823-a341-4114-a7ad-c3e9290cbcf5","Type":"ContainerDied","Data":"a2edb6d84dcab8e56768421b0d31ed3e39ef8e5fe7b68660f85cd0babbe85d48"}
Jul 28 08:08:15.442264 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.442228    2583 scope.go:117] "RemoveContainer" containerID="01d80f0e7118ec7b73b8360184f2b0de4eccf1beb6cd10c52403f2ece524255c"
Jul 28 08:08:15.450711 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.450695    2583 scope.go:117] "RemoveContainer" containerID="01d80f0e7118ec7b73b8360184f2b0de4eccf1beb6cd10c52403f2ece524255c"
Jul 28 08:08:15.450997 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:08:15.450965    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01d80f0e7118ec7b73b8360184f2b0de4eccf1beb6cd10c52403f2ece524255c\": container with ID starting with 01d80f0e7118ec7b73b8360184f2b0de4eccf1beb6cd10c52403f2ece524255c not found: ID does not exist" containerID="01d80f0e7118ec7b73b8360184f2b0de4eccf1beb6cd10c52403f2ece524255c"
Jul 28 08:08:15.451070 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.451006    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d80f0e7118ec7b73b8360184f2b0de4eccf1beb6cd10c52403f2ece524255c"} err="failed to get container status \"01d80f0e7118ec7b73b8360184f2b0de4eccf1beb6cd10c52403f2ece524255c\": rpc error: code = NotFound desc = could not find container \"01d80f0e7118ec7b73b8360184f2b0de4eccf1beb6cd10c52403f2ece524255c\": container with ID starting with 01d80f0e7118ec7b73b8360184f2b0de4eccf1beb6cd10c52403f2ece524255c not found: ID does not exist"
Jul 28 08:08:15.539471 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.539419    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ed157823-a341-4114-a7ad-c3e9290cbcf5-installation-pull-secrets\") pod \"ed157823-a341-4114-a7ad-c3e9290cbcf5\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") "
Jul 28 08:08:15.539654 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.539497    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ed157823-a341-4114-a7ad-c3e9290cbcf5-image-registry-private-configuration\") pod \"ed157823-a341-4114-a7ad-c3e9290cbcf5\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") "
Jul 28 08:08:15.539654 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.539518    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls\") pod \"ed157823-a341-4114-a7ad-c3e9290cbcf5\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") "
Jul 28 08:08:15.539654 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.539536    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ed157823-a341-4114-a7ad-c3e9290cbcf5-trusted-ca\") pod \"ed157823-a341-4114-a7ad-c3e9290cbcf5\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") "
Jul 28 08:08:15.539654 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.539561    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-certificates\") pod \"ed157823-a341-4114-a7ad-c3e9290cbcf5\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") "
Jul 28 08:08:15.539654 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.539597    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-bound-sa-token\") pod \"ed157823-a341-4114-a7ad-c3e9290cbcf5\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") "
Jul 28 08:08:15.539654 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.539627    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ed157823-a341-4114-a7ad-c3e9290cbcf5-ca-trust-extracted\") pod \"ed157823-a341-4114-a7ad-c3e9290cbcf5\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") "
Jul 28 08:08:15.539949 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.539662    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntbns\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-kube-api-access-ntbns\") pod \"ed157823-a341-4114-a7ad-c3e9290cbcf5\" (UID: \"ed157823-a341-4114-a7ad-c3e9290cbcf5\") "
Jul 28 08:08:15.540176 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.540135    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed157823-a341-4114-a7ad-c3e9290cbcf5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ed157823-a341-4114-a7ad-c3e9290cbcf5" (UID: "ed157823-a341-4114-a7ad-c3e9290cbcf5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 08:08:15.540316 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.540193    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ed157823-a341-4114-a7ad-c3e9290cbcf5" (UID: "ed157823-a341-4114-a7ad-c3e9290cbcf5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 08:08:15.542558 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.542526    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed157823-a341-4114-a7ad-c3e9290cbcf5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ed157823-a341-4114-a7ad-c3e9290cbcf5" (UID: "ed157823-a341-4114-a7ad-c3e9290cbcf5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:08:15.542558 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.542555    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ed157823-a341-4114-a7ad-c3e9290cbcf5" (UID: "ed157823-a341-4114-a7ad-c3e9290cbcf5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:08:15.542719 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.542565    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ed157823-a341-4114-a7ad-c3e9290cbcf5" (UID: "ed157823-a341-4114-a7ad-c3e9290cbcf5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:08:15.542790 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.542723    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-kube-api-access-ntbns" (OuterVolumeSpecName: "kube-api-access-ntbns") pod "ed157823-a341-4114-a7ad-c3e9290cbcf5" (UID: "ed157823-a341-4114-a7ad-c3e9290cbcf5"). InnerVolumeSpecName "kube-api-access-ntbns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:08:15.543099 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.543076    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed157823-a341-4114-a7ad-c3e9290cbcf5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ed157823-a341-4114-a7ad-c3e9290cbcf5" (UID: "ed157823-a341-4114-a7ad-c3e9290cbcf5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:08:15.548259 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.548234    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed157823-a341-4114-a7ad-c3e9290cbcf5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ed157823-a341-4114-a7ad-c3e9290cbcf5" (UID: "ed157823-a341-4114-a7ad-c3e9290cbcf5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 08:08:15.640316 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.640282    2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ed157823-a341-4114-a7ad-c3e9290cbcf5-image-registry-private-configuration\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:08:15.640316 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.640313    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:08:15.640316 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.640322    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ed157823-a341-4114-a7ad-c3e9290cbcf5-trusted-ca\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:08:15.640574 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.640331    2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ed157823-a341-4114-a7ad-c3e9290cbcf5-registry-certificates\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:08:15.640574 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.640340    2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-bound-sa-token\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:08:15.640574 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.640350    2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ed157823-a341-4114-a7ad-c3e9290cbcf5-ca-trust-extracted\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:08:15.640574 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.640357    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntbns\" (UniqueName: \"kubernetes.io/projected/ed157823-a341-4114-a7ad-c3e9290cbcf5-kube-api-access-ntbns\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:08:15.640574 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.640365    2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ed157823-a341-4114-a7ad-c3e9290cbcf5-installation-pull-secrets\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:08:15.765098 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.765066    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78b87f4567-ck6j9"]
Jul 28 08:08:15.772028 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:15.772001    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78b87f4567-ck6j9"]
Jul 28 08:08:17.333658 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:17.333622    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed157823-a341-4114-a7ad-c3e9290cbcf5" path="/var/lib/kubelet/pods/ed157823-a341-4114-a7ad-c3e9290cbcf5/volumes"
Jul 28 08:08:24.484420 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:24.484379    2583 generic.go:356] "Generic (PLEG): container finished" podID="a460ccbd-d2f1-4f6f-ab12-5306cec5d28d" containerID="685b7dd43b7c96766d0ae3eaa4935e8bf83e3272de05def5c9e5e647180a5c6b" exitCode=0
Jul 28 08:08:24.484878 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:24.484470    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9tqt" event={"ID":"a460ccbd-d2f1-4f6f-ab12-5306cec5d28d","Type":"ContainerDied","Data":"685b7dd43b7c96766d0ae3eaa4935e8bf83e3272de05def5c9e5e647180a5c6b"}
Jul 28 08:08:24.484878 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:24.484833    2583 scope.go:117] "RemoveContainer" containerID="685b7dd43b7c96766d0ae3eaa4935e8bf83e3272de05def5c9e5e647180a5c6b"
Jul 28 08:08:25.491065 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:25.491033    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-k9tqt" event={"ID":"a460ccbd-d2f1-4f6f-ab12-5306cec5d28d","Type":"ContainerStarted","Data":"939d208d5524f9a1e82012ceb221404e84676e0a04c3621bda4fd44584c53bce"}
Jul 28 08:08:59.219708 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:59.219667    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs\") pod \"network-metrics-daemon-xphvp\" (UID: \"eb7a2f95-8714-4283-8dcf-66f1fb75b4e4\") " pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:08:59.222227 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:59.222201    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb7a2f95-8714-4283-8dcf-66f1fb75b4e4-metrics-certs\") pod \"network-metrics-daemon-xphvp\" (UID: \"eb7a2f95-8714-4283-8dcf-66f1fb75b4e4\") " pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:08:59.332205 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:59.332177    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kk5fx\""
Jul 28 08:08:59.340224 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:59.340202    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xphvp"
Jul 28 08:08:59.472927 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:59.472898    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xphvp"]
Jul 28 08:08:59.475321 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:08:59.475293    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb7a2f95_8714_4283_8dcf_66f1fb75b4e4.slice/crio-67d9def076d119ad864f0b0f68a0b2d2cc7a8244afe385238caea95ca60bb5a4 WatchSource:0}: Error finding container 67d9def076d119ad864f0b0f68a0b2d2cc7a8244afe385238caea95ca60bb5a4: Status 404 returned error can't find the container with id 67d9def076d119ad864f0b0f68a0b2d2cc7a8244afe385238caea95ca60bb5a4
Jul 28 08:08:59.624897 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:08:59.624864    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xphvp" event={"ID":"eb7a2f95-8714-4283-8dcf-66f1fb75b4e4","Type":"ContainerStarted","Data":"67d9def076d119ad864f0b0f68a0b2d2cc7a8244afe385238caea95ca60bb5a4"}
Jul 28 08:09:00.630917 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:00.630879    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xphvp" event={"ID":"eb7a2f95-8714-4283-8dcf-66f1fb75b4e4","Type":"ContainerStarted","Data":"db4de914aac9875c2b28ec1e079f5f0fc84957040981087e7183795a001b355e"}
Jul 28 08:09:00.631270 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:00.630945    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xphvp" event={"ID":"eb7a2f95-8714-4283-8dcf-66f1fb75b4e4","Type":"ContainerStarted","Data":"169c7da4cac2697a1da470ceb10a4e462d9e755146b65ac9b51142f8426ceb8d"}
Jul 28 08:09:00.648495 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:00.648428    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xphvp" podStartSLOduration=373.678878447 podStartE2EDuration="6m14.648413304s" totalImagesPullingTime="969.534857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:09:00.647427505 +0000 UTC m=+375.834615636" watchObservedRunningTime="2026-07-28 08:09:00.648413304 +0000 UTC m=+375.835601433"
Jul 28 08:09:08.939910 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:08.939872    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 08:09:08.940414 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:08.940170    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="alertmanager" containerID="cri-o://5c3f4a7cfb6ae76b5538caaff5f6b013137d6dd4ecef59bc9221c91f7a65285a" gracePeriod=120
Jul 28 08:09:08.940414 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:08.940245    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="kube-rbac-proxy-metric" containerID="cri-o://fec6bcac707edf7b8204c359d0f9c01c8193a8558fb37da33670de71969b4ecb" gracePeriod=120
Jul 28 08:09:08.940414 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:08.940265    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="kube-rbac-proxy-web" containerID="cri-o://7736eacaf0fd9f0bb7b8d91132d6478095cb4f3ea3d3a3914e3af66a7d8e49b3" gracePeriod=120
Jul 28 08:09:08.940414 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:08.940274    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="config-reloader" containerID="cri-o://1c9bdb33a69877cb52b6b720a5ec61f0e76bdaea2d485eb1f957b4dd72bf2541" gracePeriod=120
Jul 28 08:09:08.940414 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:08.940322    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="kube-rbac-proxy" containerID="cri-o://51720289a2872dafb8dca781a0c8331a2bf2408b617c01e3cf4ecd80a91d208d" gracePeriod=120
Jul 28 08:09:08.940414 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:08.940327    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="prom-label-proxy" containerID="cri-o://0fb73fb9611141d19de898397d5d27f673a0eb2fe01cf7e1d948734e060b15e1" gracePeriod=120
Jul 28 08:09:09.668767 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:09.668736    2583 generic.go:356] "Generic (PLEG): container finished" podID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerID="0fb73fb9611141d19de898397d5d27f673a0eb2fe01cf7e1d948734e060b15e1" exitCode=0
Jul 28 08:09:09.668767 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:09.668760    2583 generic.go:356] "Generic (PLEG): container finished" podID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerID="51720289a2872dafb8dca781a0c8331a2bf2408b617c01e3cf4ecd80a91d208d" exitCode=0
Jul 28 08:09:09.668767 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:09.668767    2583 generic.go:356] "Generic (PLEG): container finished" podID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerID="1c9bdb33a69877cb52b6b720a5ec61f0e76bdaea2d485eb1f957b4dd72bf2541" exitCode=0
Jul 28 08:09:09.668767 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:09.668772    2583 generic.go:356] "Generic (PLEG): container finished" podID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerID="5c3f4a7cfb6ae76b5538caaff5f6b013137d6dd4ecef59bc9221c91f7a65285a" exitCode=0
Jul 28 08:09:09.669034 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:09.668802    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74ff06fa-1322-4638-a0fd-a46dc6029cde","Type":"ContainerDied","Data":"0fb73fb9611141d19de898397d5d27f673a0eb2fe01cf7e1d948734e060b15e1"}
Jul 28 08:09:09.669034 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:09.668853    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74ff06fa-1322-4638-a0fd-a46dc6029cde","Type":"ContainerDied","Data":"51720289a2872dafb8dca781a0c8331a2bf2408b617c01e3cf4ecd80a91d208d"}
Jul 28 08:09:09.669034 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:09.668878    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74ff06fa-1322-4638-a0fd-a46dc6029cde","Type":"ContainerDied","Data":"1c9bdb33a69877cb52b6b720a5ec61f0e76bdaea2d485eb1f957b4dd72bf2541"}
Jul 28 08:09:09.669034 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:09.668901    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74ff06fa-1322-4638-a0fd-a46dc6029cde","Type":"ContainerDied","Data":"5c3f4a7cfb6ae76b5538caaff5f6b013137d6dd4ecef59bc9221c91f7a65285a"}
Jul 28 08:09:10.186948 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.186924    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.200730 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.200704    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-config-volume\") pod \"74ff06fa-1322-4638-a0fd-a46dc6029cde\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") "
Jul 28 08:09:10.200808 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.200762    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-kube-rbac-proxy\") pod \"74ff06fa-1322-4638-a0fd-a46dc6029cde\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") "
Jul 28 08:09:10.200852 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.200810    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-cluster-tls-config\") pod \"74ff06fa-1322-4638-a0fd-a46dc6029cde\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") "
Jul 28 08:09:10.200852 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.200843    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5twzd\" (UniqueName: \"kubernetes.io/projected/74ff06fa-1322-4638-a0fd-a46dc6029cde-kube-api-access-5twzd\") pod \"74ff06fa-1322-4638-a0fd-a46dc6029cde\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") "
Jul 28 08:09:10.200983 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.200873    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74ff06fa-1322-4638-a0fd-a46dc6029cde-alertmanager-main-db\") pod \"74ff06fa-1322-4638-a0fd-a46dc6029cde\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") "
Jul 28 08:09:10.200983 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.200903    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-main-tls\") pod \"74ff06fa-1322-4638-a0fd-a46dc6029cde\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") "
Jul 28 08:09:10.201289 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.201242    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74ff06fa-1322-4638-a0fd-a46dc6029cde-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "74ff06fa-1322-4638-a0fd-a46dc6029cde" (UID: "74ff06fa-1322-4638-a0fd-a46dc6029cde"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 08:09:10.203410 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.203375    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "74ff06fa-1322-4638-a0fd-a46dc6029cde" (UID: "74ff06fa-1322-4638-a0fd-a46dc6029cde"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:09:10.203579 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.203559    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-config-volume" (OuterVolumeSpecName: "config-volume") pod "74ff06fa-1322-4638-a0fd-a46dc6029cde" (UID: "74ff06fa-1322-4638-a0fd-a46dc6029cde"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:09:10.203650 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.203618    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "74ff06fa-1322-4638-a0fd-a46dc6029cde" (UID: "74ff06fa-1322-4638-a0fd-a46dc6029cde"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:09:10.203834 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.203818    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74ff06fa-1322-4638-a0fd-a46dc6029cde-kube-api-access-5twzd" (OuterVolumeSpecName: "kube-api-access-5twzd") pod "74ff06fa-1322-4638-a0fd-a46dc6029cde" (UID: "74ff06fa-1322-4638-a0fd-a46dc6029cde"). InnerVolumeSpecName "kube-api-access-5twzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:09:10.208005 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.207852    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "74ff06fa-1322-4638-a0fd-a46dc6029cde" (UID: "74ff06fa-1322-4638-a0fd-a46dc6029cde"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:09:10.301485 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.301375    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-kube-rbac-proxy-web\") pod \"74ff06fa-1322-4638-a0fd-a46dc6029cde\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") "
Jul 28 08:09:10.301485 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.301413    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74ff06fa-1322-4638-a0fd-a46dc6029cde-alertmanager-trusted-ca-bundle\") pod \"74ff06fa-1322-4638-a0fd-a46dc6029cde\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") "
Jul 28 08:09:10.301485 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.301431    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74ff06fa-1322-4638-a0fd-a46dc6029cde-metrics-client-ca\") pod \"74ff06fa-1322-4638-a0fd-a46dc6029cde\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") "
Jul 28 08:09:10.301485 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.301476    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74ff06fa-1322-4638-a0fd-a46dc6029cde-config-out\") pod \"74ff06fa-1322-4638-a0fd-a46dc6029cde\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") "
Jul 28 08:09:10.301803 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.301504    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-kube-rbac-proxy-metric\") pod \"74ff06fa-1322-4638-a0fd-a46dc6029cde\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") "
Jul 28 08:09:10.301803 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.301532    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-web-config\") pod \"74ff06fa-1322-4638-a0fd-a46dc6029cde\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") "
Jul 28 08:09:10.301803 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.301558    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74ff06fa-1322-4638-a0fd-a46dc6029cde-tls-assets\") pod \"74ff06fa-1322-4638-a0fd-a46dc6029cde\" (UID: \"74ff06fa-1322-4638-a0fd-a46dc6029cde\") "
Jul 28 08:09:10.301803 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.301768    2583 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-config-volume\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:09:10.301803 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.301786    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:09:10.301803 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.301802    2583 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-cluster-tls-config\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:09:10.302106 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.301795    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74ff06fa-1322-4638-a0fd-a46dc6029cde-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "74ff06fa-1322-4638-a0fd-a46dc6029cde" (UID: "74ff06fa-1322-4638-a0fd-a46dc6029cde"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 08:09:10.302106 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.301816    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5twzd\" (UniqueName: \"kubernetes.io/projected/74ff06fa-1322-4638-a0fd-a46dc6029cde-kube-api-access-5twzd\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:09:10.302106 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.301831    2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74ff06fa-1322-4638-a0fd-a46dc6029cde-alertmanager-main-db\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:09:10.302106 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.301853    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-main-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:09:10.302106 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.302056    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74ff06fa-1322-4638-a0fd-a46dc6029cde-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "74ff06fa-1322-4638-a0fd-a46dc6029cde" (UID: "74ff06fa-1322-4638-a0fd-a46dc6029cde"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 08:09:10.303928 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.303902    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "74ff06fa-1322-4638-a0fd-a46dc6029cde" (UID: "74ff06fa-1322-4638-a0fd-a46dc6029cde"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:09:10.304239 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.304218    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "74ff06fa-1322-4638-a0fd-a46dc6029cde" (UID: "74ff06fa-1322-4638-a0fd-a46dc6029cde"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:09:10.304361 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.304341    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74ff06fa-1322-4638-a0fd-a46dc6029cde-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "74ff06fa-1322-4638-a0fd-a46dc6029cde" (UID: "74ff06fa-1322-4638-a0fd-a46dc6029cde"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:09:10.304419 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.304357    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74ff06fa-1322-4638-a0fd-a46dc6029cde-config-out" (OuterVolumeSpecName: "config-out") pod "74ff06fa-1322-4638-a0fd-a46dc6029cde" (UID: "74ff06fa-1322-4638-a0fd-a46dc6029cde"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 08:09:10.314668 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.314642    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-web-config" (OuterVolumeSpecName: "web-config") pod "74ff06fa-1322-4638-a0fd-a46dc6029cde" (UID: "74ff06fa-1322-4638-a0fd-a46dc6029cde"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:09:10.402715 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.402487    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:09:10.402715 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.402522    2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74ff06fa-1322-4638-a0fd-a46dc6029cde-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:09:10.402715 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.402538    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74ff06fa-1322-4638-a0fd-a46dc6029cde-metrics-client-ca\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:09:10.402715 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.402550    2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74ff06fa-1322-4638-a0fd-a46dc6029cde-config-out\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:09:10.402715 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.402565    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:09:10.402715 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.402579    2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74ff06fa-1322-4638-a0fd-a46dc6029cde-web-config\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:09:10.402715 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.402592    2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74ff06fa-1322-4638-a0fd-a46dc6029cde-tls-assets\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:09:10.676379 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.676346    2583 generic.go:356] "Generic (PLEG): container finished" podID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerID="fec6bcac707edf7b8204c359d0f9c01c8193a8558fb37da33670de71969b4ecb" exitCode=0
Jul 28 08:09:10.676379 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.676378    2583 generic.go:356] "Generic (PLEG): container finished" podID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerID="7736eacaf0fd9f0bb7b8d91132d6478095cb4f3ea3d3a3914e3af66a7d8e49b3" exitCode=0
Jul 28 08:09:10.676620 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.676429    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.676620 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.676430    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74ff06fa-1322-4638-a0fd-a46dc6029cde","Type":"ContainerDied","Data":"fec6bcac707edf7b8204c359d0f9c01c8193a8558fb37da33670de71969b4ecb"}
Jul 28 08:09:10.676620 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.676535    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74ff06fa-1322-4638-a0fd-a46dc6029cde","Type":"ContainerDied","Data":"7736eacaf0fd9f0bb7b8d91132d6478095cb4f3ea3d3a3914e3af66a7d8e49b3"}
Jul 28 08:09:10.676620 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.676576    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74ff06fa-1322-4638-a0fd-a46dc6029cde","Type":"ContainerDied","Data":"673cbd609ca48879dfa566b8736ca9bb0b90b750b1dd935fb29c0ae9d86ee345"}
Jul 28 08:09:10.676620 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.676604    2583 scope.go:117] "RemoveContainer" containerID="0fb73fb9611141d19de898397d5d27f673a0eb2fe01cf7e1d948734e060b15e1"
Jul 28 08:09:10.685325 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.685304    2583 scope.go:117] "RemoveContainer" containerID="fec6bcac707edf7b8204c359d0f9c01c8193a8558fb37da33670de71969b4ecb"
Jul 28 08:09:10.692481 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.692465    2583 scope.go:117] "RemoveContainer" containerID="51720289a2872dafb8dca781a0c8331a2bf2408b617c01e3cf4ecd80a91d208d"
Jul 28 08:09:10.699548 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.699529    2583 scope.go:117] "RemoveContainer" containerID="7736eacaf0fd9f0bb7b8d91132d6478095cb4f3ea3d3a3914e3af66a7d8e49b3"
Jul 28 08:09:10.707535 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.707513    2583 scope.go:117] "RemoveContainer" containerID="1c9bdb33a69877cb52b6b720a5ec61f0e76bdaea2d485eb1f957b4dd72bf2541"
Jul 28 08:09:10.715033 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.715016    2583 scope.go:117] "RemoveContainer" containerID="5c3f4a7cfb6ae76b5538caaff5f6b013137d6dd4ecef59bc9221c91f7a65285a"
Jul 28 08:09:10.719084 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.719061    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 08:09:10.722735 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.722721    2583 scope.go:117] "RemoveContainer" containerID="cda762bd450f3ed9278e57899c78b7dbcbccabe53e92f22e9eac11e9613baec7"
Jul 28 08:09:10.729656 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.729634    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 08:09:10.730876 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.730856    2583 scope.go:117] "RemoveContainer" containerID="0fb73fb9611141d19de898397d5d27f673a0eb2fe01cf7e1d948734e060b15e1"
Jul 28 08:09:10.731123 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:09:10.731104    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fb73fb9611141d19de898397d5d27f673a0eb2fe01cf7e1d948734e060b15e1\": container with ID starting with 0fb73fb9611141d19de898397d5d27f673a0eb2fe01cf7e1d948734e060b15e1 not found: ID does not exist" containerID="0fb73fb9611141d19de898397d5d27f673a0eb2fe01cf7e1d948734e060b15e1"
Jul 28 08:09:10.731166 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.731133    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fb73fb9611141d19de898397d5d27f673a0eb2fe01cf7e1d948734e060b15e1"} err="failed to get container status \"0fb73fb9611141d19de898397d5d27f673a0eb2fe01cf7e1d948734e060b15e1\": rpc error: code = NotFound desc = could not find container \"0fb73fb9611141d19de898397d5d27f673a0eb2fe01cf7e1d948734e060b15e1\": container with ID starting with 0fb73fb9611141d19de898397d5d27f673a0eb2fe01cf7e1d948734e060b15e1 not found: ID does not exist"
Jul 28 08:09:10.731166 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.731153    2583 scope.go:117] "RemoveContainer" containerID="fec6bcac707edf7b8204c359d0f9c01c8193a8558fb37da33670de71969b4ecb"
Jul 28 08:09:10.731356 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:09:10.731338    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fec6bcac707edf7b8204c359d0f9c01c8193a8558fb37da33670de71969b4ecb\": container with ID starting with fec6bcac707edf7b8204c359d0f9c01c8193a8558fb37da33670de71969b4ecb not found: ID does not exist" containerID="fec6bcac707edf7b8204c359d0f9c01c8193a8558fb37da33670de71969b4ecb"
Jul 28 08:09:10.731435 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.731357    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fec6bcac707edf7b8204c359d0f9c01c8193a8558fb37da33670de71969b4ecb"} err="failed to get container status \"fec6bcac707edf7b8204c359d0f9c01c8193a8558fb37da33670de71969b4ecb\": rpc error: code = NotFound desc = could not find container \"fec6bcac707edf7b8204c359d0f9c01c8193a8558fb37da33670de71969b4ecb\": container with ID starting with fec6bcac707edf7b8204c359d0f9c01c8193a8558fb37da33670de71969b4ecb not found: ID does not exist"
Jul 28 08:09:10.731435 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.731370    2583 scope.go:117] "RemoveContainer" containerID="51720289a2872dafb8dca781a0c8331a2bf2408b617c01e3cf4ecd80a91d208d"
Jul 28 08:09:10.731651 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:09:10.731634    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51720289a2872dafb8dca781a0c8331a2bf2408b617c01e3cf4ecd80a91d208d\": container with ID starting with 51720289a2872dafb8dca781a0c8331a2bf2408b617c01e3cf4ecd80a91d208d not found: ID does not exist" containerID="51720289a2872dafb8dca781a0c8331a2bf2408b617c01e3cf4ecd80a91d208d"
Jul 28 08:09:10.731693 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.731657    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51720289a2872dafb8dca781a0c8331a2bf2408b617c01e3cf4ecd80a91d208d"} err="failed to get container status \"51720289a2872dafb8dca781a0c8331a2bf2408b617c01e3cf4ecd80a91d208d\": rpc error: code = NotFound desc = could not find container \"51720289a2872dafb8dca781a0c8331a2bf2408b617c01e3cf4ecd80a91d208d\": container with ID starting with 51720289a2872dafb8dca781a0c8331a2bf2408b617c01e3cf4ecd80a91d208d not found: ID does not exist"
Jul 28 08:09:10.731693 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.731673    2583 scope.go:117] "RemoveContainer" containerID="7736eacaf0fd9f0bb7b8d91132d6478095cb4f3ea3d3a3914e3af66a7d8e49b3"
Jul 28 08:09:10.731908 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:09:10.731889    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7736eacaf0fd9f0bb7b8d91132d6478095cb4f3ea3d3a3914e3af66a7d8e49b3\": container with ID starting with 7736eacaf0fd9f0bb7b8d91132d6478095cb4f3ea3d3a3914e3af66a7d8e49b3 not found: ID does not exist" containerID="7736eacaf0fd9f0bb7b8d91132d6478095cb4f3ea3d3a3914e3af66a7d8e49b3"
Jul 28 08:09:10.731962 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.731913    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7736eacaf0fd9f0bb7b8d91132d6478095cb4f3ea3d3a3914e3af66a7d8e49b3"} err="failed to get container status \"7736eacaf0fd9f0bb7b8d91132d6478095cb4f3ea3d3a3914e3af66a7d8e49b3\": rpc error: code = NotFound desc = could not find container \"7736eacaf0fd9f0bb7b8d91132d6478095cb4f3ea3d3a3914e3af66a7d8e49b3\": container with ID starting with 7736eacaf0fd9f0bb7b8d91132d6478095cb4f3ea3d3a3914e3af66a7d8e49b3 not found: ID does not exist"
Jul 28 08:09:10.731962 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.731926    2583 scope.go:117] "RemoveContainer" containerID="1c9bdb33a69877cb52b6b720a5ec61f0e76bdaea2d485eb1f957b4dd72bf2541"
Jul 28 08:09:10.732192 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:09:10.732173    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c9bdb33a69877cb52b6b720a5ec61f0e76bdaea2d485eb1f957b4dd72bf2541\": container with ID starting with 1c9bdb33a69877cb52b6b720a5ec61f0e76bdaea2d485eb1f957b4dd72bf2541 not found: ID does not exist" containerID="1c9bdb33a69877cb52b6b720a5ec61f0e76bdaea2d485eb1f957b4dd72bf2541"
Jul 28 08:09:10.732262 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.732197    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c9bdb33a69877cb52b6b720a5ec61f0e76bdaea2d485eb1f957b4dd72bf2541"} err="failed to get container status \"1c9bdb33a69877cb52b6b720a5ec61f0e76bdaea2d485eb1f957b4dd72bf2541\": rpc error: code = NotFound desc = could not find container \"1c9bdb33a69877cb52b6b720a5ec61f0e76bdaea2d485eb1f957b4dd72bf2541\": container with ID starting with 1c9bdb33a69877cb52b6b720a5ec61f0e76bdaea2d485eb1f957b4dd72bf2541 not found: ID does not exist"
Jul 28 08:09:10.732262 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.732211    2583 scope.go:117] "RemoveContainer" containerID="5c3f4a7cfb6ae76b5538caaff5f6b013137d6dd4ecef59bc9221c91f7a65285a"
Jul 28 08:09:10.732492 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:09:10.732472    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c3f4a7cfb6ae76b5538caaff5f6b013137d6dd4ecef59bc9221c91f7a65285a\": container with ID starting with 5c3f4a7cfb6ae76b5538caaff5f6b013137d6dd4ecef59bc9221c91f7a65285a not found: ID does not exist" containerID="5c3f4a7cfb6ae76b5538caaff5f6b013137d6dd4ecef59bc9221c91f7a65285a"
Jul 28 08:09:10.732551 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.732493    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c3f4a7cfb6ae76b5538caaff5f6b013137d6dd4ecef59bc9221c91f7a65285a"} err="failed to get container status \"5c3f4a7cfb6ae76b5538caaff5f6b013137d6dd4ecef59bc9221c91f7a65285a\": rpc error: code = NotFound desc = could not find container \"5c3f4a7cfb6ae76b5538caaff5f6b013137d6dd4ecef59bc9221c91f7a65285a\": container with ID starting with 5c3f4a7cfb6ae76b5538caaff5f6b013137d6dd4ecef59bc9221c91f7a65285a not found: ID does not exist"
Jul 28 08:09:10.732551 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.732506    2583 scope.go:117] "RemoveContainer" containerID="cda762bd450f3ed9278e57899c78b7dbcbccabe53e92f22e9eac11e9613baec7"
Jul 28 08:09:10.732727 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:09:10.732713    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cda762bd450f3ed9278e57899c78b7dbcbccabe53e92f22e9eac11e9613baec7\": container with ID starting with cda762bd450f3ed9278e57899c78b7dbcbccabe53e92f22e9eac11e9613baec7 not found: ID does not exist" containerID="cda762bd450f3ed9278e57899c78b7dbcbccabe53e92f22e9eac11e9613baec7"
Jul 28 08:09:10.732762 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.732731    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cda762bd450f3ed9278e57899c78b7dbcbccabe53e92f22e9eac11e9613baec7"} err="failed to get container status \"cda762bd450f3ed9278e57899c78b7dbcbccabe53e92f22e9eac11e9613baec7\": rpc error: code = NotFound desc = could not find container \"cda762bd450f3ed9278e57899c78b7dbcbccabe53e92f22e9eac11e9613baec7\": container with ID starting with cda762bd450f3ed9278e57899c78b7dbcbccabe53e92f22e9eac11e9613baec7 not found: ID does not exist"
Jul 28 08:09:10.732762 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.732743    2583 scope.go:117] "RemoveContainer" containerID="0fb73fb9611141d19de898397d5d27f673a0eb2fe01cf7e1d948734e060b15e1"
Jul 28 08:09:10.732966 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.732951    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fb73fb9611141d19de898397d5d27f673a0eb2fe01cf7e1d948734e060b15e1"} err="failed to get container status \"0fb73fb9611141d19de898397d5d27f673a0eb2fe01cf7e1d948734e060b15e1\": rpc error: code = NotFound desc = could not find container \"0fb73fb9611141d19de898397d5d27f673a0eb2fe01cf7e1d948734e060b15e1\": container with ID starting with 0fb73fb9611141d19de898397d5d27f673a0eb2fe01cf7e1d948734e060b15e1 not found: ID does not exist"
Jul 28 08:09:10.733004 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.732966    2583 scope.go:117] "RemoveContainer" containerID="fec6bcac707edf7b8204c359d0f9c01c8193a8558fb37da33670de71969b4ecb"
Jul 28 08:09:10.733180 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.733164    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fec6bcac707edf7b8204c359d0f9c01c8193a8558fb37da33670de71969b4ecb"} err="failed to get container status \"fec6bcac707edf7b8204c359d0f9c01c8193a8558fb37da33670de71969b4ecb\": rpc error: code = NotFound desc = could not find container \"fec6bcac707edf7b8204c359d0f9c01c8193a8558fb37da33670de71969b4ecb\": container with ID starting with fec6bcac707edf7b8204c359d0f9c01c8193a8558fb37da33670de71969b4ecb not found: ID does not exist"
Jul 28 08:09:10.733213 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.733182    2583 scope.go:117] "RemoveContainer" containerID="51720289a2872dafb8dca781a0c8331a2bf2408b617c01e3cf4ecd80a91d208d"
Jul 28 08:09:10.733392 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.733374    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51720289a2872dafb8dca781a0c8331a2bf2408b617c01e3cf4ecd80a91d208d"} err="failed to get container status \"51720289a2872dafb8dca781a0c8331a2bf2408b617c01e3cf4ecd80a91d208d\": rpc error: code = NotFound desc = could not find container \"51720289a2872dafb8dca781a0c8331a2bf2408b617c01e3cf4ecd80a91d208d\": container with ID starting with 51720289a2872dafb8dca781a0c8331a2bf2408b617c01e3cf4ecd80a91d208d not found: ID does not exist"
Jul 28 08:09:10.733437 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.733392    2583 scope.go:117] "RemoveContainer" containerID="7736eacaf0fd9f0bb7b8d91132d6478095cb4f3ea3d3a3914e3af66a7d8e49b3"
Jul 28 08:09:10.733618 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.733601    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7736eacaf0fd9f0bb7b8d91132d6478095cb4f3ea3d3a3914e3af66a7d8e49b3"} err="failed to get container status \"7736eacaf0fd9f0bb7b8d91132d6478095cb4f3ea3d3a3914e3af66a7d8e49b3\": rpc error: code = NotFound desc = could not find container \"7736eacaf0fd9f0bb7b8d91132d6478095cb4f3ea3d3a3914e3af66a7d8e49b3\": container with ID starting with 7736eacaf0fd9f0bb7b8d91132d6478095cb4f3ea3d3a3914e3af66a7d8e49b3 not found: ID does not exist"
Jul 28 08:09:10.733656 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.733619    2583 scope.go:117] "RemoveContainer" containerID="1c9bdb33a69877cb52b6b720a5ec61f0e76bdaea2d485eb1f957b4dd72bf2541"
Jul 28 08:09:10.733795 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.733777    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c9bdb33a69877cb52b6b720a5ec61f0e76bdaea2d485eb1f957b4dd72bf2541"} err="failed to get container status \"1c9bdb33a69877cb52b6b720a5ec61f0e76bdaea2d485eb1f957b4dd72bf2541\": rpc error: code = NotFound desc = could not find container \"1c9bdb33a69877cb52b6b720a5ec61f0e76bdaea2d485eb1f957b4dd72bf2541\": container with ID starting with 1c9bdb33a69877cb52b6b720a5ec61f0e76bdaea2d485eb1f957b4dd72bf2541 not found: ID does not exist"
Jul 28 08:09:10.733855 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.733797    2583 scope.go:117] "RemoveContainer" containerID="5c3f4a7cfb6ae76b5538caaff5f6b013137d6dd4ecef59bc9221c91f7a65285a"
Jul 28 08:09:10.734011 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.733990    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c3f4a7cfb6ae76b5538caaff5f6b013137d6dd4ecef59bc9221c91f7a65285a"} err="failed to get container status \"5c3f4a7cfb6ae76b5538caaff5f6b013137d6dd4ecef59bc9221c91f7a65285a\": rpc error: code = NotFound desc = could not find container \"5c3f4a7cfb6ae76b5538caaff5f6b013137d6dd4ecef59bc9221c91f7a65285a\": container with ID starting with 5c3f4a7cfb6ae76b5538caaff5f6b013137d6dd4ecef59bc9221c91f7a65285a not found: ID does not exist"
Jul 28 08:09:10.734080 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.734012    2583 scope.go:117] "RemoveContainer" containerID="cda762bd450f3ed9278e57899c78b7dbcbccabe53e92f22e9eac11e9613baec7"
Jul 28 08:09:10.734215 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.734200    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cda762bd450f3ed9278e57899c78b7dbcbccabe53e92f22e9eac11e9613baec7"} err="failed to get container status \"cda762bd450f3ed9278e57899c78b7dbcbccabe53e92f22e9eac11e9613baec7\": rpc error: code = NotFound desc = could not find container \"cda762bd450f3ed9278e57899c78b7dbcbccabe53e92f22e9eac11e9613baec7\": container with ID starting with cda762bd450f3ed9278e57899c78b7dbcbccabe53e92f22e9eac11e9613baec7 not found: ID does not exist"
Jul 28 08:09:10.776114 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776082    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 08:09:10.776432 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776418    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="kube-rbac-proxy"
Jul 28 08:09:10.776495 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776437    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="kube-rbac-proxy"
Jul 28 08:09:10.776495 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776461    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="kube-rbac-proxy-metric"
Jul 28 08:09:10.776495 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776467    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="kube-rbac-proxy-metric"
Jul 28 08:09:10.776495 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776477    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="prom-label-proxy"
Jul 28 08:09:10.776495 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776483    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="prom-label-proxy"
Jul 28 08:09:10.776495 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776492    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed157823-a341-4114-a7ad-c3e9290cbcf5" containerName="registry"
Jul 28 08:09:10.776495 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776497    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed157823-a341-4114-a7ad-c3e9290cbcf5" containerName="registry"
Jul 28 08:09:10.776698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776506    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="config-reloader"
Jul 28 08:09:10.776698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776515    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="config-reloader"
Jul 28 08:09:10.776698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776525    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="kube-rbac-proxy-web"
Jul 28 08:09:10.776698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776531    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="kube-rbac-proxy-web"
Jul 28 08:09:10.776698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776536    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="init-config-reloader"
Jul 28 08:09:10.776698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776541    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="init-config-reloader"
Jul 28 08:09:10.776698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776554    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="alertmanager"
Jul 28 08:09:10.776698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776558    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="alertmanager"
Jul 28 08:09:10.776698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776617    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="config-reloader"
Jul 28 08:09:10.776698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776626    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="kube-rbac-proxy"
Jul 28 08:09:10.776698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776632    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="kube-rbac-proxy-metric"
Jul 28 08:09:10.776698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776639    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="kube-rbac-proxy-web"
Jul 28 08:09:10.776698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776644    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="prom-label-proxy"
Jul 28 08:09:10.776698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776649    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed157823-a341-4114-a7ad-c3e9290cbcf5" containerName="registry"
Jul 28 08:09:10.776698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.776655    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" containerName="alertmanager"
Jul 28 08:09:10.780315 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.780296    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.783749 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.783730    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 28 08:09:10.783921 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.783899    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 28 08:09:10.784026 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.784008    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 28 08:09:10.784097 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.784008    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 28 08:09:10.784525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.784509    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 28 08:09:10.784613 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.784606    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 28 08:09:10.784671 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.784623    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 28 08:09:10.785168 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.785145    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 28 08:09:10.785168 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.785151    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nlwcs\""
Jul 28 08:09:10.791330 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.791307    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 28 08:09:10.804916 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.804891    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-config-out\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.804998 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.804924    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.804998 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.804959    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.805085 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.805018    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-config-volume\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.805085 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.805040    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.805085 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.805071    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.805226 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.805091    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.805226 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.805165    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.805226 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.805196    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.805226 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.805218    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.805402 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.805250    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.805402 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.805274    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svf42\" (UniqueName: \"kubernetes.io/projected/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-kube-api-access-svf42\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.805402 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.805305    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-web-config\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.811591 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.811558    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 08:09:10.905719 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.905667    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.905719 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.905720    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.905975 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.905743    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.905975 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.905771    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.905975 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.905792    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svf42\" (UniqueName: \"kubernetes.io/projected/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-kube-api-access-svf42\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.905975 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.905819    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-web-config\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.905975 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.905861    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-config-out\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.905975 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.905964    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.906268 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.906018    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.906268 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.906056    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-config-volume\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.906268 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.906082    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.906268 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.906135    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.906268 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.906168    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.907647 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.907030    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.907647 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.907307    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.907647 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.907578    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.909123 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.909053    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-config-out\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.909123 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.909053    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.909123 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.909176    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.909475 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.909309    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.909475 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.909336    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-web-config\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.909992 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.909967    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.910326 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.910312    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.910787 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.910763    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.910937 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.910920    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-config-volume\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:10.914496 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:10.914473    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svf42\" (UniqueName: \"kubernetes.io/projected/a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80-kube-api-access-svf42\") pod \"alertmanager-main-0\" (UID: \"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:11.090711 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:11.090672    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 08:09:11.229905 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:11.229870    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 08:09:11.233923 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:09:11.233892    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26cd9a8_ab79_4c92_9dd1_5c8ae9b52d80.slice/crio-8b969961dee6e023b22af27b79216eead853b3b47aa159cc0dd80b1dd097c3fa WatchSource:0}: Error finding container 8b969961dee6e023b22af27b79216eead853b3b47aa159cc0dd80b1dd097c3fa: Status 404 returned error can't find the container with id 8b969961dee6e023b22af27b79216eead853b3b47aa159cc0dd80b1dd097c3fa
Jul 28 08:09:11.333931 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:11.333898    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74ff06fa-1322-4638-a0fd-a46dc6029cde" path="/var/lib/kubelet/pods/74ff06fa-1322-4638-a0fd-a46dc6029cde/volumes"
Jul 28 08:09:11.682318 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:11.682280    2583 generic.go:356] "Generic (PLEG): container finished" podID="a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80" containerID="cfa572e988898fd3d50bed58160e0589b40f169aad6846f0cf51acdd14361a72" exitCode=0
Jul 28 08:09:11.682508 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:11.682367    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80","Type":"ContainerDied","Data":"cfa572e988898fd3d50bed58160e0589b40f169aad6846f0cf51acdd14361a72"}
Jul 28 08:09:11.682508 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:11.682441    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80","Type":"ContainerStarted","Data":"8b969961dee6e023b22af27b79216eead853b3b47aa159cc0dd80b1dd097c3fa"}
Jul 28 08:09:12.694668 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:12.694632    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80","Type":"ContainerStarted","Data":"f8b1583ced72cbb993fab1cbe1b7681856002259781f2b468584abcb458b5676"}
Jul 28 08:09:12.695073 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:12.694728    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80","Type":"ContainerStarted","Data":"958a2015a3989395a2bbe530e75b356cd9cfc8b13945b1cfc5f20d3d51d72b7d"}
Jul 28 08:09:12.695073 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:12.694756    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80","Type":"ContainerStarted","Data":"3e4e9d951360a37d0cd952832379539c55a1c5c530f07e7ee39aff57948be61e"}
Jul 28 08:09:12.695073 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:12.694781    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80","Type":"ContainerStarted","Data":"7136540f04d15ec9658cf66980ef73c155df8178d68f30d130f6b3ff80d27832"}
Jul 28 08:09:12.695073 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:12.694816    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80","Type":"ContainerStarted","Data":"44813d616365b61a59c9cadd1cec1774a2ce60e3aa4711e60b1060384981038c"}
Jul 28 08:09:12.695073 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:12.694844    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80","Type":"ContainerStarted","Data":"bf2ed42cecb6637edde66ee26ab3c4acc3d8e3834dfa2c8690ea3c4b72fc2704"}
Jul 28 08:09:12.729103 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:12.729046    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.713751765 podStartE2EDuration="2.72902972s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.277955ms" isStatefulPod=false podCreationTimestamp="2026-07-28 08:09:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:09:12.727698864 +0000 UTC m=+387.914887035" watchObservedRunningTime="2026-07-28 08:09:12.72902972 +0000 UTC m=+387.916217849"
Jul 28 08:09:12.940433 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:12.940401    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5954485cc9-pkqg4"]
Jul 28 08:09:12.942768 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:12.942750    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:12.945589 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:12.945524    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 28 08:09:12.945589 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:12.945540    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 28 08:09:12.945814 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:12.945548    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jg9jq\""
Jul 28 08:09:12.945814 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:12.945552    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 28 08:09:12.946034 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:12.946018    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 28 08:09:12.946134 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:12.946094    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 28 08:09:12.951240 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:12.951216    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 28 08:09:12.963495 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:12.963474    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5954485cc9-pkqg4"]
Jul 28 08:09:13.021370 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.021338    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/65913f8d-87a4-44ef-8736-34ff2880adff-federate-client-tls\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.021370 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.021373    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/65913f8d-87a4-44ef-8736-34ff2880adff-telemeter-client-tls\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.021594 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.021390    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65913f8d-87a4-44ef-8736-34ff2880adff-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.021594 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.021472    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65913f8d-87a4-44ef-8736-34ff2880adff-metrics-client-ca\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.021594 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.021534    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65913f8d-87a4-44ef-8736-34ff2880adff-serving-certs-ca-bundle\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.021594 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.021566    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t7pk\" (UniqueName: \"kubernetes.io/projected/65913f8d-87a4-44ef-8736-34ff2880adff-kube-api-access-6t7pk\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.021714 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.021604    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65913f8d-87a4-44ef-8736-34ff2880adff-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.021714 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.021633    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/65913f8d-87a4-44ef-8736-34ff2880adff-secret-telemeter-client\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.122739 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.122703    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65913f8d-87a4-44ef-8736-34ff2880adff-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.122739 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.122747    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/65913f8d-87a4-44ef-8736-34ff2880adff-secret-telemeter-client\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.122906 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.122773    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/65913f8d-87a4-44ef-8736-34ff2880adff-federate-client-tls\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.122906 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.122798    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/65913f8d-87a4-44ef-8736-34ff2880adff-telemeter-client-tls\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.123007 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.122919    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65913f8d-87a4-44ef-8736-34ff2880adff-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.123007 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.122997    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65913f8d-87a4-44ef-8736-34ff2880adff-metrics-client-ca\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.123111 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.123050    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65913f8d-87a4-44ef-8736-34ff2880adff-serving-certs-ca-bundle\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.123111 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.123097    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t7pk\" (UniqueName: \"kubernetes.io/projected/65913f8d-87a4-44ef-8736-34ff2880adff-kube-api-access-6t7pk\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.123760 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.123735    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65913f8d-87a4-44ef-8736-34ff2880adff-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.124053 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.124028    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65913f8d-87a4-44ef-8736-34ff2880adff-serving-certs-ca-bundle\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.124134 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.124107    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65913f8d-87a4-44ef-8736-34ff2880adff-metrics-client-ca\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.125608 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.125583    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/65913f8d-87a4-44ef-8736-34ff2880adff-telemeter-client-tls\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.125711 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.125653    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65913f8d-87a4-44ef-8736-34ff2880adff-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.125821 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.125804    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/65913f8d-87a4-44ef-8736-34ff2880adff-federate-client-tls\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.125870 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.125823    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/65913f8d-87a4-44ef-8736-34ff2880adff-secret-telemeter-client\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.133050 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.133029    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t7pk\" (UniqueName: \"kubernetes.io/projected/65913f8d-87a4-44ef-8736-34ff2880adff-kube-api-access-6t7pk\") pod \"telemeter-client-5954485cc9-pkqg4\" (UID: \"65913f8d-87a4-44ef-8736-34ff2880adff\") " pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.253731 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.253625    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4"
Jul 28 08:09:13.405203 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.405179    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5954485cc9-pkqg4"]
Jul 28 08:09:13.407473 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:09:13.407428    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65913f8d_87a4_44ef_8736_34ff2880adff.slice/crio-9a438cd6e9f50485b5704e9c515a21612e3993ce1d161d018ff83bcd32797a37 WatchSource:0}: Error finding container 9a438cd6e9f50485b5704e9c515a21612e3993ce1d161d018ff83bcd32797a37: Status 404 returned error can't find the container with id 9a438cd6e9f50485b5704e9c515a21612e3993ce1d161d018ff83bcd32797a37
Jul 28 08:09:13.701296 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:13.701261    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4" event={"ID":"65913f8d-87a4-44ef-8736-34ff2880adff","Type":"ContainerStarted","Data":"9a438cd6e9f50485b5704e9c515a21612e3993ce1d161d018ff83bcd32797a37"}
Jul 28 08:09:16.715083 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:16.715045    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4" event={"ID":"65913f8d-87a4-44ef-8736-34ff2880adff","Type":"ContainerStarted","Data":"42b1fcfb198954305016fc8fb75c28ac0caa71ad2877a7b8de4883009419a648"}
Jul 28 08:09:16.715609 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:16.715109    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4" event={"ID":"65913f8d-87a4-44ef-8736-34ff2880adff","Type":"ContainerStarted","Data":"9b0d18d9f3621016f8a0ee35c1b4c49fe4550456e3509b232bcaee75ec67c3a6"}
Jul 28 08:09:16.715609 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:16.715139    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4" event={"ID":"65913f8d-87a4-44ef-8736-34ff2880adff","Type":"ContainerStarted","Data":"6e697bdf9d73a41ba7caa2c3188e081bd41e34080f5ae733ab30a6cbe37c6ed4"}
Jul 28 08:09:16.739505 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:16.738937    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5954485cc9-pkqg4" podStartSLOduration=2.441376838 podStartE2EDuration="4.738915939s" totalImagesPullingTime="2.297539101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:09:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:09:16.737943285 +0000 UTC m=+391.925131404" watchObservedRunningTime="2026-07-28 08:09:16.738915939 +0000 UTC m=+391.926104073"
Jul 28 08:09:28.120465 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:28.120411    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cd69c557b-x4p5c"]
Jul 28 08:09:53.141231 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.141179    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7cd69c557b-x4p5c" podUID="becf2df2-9333-4adb-aba6-d74566a50328" containerName="console" containerID="cri-o://279e13f43ed08e5652c2451707cbcfdd61979aae0e043cc80a3683f9418d5c82" gracePeriod=15
Jul 28 08:09:53.389765 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.389738    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:09:53.577684 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.577598    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/becf2df2-9333-4adb-aba6-d74566a50328-console-oauth-config\") pod \"becf2df2-9333-4adb-aba6-d74566a50328\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") "
Jul 28 08:09:53.577684 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.577665    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-console-config\") pod \"becf2df2-9333-4adb-aba6-d74566a50328\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") "
Jul 28 08:09:53.577891 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.577704    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kg6xd\" (UniqueName: \"kubernetes.io/projected/becf2df2-9333-4adb-aba6-d74566a50328-kube-api-access-kg6xd\") pod \"becf2df2-9333-4adb-aba6-d74566a50328\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") "
Jul 28 08:09:53.577891 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.577719    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-service-ca\") pod \"becf2df2-9333-4adb-aba6-d74566a50328\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") "
Jul 28 08:09:53.577891 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.577756    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-oauth-serving-cert\") pod \"becf2df2-9333-4adb-aba6-d74566a50328\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") "
Jul 28 08:09:53.577891 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.577808    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-trusted-ca-bundle\") pod \"becf2df2-9333-4adb-aba6-d74566a50328\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") "
Jul 28 08:09:53.577891 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.577835    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/becf2df2-9333-4adb-aba6-d74566a50328-console-serving-cert\") pod \"becf2df2-9333-4adb-aba6-d74566a50328\" (UID: \"becf2df2-9333-4adb-aba6-d74566a50328\") "
Jul 28 08:09:53.578206 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.578175    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-console-config" (OuterVolumeSpecName: "console-config") pod "becf2df2-9333-4adb-aba6-d74566a50328" (UID: "becf2df2-9333-4adb-aba6-d74566a50328"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 08:09:53.578206 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.578193    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-service-ca" (OuterVolumeSpecName: "service-ca") pod "becf2df2-9333-4adb-aba6-d74566a50328" (UID: "becf2df2-9333-4adb-aba6-d74566a50328"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 08:09:53.578566 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.578385    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "becf2df2-9333-4adb-aba6-d74566a50328" (UID: "becf2df2-9333-4adb-aba6-d74566a50328"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 08:09:53.578566 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.578468    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "becf2df2-9333-4adb-aba6-d74566a50328" (UID: "becf2df2-9333-4adb-aba6-d74566a50328"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 08:09:53.580189 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.580160    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/becf2df2-9333-4adb-aba6-d74566a50328-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "becf2df2-9333-4adb-aba6-d74566a50328" (UID: "becf2df2-9333-4adb-aba6-d74566a50328"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:09:53.580312 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.580205    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/becf2df2-9333-4adb-aba6-d74566a50328-kube-api-access-kg6xd" (OuterVolumeSpecName: "kube-api-access-kg6xd") pod "becf2df2-9333-4adb-aba6-d74566a50328" (UID: "becf2df2-9333-4adb-aba6-d74566a50328"). InnerVolumeSpecName "kube-api-access-kg6xd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:09:53.580312 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.580249    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/becf2df2-9333-4adb-aba6-d74566a50328-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "becf2df2-9333-4adb-aba6-d74566a50328" (UID: "becf2df2-9333-4adb-aba6-d74566a50328"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:09:53.679438 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.679400    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/becf2df2-9333-4adb-aba6-d74566a50328-console-serving-cert\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:09:53.679438 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.679430    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/becf2df2-9333-4adb-aba6-d74566a50328-console-oauth-config\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:09:53.679438 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.679439    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-console-config\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:09:53.679438 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.679471    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg6xd\" (UniqueName: \"kubernetes.io/projected/becf2df2-9333-4adb-aba6-d74566a50328-kube-api-access-kg6xd\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:09:53.679438 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.679479    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-service-ca\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:09:53.679764 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.679488    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-oauth-serving-cert\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:09:53.679764 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.679495    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/becf2df2-9333-4adb-aba6-d74566a50328-trusted-ca-bundle\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:09:53.869005 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.868972    2583 generic.go:356] "Generic (PLEG): container finished" podID="becf2df2-9333-4adb-aba6-d74566a50328" containerID="279e13f43ed08e5652c2451707cbcfdd61979aae0e043cc80a3683f9418d5c82" exitCode=0
Jul 28 08:09:53.869166 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.869021    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cd69c557b-x4p5c"
Jul 28 08:09:53.869166 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.869021    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cd69c557b-x4p5c" event={"ID":"becf2df2-9333-4adb-aba6-d74566a50328","Type":"ContainerDied","Data":"279e13f43ed08e5652c2451707cbcfdd61979aae0e043cc80a3683f9418d5c82"}
Jul 28 08:09:53.869166 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.869076    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cd69c557b-x4p5c" event={"ID":"becf2df2-9333-4adb-aba6-d74566a50328","Type":"ContainerDied","Data":"74860c00c8cf45ba08b75d85ca35ac84ec241184b77fc7047e3b30346cd198c3"}
Jul 28 08:09:53.869166 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.869099    2583 scope.go:117] "RemoveContainer" containerID="279e13f43ed08e5652c2451707cbcfdd61979aae0e043cc80a3683f9418d5c82"
Jul 28 08:09:53.878629 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.878605    2583 scope.go:117] "RemoveContainer" containerID="279e13f43ed08e5652c2451707cbcfdd61979aae0e043cc80a3683f9418d5c82"
Jul 28 08:09:53.878884 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:09:53.878865    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"279e13f43ed08e5652c2451707cbcfdd61979aae0e043cc80a3683f9418d5c82\": container with ID starting with 279e13f43ed08e5652c2451707cbcfdd61979aae0e043cc80a3683f9418d5c82 not found: ID does not exist" containerID="279e13f43ed08e5652c2451707cbcfdd61979aae0e043cc80a3683f9418d5c82"
Jul 28 08:09:53.878940 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.878893    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"279e13f43ed08e5652c2451707cbcfdd61979aae0e043cc80a3683f9418d5c82"} err="failed to get container status \"279e13f43ed08e5652c2451707cbcfdd61979aae0e043cc80a3683f9418d5c82\": rpc error: code = NotFound desc = could not find container \"279e13f43ed08e5652c2451707cbcfdd61979aae0e043cc80a3683f9418d5c82\": container with ID starting with 279e13f43ed08e5652c2451707cbcfdd61979aae0e043cc80a3683f9418d5c82 not found: ID does not exist"
Jul 28 08:09:53.890974 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.890947    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cd69c557b-x4p5c"]
Jul 28 08:09:53.895572 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:53.895549    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cd69c557b-x4p5c"]
Jul 28 08:09:55.333998 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:09:55.333961    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="becf2df2-9333-4adb-aba6-d74566a50328" path="/var/lib/kubelet/pods/becf2df2-9333-4adb-aba6-d74566a50328/volumes"
Jul 28 08:10:24.318139 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.318088    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84b8f44b84-7k5hw"]
Jul 28 08:10:24.318753 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.318632    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="becf2df2-9333-4adb-aba6-d74566a50328" containerName="console"
Jul 28 08:10:24.318753 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.318652    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="becf2df2-9333-4adb-aba6-d74566a50328" containerName="console"
Jul 28 08:10:24.318873 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.318762    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="becf2df2-9333-4adb-aba6-d74566a50328" containerName="console"
Jul 28 08:10:24.322982 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.322958    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.327709 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.327671    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 08:10:24.327907 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.327891    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2zwlv\""
Jul 28 08:10:24.328048 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.328028    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 08:10:24.328538 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.328514    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 08:10:24.328723 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.328540    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 08:10:24.329383 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.329361    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 08:10:24.335346 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.335320    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 28 08:10:24.336036 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.336016    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84b8f44b84-7k5hw"]
Jul 28 08:10:24.419153 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.419113    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bdf1bc2c-8229-4788-bc52-9dbee3903abb-console-oauth-config\") pod \"console-84b8f44b84-7k5hw\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") " pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.419349 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.419193    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh2f6\" (UniqueName: \"kubernetes.io/projected/bdf1bc2c-8229-4788-bc52-9dbee3903abb-kube-api-access-hh2f6\") pod \"console-84b8f44b84-7k5hw\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") " pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.419349 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.419274    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-trusted-ca-bundle\") pod \"console-84b8f44b84-7k5hw\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") " pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.419349 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.419338    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bdf1bc2c-8229-4788-bc52-9dbee3903abb-console-serving-cert\") pod \"console-84b8f44b84-7k5hw\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") " pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.419586 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.419480    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-console-config\") pod \"console-84b8f44b84-7k5hw\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") " pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.419655 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.419622    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-oauth-serving-cert\") pod \"console-84b8f44b84-7k5hw\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") " pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.419721 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.419699    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-service-ca\") pod \"console-84b8f44b84-7k5hw\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") " pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.520529 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.520488    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bdf1bc2c-8229-4788-bc52-9dbee3903abb-console-oauth-config\") pod \"console-84b8f44b84-7k5hw\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") " pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.520727 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.520535    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh2f6\" (UniqueName: \"kubernetes.io/projected/bdf1bc2c-8229-4788-bc52-9dbee3903abb-kube-api-access-hh2f6\") pod \"console-84b8f44b84-7k5hw\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") " pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.520727 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.520576    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-trusted-ca-bundle\") pod \"console-84b8f44b84-7k5hw\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") " pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.520727 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.520615    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bdf1bc2c-8229-4788-bc52-9dbee3903abb-console-serving-cert\") pod \"console-84b8f44b84-7k5hw\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") " pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.520888 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.520763    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-console-config\") pod \"console-84b8f44b84-7k5hw\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") " pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.520888 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.520810    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-oauth-serving-cert\") pod \"console-84b8f44b84-7k5hw\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") " pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.520888 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.520849    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-service-ca\") pod \"console-84b8f44b84-7k5hw\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") " pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.521517 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.521490    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-oauth-serving-cert\") pod \"console-84b8f44b84-7k5hw\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") " pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.521652 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.521496    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-console-config\") pod \"console-84b8f44b84-7k5hw\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") " pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.521762 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.521740    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-trusted-ca-bundle\") pod \"console-84b8f44b84-7k5hw\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") " pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.521819 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.521798    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-service-ca\") pod \"console-84b8f44b84-7k5hw\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") " pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.523348 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.523320    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bdf1bc2c-8229-4788-bc52-9dbee3903abb-console-serving-cert\") pod \"console-84b8f44b84-7k5hw\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") " pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.523490 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.523357    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bdf1bc2c-8229-4788-bc52-9dbee3903abb-console-oauth-config\") pod \"console-84b8f44b84-7k5hw\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") " pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.530805 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.530786    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh2f6\" (UniqueName: \"kubernetes.io/projected/bdf1bc2c-8229-4788-bc52-9dbee3903abb-kube-api-access-hh2f6\") pod \"console-84b8f44b84-7k5hw\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") " pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.634258 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.634228    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:24.770391 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.770358    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84b8f44b84-7k5hw"]
Jul 28 08:10:24.773678 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:10:24.773650    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdf1bc2c_8229_4788_bc52_9dbee3903abb.slice/crio-45dffcfbd89a750a48d302937fef05b40a491d6c973084728938379b44ce7ba2 WatchSource:0}: Error finding container 45dffcfbd89a750a48d302937fef05b40a491d6c973084728938379b44ce7ba2: Status 404 returned error can't find the container with id 45dffcfbd89a750a48d302937fef05b40a491d6c973084728938379b44ce7ba2
Jul 28 08:10:24.998233 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.998138    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b8f44b84-7k5hw" event={"ID":"bdf1bc2c-8229-4788-bc52-9dbee3903abb","Type":"ContainerStarted","Data":"9d1007c7efd9a89e2d3643e0d705e2b4ee0a88a390e1413e420b5190fa1cfa8b"}
Jul 28 08:10:24.998233 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:24.998201    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b8f44b84-7k5hw" event={"ID":"bdf1bc2c-8229-4788-bc52-9dbee3903abb","Type":"ContainerStarted","Data":"45dffcfbd89a750a48d302937fef05b40a491d6c973084728938379b44ce7ba2"}
Jul 28 08:10:25.015318 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:25.015257    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84b8f44b84-7k5hw" podStartSLOduration=1.015241399 podStartE2EDuration="1.015241399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:10:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:10:25.014401188 +0000 UTC m=+460.201589321" watchObservedRunningTime="2026-07-28 08:10:25.015241399 +0000 UTC m=+460.202429528"
Jul 28 08:10:34.634668 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:34.634629    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:34.635066 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:34.634693    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:34.639602 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:34.639579    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:10:35.042892 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:10:35.042810    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:12:48.511524 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:48.511497    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vgzf4_dcf82623-a4f7-4511-aed0-7248950f1ca1/console-operator/1.log"
Jul 28 08:12:48.514026 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:48.511997    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vgzf4_dcf82623-a4f7-4511-aed0-7248950f1ca1/console-operator/1.log"
Jul 28 08:12:48.518836 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:48.518808    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-acl-logging/0.log"
Jul 28 08:12:48.519320 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:48.519303    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-acl-logging/0.log"
Jul 28 08:12:55.777142 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.777104    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"]
Jul 28 08:12:55.781110 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.781093    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:12:55.783492 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.783436    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jul 28 08:12:55.783752 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.783734    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jul 28 08:12:55.783847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.783830    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 28 08:12:55.783981 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.783963    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jul 28 08:12:55.784063 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.783988    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jul 28 08:12:55.784063 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.784018    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 28 08:12:55.784063 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.783968    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-cd849\""
Jul 28 08:12:55.784063 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.783967    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jul 28 08:12:55.796646 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.796620    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"]
Jul 28 08:12:55.888857 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.888816    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-registry-tls\") pod \"feast-simple-feast-setup-74c44d6f4-hwxjj\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:12:55.888857 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.888855    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glp9c\" (UniqueName: \"kubernetes.io/projected/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-kube-api-access-glp9c\") pod \"feast-simple-feast-setup-74c44d6f4-hwxjj\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:12:55.889086 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.888915    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-offline-tls\") pod \"feast-simple-feast-setup-74c44d6f4-hwxjj\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:12:55.889086 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.888956    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-ui-tls\") pod \"feast-simple-feast-setup-74c44d6f4-hwxjj\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:12:55.889086 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.888987    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-feast-data\") pod \"feast-simple-feast-setup-74c44d6f4-hwxjj\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:12:55.889086 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.889041    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-online-tls\") pod \"feast-simple-feast-setup-74c44d6f4-hwxjj\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:12:55.990294 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.990252    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-offline-tls\") pod \"feast-simple-feast-setup-74c44d6f4-hwxjj\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:12:55.990294 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.990299    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-ui-tls\") pod \"feast-simple-feast-setup-74c44d6f4-hwxjj\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:12:55.990585 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.990322    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-feast-data\") pod \"feast-simple-feast-setup-74c44d6f4-hwxjj\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:12:55.990585 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.990373    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-online-tls\") pod \"feast-simple-feast-setup-74c44d6f4-hwxjj\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:12:55.990585 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.990407    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-registry-tls\") pod \"feast-simple-feast-setup-74c44d6f4-hwxjj\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:12:55.990585 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.990435    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glp9c\" (UniqueName: \"kubernetes.io/projected/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-kube-api-access-glp9c\") pod \"feast-simple-feast-setup-74c44d6f4-hwxjj\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:12:55.990907 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.990875    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-feast-data\") pod \"feast-simple-feast-setup-74c44d6f4-hwxjj\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:12:55.993053 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.993023    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-registry-tls\") pod \"feast-simple-feast-setup-74c44d6f4-hwxjj\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:12:55.993195 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.993164    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-offline-tls\") pod \"feast-simple-feast-setup-74c44d6f4-hwxjj\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:12:55.993508 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.993493    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-ui-tls\") pod \"feast-simple-feast-setup-74c44d6f4-hwxjj\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:12:55.993582 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:55.993567    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-online-tls\") pod \"feast-simple-feast-setup-74c44d6f4-hwxjj\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:12:56.007859 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:56.007827    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glp9c\" (UniqueName: \"kubernetes.io/projected/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-kube-api-access-glp9c\") pod \"feast-simple-feast-setup-74c44d6f4-hwxjj\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:12:56.106106 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:56.106018    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:12:56.252349 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:56.252316    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"]
Jul 28 08:12:56.255700 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:12:56.255675    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bb15280_fd9c_4ef5_a1ee_11265c7aafb3.slice/crio-1b6dc9342a92361f8cab095150aeae732ced3b0f28e226ae131fcb50c974327c WatchSource:0}: Error finding container 1b6dc9342a92361f8cab095150aeae732ced3b0f28e226ae131fcb50c974327c: Status 404 returned error can't find the container with id 1b6dc9342a92361f8cab095150aeae732ced3b0f28e226ae131fcb50c974327c
Jul 28 08:12:56.257588 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:56.257570    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 08:12:56.624522 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:12:56.624490    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" event={"ID":"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3","Type":"ContainerStarted","Data":"1b6dc9342a92361f8cab095150aeae732ced3b0f28e226ae131fcb50c974327c"}
Jul 28 08:13:27.760708 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:27.760666    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" event={"ID":"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3","Type":"ContainerStarted","Data":"5ee47e1bf055eb8955b0b7a37ae96e072ea50ed7e902feab441da7c8847847df"}
Jul 28 08:13:32.782167 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:32.782134    2583 generic.go:356] "Generic (PLEG): container finished" podID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerID="5ee47e1bf055eb8955b0b7a37ae96e072ea50ed7e902feab441da7c8847847df" exitCode=0
Jul 28 08:13:32.782586 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:32.782185    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" event={"ID":"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3","Type":"ContainerDied","Data":"5ee47e1bf055eb8955b0b7a37ae96e072ea50ed7e902feab441da7c8847847df"}
Jul 28 08:13:33.788828 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:33.788788    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" event={"ID":"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3","Type":"ContainerStarted","Data":"70cd71043ca5172040676d52afc6b17eaed5b82bd55dd0a25cd4094fda9c300f"}
Jul 28 08:13:38.814808 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:38.814776    2583 generic.go:356] "Generic (PLEG): container finished" podID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerID="70cd71043ca5172040676d52afc6b17eaed5b82bd55dd0a25cd4094fda9c300f" exitCode=0
Jul 28 08:13:38.815288 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:38.814858    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" event={"ID":"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3","Type":"ContainerDied","Data":"70cd71043ca5172040676d52afc6b17eaed5b82bd55dd0a25cd4094fda9c300f"}
Jul 28 08:13:39.834994 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:39.834950    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" event={"ID":"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3","Type":"ContainerStarted","Data":"ae7495001af901742b9e34c09bcce884c963a121c3941b22e1aa067ef356ad35"}
Jul 28 08:13:39.835482 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:39.835018    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" event={"ID":"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3","Type":"ContainerStarted","Data":"560652f83f6043854348ff994b5bdd1985e31217ca3d94be738fe86d45cc0962"}
Jul 28 08:13:39.835482 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:39.835049    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" event={"ID":"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3","Type":"ContainerStarted","Data":"0abd8473d23c92a5dd2fe0580fa034745069441b1b84319774cc5478fcf8073e"}
Jul 28 08:13:39.835482 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:39.835072    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" event={"ID":"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3","Type":"ContainerStarted","Data":"43de53baea753b3d316716bc28bcb06810c6d3c5be534318aebc4842014f0fb0"}
Jul 28 08:13:39.862558 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:39.862494    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" podStartSLOduration=14.305327605 podStartE2EDuration="44.862471688s" totalImagesPullingTime="30.557144083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:12:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:13:39.860175621 +0000 UTC m=+655.047363752" watchObservedRunningTime="2026-07-28 08:13:39.862471688 +0000 UTC m=+655.049659819"
Jul 28 08:13:41.107186 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:41.107054    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:13:41.107186 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:41.107117    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:13:41.107186 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:41.107136    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:13:41.107186 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:41.107153    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:13:41.109354 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:41.109318    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
Jul 28 08:13:41.109617 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:41.109362    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Jul 28 08:13:41.109744 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:41.109417    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused"
Jul 28 08:13:41.109744 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:41.109471    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused"
Jul 28 08:13:44.107094 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:44.106897    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
Jul 28 08:13:44.107094 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:44.106942    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Jul 28 08:13:44.107094 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:44.106912    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused"
Jul 28 08:13:44.107094 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:44.106912    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused"
Jul 28 08:13:46.106273 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:46.106213    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:13:46.106716 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:46.106298    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:13:46.106716 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:46.106317    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:13:46.106716 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:46.106334    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:13:47.107197 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:47.107162    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:13:47.107746 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:47.107406    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:13:47.107746 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:47.107541    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:13:47.112697 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:47.112671    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:13:47.877705 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:47.877642    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:13:47.878139 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:47.878117    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:13:47.878236 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:47.878175    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:13:47.880640 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:13:47.880623    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:14:34.211523 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:34.211487    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84b8f44b84-7k5hw"]
Jul 28 08:14:49.115233 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.115143    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"]
Jul 28 08:14:49.115830 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.115565    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="offline" containerID="cri-o://560652f83f6043854348ff994b5bdd1985e31217ca3d94be738fe86d45cc0962" gracePeriod=30
Jul 28 08:14:49.115830 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.115586    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="online" containerID="cri-o://0abd8473d23c92a5dd2fe0580fa034745069441b1b84319774cc5478fcf8073e" gracePeriod=30
Jul 28 08:14:49.115830 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.115629    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="registry" containerID="cri-o://43de53baea753b3d316716bc28bcb06810c6d3c5be534318aebc4842014f0fb0" gracePeriod=30
Jul 28 08:14:49.115830 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.115578    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="ui" containerID="cri-o://ae7495001af901742b9e34c09bcce884c963a121c3941b22e1aa067ef356ad35" gracePeriod=30
Jul 28 08:14:49.380814 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.380775    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"]
Jul 28 08:14:49.384909 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.384892    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:49.387148 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.387125    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-nz5ft\""
Jul 28 08:14:49.398976 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.398941    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"]
Jul 28 08:14:49.444904 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.444869    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-registry-tls\") pod \"feast-simple-feast-setup-74c44d6f4-n6w6q\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:49.444904 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.444907    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-offline-tls\") pod \"feast-simple-feast-setup-74c44d6f4-n6w6q\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:49.445157 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.444926    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klkqp\" (UniqueName: \"kubernetes.io/projected/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-kube-api-access-klkqp\") pod \"feast-simple-feast-setup-74c44d6f4-n6w6q\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:49.445157 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.444946    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-feast-data\") pod \"feast-simple-feast-setup-74c44d6f4-n6w6q\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:49.445157 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.445014    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-online-tls\") pod \"feast-simple-feast-setup-74c44d6f4-n6w6q\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:49.445157 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.445040    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-ui-tls\") pod \"feast-simple-feast-setup-74c44d6f4-n6w6q\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:49.545634 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.545582    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-feast-data\") pod \"feast-simple-feast-setup-74c44d6f4-n6w6q\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:49.545856 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.545660    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-online-tls\") pod \"feast-simple-feast-setup-74c44d6f4-n6w6q\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:49.545856 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.545708    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-ui-tls\") pod \"feast-simple-feast-setup-74c44d6f4-n6w6q\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:49.545856 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.545789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-registry-tls\") pod \"feast-simple-feast-setup-74c44d6f4-n6w6q\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:49.545856 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.545824    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-offline-tls\") pod \"feast-simple-feast-setup-74c44d6f4-n6w6q\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:49.545856 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.545852    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klkqp\" (UniqueName: \"kubernetes.io/projected/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-kube-api-access-klkqp\") pod \"feast-simple-feast-setup-74c44d6f4-n6w6q\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:49.546194 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:14:49.545890    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jul 28 08:14:49.546194 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:14:49.545981    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-ui-tls podName:a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9 nodeName:}" failed. No retries permitted until 2026-07-28 08:14:50.045958515 +0000 UTC m=+725.233146641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-ui-tls") pod "feast-simple-feast-setup-74c44d6f4-n6w6q" (UID: "a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9") : secret "feast-simple-feast-setup-ui-tls" not found
Jul 28 08:14:49.546194 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.546070    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-feast-data\") pod \"feast-simple-feast-setup-74c44d6f4-n6w6q\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:49.546194 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:14:49.546169    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jul 28 08:14:49.546359 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:14:49.546234    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-offline-tls podName:a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9 nodeName:}" failed. No retries permitted until 2026-07-28 08:14:50.04621445 +0000 UTC m=+725.233402585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-offline-tls") pod "feast-simple-feast-setup-74c44d6f4-n6w6q" (UID: "a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9") : secret "feast-simple-feast-setup-offline-tls" not found
Jul 28 08:14:49.549131 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.548854    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-online-tls\") pod \"feast-simple-feast-setup-74c44d6f4-n6w6q\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:49.549131 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.549086    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-registry-tls\") pod \"feast-simple-feast-setup-74c44d6f4-n6w6q\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:49.554870 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:49.554839    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klkqp\" (UniqueName: \"kubernetes.io/projected/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-kube-api-access-klkqp\") pod \"feast-simple-feast-setup-74c44d6f4-n6w6q\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:50.050167 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:50.050059    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-ui-tls\") pod \"feast-simple-feast-setup-74c44d6f4-n6w6q\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:50.050167 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:50.050155    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-offline-tls\") pod \"feast-simple-feast-setup-74c44d6f4-n6w6q\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:50.052740 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:50.052713    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-offline-tls\") pod \"feast-simple-feast-setup-74c44d6f4-n6w6q\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:50.052867 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:50.052767    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-ui-tls\") pod \"feast-simple-feast-setup-74c44d6f4-n6w6q\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") " pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:50.139574 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:50.139538    2583 generic.go:356] "Generic (PLEG): container finished" podID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerID="ae7495001af901742b9e34c09bcce884c963a121c3941b22e1aa067ef356ad35" exitCode=0
Jul 28 08:14:50.139574 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:50.139569    2583 generic.go:356] "Generic (PLEG): container finished" podID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerID="0abd8473d23c92a5dd2fe0580fa034745069441b1b84319774cc5478fcf8073e" exitCode=0
Jul 28 08:14:50.140024 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:50.139622    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" event={"ID":"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3","Type":"ContainerDied","Data":"ae7495001af901742b9e34c09bcce884c963a121c3941b22e1aa067ef356ad35"}
Jul 28 08:14:50.140024 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:50.139679    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" event={"ID":"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3","Type":"ContainerDied","Data":"0abd8473d23c92a5dd2fe0580fa034745069441b1b84319774cc5478fcf8073e"}
Jul 28 08:14:50.294586 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:50.294555    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:14:50.438567 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:50.438537    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"]
Jul 28 08:14:50.441924 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:14:50.441891    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda00e6e7c_4c3c_45e8_9ec3_1deb9976fee9.slice/crio-085cc6e6a58209f9b3c799bf9d744d04f09ddf005d8d0e63500858d3c3385489 WatchSource:0}: Error finding container 085cc6e6a58209f9b3c799bf9d744d04f09ddf005d8d0e63500858d3c3385489: Status 404 returned error can't find the container with id 085cc6e6a58209f9b3c799bf9d744d04f09ddf005d8d0e63500858d3c3385489
Jul 28 08:14:51.145207 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:51.145172    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" event={"ID":"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9","Type":"ContainerStarted","Data":"4141c2a9c48f14c50cf92a453ac7f1206f8742da5d008acf7562bfc970a2d49f"}
Jul 28 08:14:51.145623 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:51.145226    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" event={"ID":"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9","Type":"ContainerStarted","Data":"085cc6e6a58209f9b3c799bf9d744d04f09ddf005d8d0e63500858d3c3385489"}
Jul 28 08:14:56.171002 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:56.170961    2583 generic.go:356] "Generic (PLEG): container finished" podID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerID="4141c2a9c48f14c50cf92a453ac7f1206f8742da5d008acf7562bfc970a2d49f" exitCode=0
Jul 28 08:14:56.171484 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:56.171035    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" event={"ID":"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9","Type":"ContainerDied","Data":"4141c2a9c48f14c50cf92a453ac7f1206f8742da5d008acf7562bfc970a2d49f"}
Jul 28 08:14:57.177048 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:57.177013    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" event={"ID":"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9","Type":"ContainerStarted","Data":"9cce7942ed6b12447cf22fb1d45c96a731da531439cd1441f71516b551b87a9e"}
Jul 28 08:14:57.878227 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:57.878178    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
Jul 28 08:14:57.878427 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:57.878192    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Jul 28 08:14:59.233477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.233416    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84b8f44b84-7k5hw" podUID="bdf1bc2c-8229-4788-bc52-9dbee3903abb" containerName="console" containerID="cri-o://9d1007c7efd9a89e2d3643e0d705e2b4ee0a88a390e1413e420b5190fa1cfa8b" gracePeriod=15
Jul 28 08:14:59.495061 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.494993    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:14:59.535959 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.535929    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-oauth-serving-cert\") pod \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") "
Jul 28 08:14:59.535959 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.535966    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-trusted-ca-bundle\") pod \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") "
Jul 28 08:14:59.536187 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.536020    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-service-ca\") pod \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") "
Jul 28 08:14:59.536187 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.536051    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bdf1bc2c-8229-4788-bc52-9dbee3903abb-console-oauth-config\") pod \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") "
Jul 28 08:14:59.536187 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.536077    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bdf1bc2c-8229-4788-bc52-9dbee3903abb-console-serving-cert\") pod \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") "
Jul 28 08:14:59.536568 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.536422    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-console-config\") pod \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") "
Jul 28 08:14:59.536568 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.536501    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hh2f6\" (UniqueName: \"kubernetes.io/projected/bdf1bc2c-8229-4788-bc52-9dbee3903abb-kube-api-access-hh2f6\") pod \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\" (UID: \"bdf1bc2c-8229-4788-bc52-9dbee3903abb\") "
Jul 28 08:14:59.536727 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.536424    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bdf1bc2c-8229-4788-bc52-9dbee3903abb" (UID: "bdf1bc2c-8229-4788-bc52-9dbee3903abb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 08:14:59.536727 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.536684    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-service-ca" (OuterVolumeSpecName: "service-ca") pod "bdf1bc2c-8229-4788-bc52-9dbee3903abb" (UID: "bdf1bc2c-8229-4788-bc52-9dbee3903abb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 08:14:59.536825 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.536789    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-oauth-serving-cert\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:14:59.536825 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.536809    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-service-ca\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:14:59.536934 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.536857    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-console-config" (OuterVolumeSpecName: "console-config") pod "bdf1bc2c-8229-4788-bc52-9dbee3903abb" (UID: "bdf1bc2c-8229-4788-bc52-9dbee3903abb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 08:14:59.537064 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.536592    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bdf1bc2c-8229-4788-bc52-9dbee3903abb" (UID: "bdf1bc2c-8229-4788-bc52-9dbee3903abb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 08:14:59.538649 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.538620    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdf1bc2c-8229-4788-bc52-9dbee3903abb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bdf1bc2c-8229-4788-bc52-9dbee3903abb" (UID: "bdf1bc2c-8229-4788-bc52-9dbee3903abb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:14:59.538744 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.538729    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdf1bc2c-8229-4788-bc52-9dbee3903abb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bdf1bc2c-8229-4788-bc52-9dbee3903abb" (UID: "bdf1bc2c-8229-4788-bc52-9dbee3903abb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:14:59.539173 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.539157    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdf1bc2c-8229-4788-bc52-9dbee3903abb-kube-api-access-hh2f6" (OuterVolumeSpecName: "kube-api-access-hh2f6") pod "bdf1bc2c-8229-4788-bc52-9dbee3903abb" (UID: "bdf1bc2c-8229-4788-bc52-9dbee3903abb"). InnerVolumeSpecName "kube-api-access-hh2f6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:14:59.637516 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.637482    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-console-config\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:14:59.637516 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.637511    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hh2f6\" (UniqueName: \"kubernetes.io/projected/bdf1bc2c-8229-4788-bc52-9dbee3903abb-kube-api-access-hh2f6\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:14:59.637516 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.637521    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdf1bc2c-8229-4788-bc52-9dbee3903abb-trusted-ca-bundle\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:14:59.637741 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.637529    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bdf1bc2c-8229-4788-bc52-9dbee3903abb-console-oauth-config\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:14:59.637741 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:14:59.637538    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bdf1bc2c-8229-4788-bc52-9dbee3903abb-console-serving-cert\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:15:00.194323 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:00.194286    2583 generic.go:356] "Generic (PLEG): container finished" podID="bdf1bc2c-8229-4788-bc52-9dbee3903abb" containerID="9d1007c7efd9a89e2d3643e0d705e2b4ee0a88a390e1413e420b5190fa1cfa8b" exitCode=0
Jul 28 08:15:00.194515 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:00.194329    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b8f44b84-7k5hw"
Jul 28 08:15:00.194515 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:00.194360    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b8f44b84-7k5hw" event={"ID":"bdf1bc2c-8229-4788-bc52-9dbee3903abb","Type":"ContainerDied","Data":"9d1007c7efd9a89e2d3643e0d705e2b4ee0a88a390e1413e420b5190fa1cfa8b"}
Jul 28 08:15:00.194515 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:00.194418    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b8f44b84-7k5hw" event={"ID":"bdf1bc2c-8229-4788-bc52-9dbee3903abb","Type":"ContainerDied","Data":"45dffcfbd89a750a48d302937fef05b40a491d6c973084728938379b44ce7ba2"}
Jul 28 08:15:00.194515 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:00.194468    2583 scope.go:117] "RemoveContainer" containerID="9d1007c7efd9a89e2d3643e0d705e2b4ee0a88a390e1413e420b5190fa1cfa8b"
Jul 28 08:15:00.204036 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:00.204011    2583 scope.go:117] "RemoveContainer" containerID="9d1007c7efd9a89e2d3643e0d705e2b4ee0a88a390e1413e420b5190fa1cfa8b"
Jul 28 08:15:00.204379 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:15:00.204356    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d1007c7efd9a89e2d3643e0d705e2b4ee0a88a390e1413e420b5190fa1cfa8b\": container with ID starting with 9d1007c7efd9a89e2d3643e0d705e2b4ee0a88a390e1413e420b5190fa1cfa8b not found: ID does not exist" containerID="9d1007c7efd9a89e2d3643e0d705e2b4ee0a88a390e1413e420b5190fa1cfa8b"
Jul 28 08:15:00.204427 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:00.204389    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d1007c7efd9a89e2d3643e0d705e2b4ee0a88a390e1413e420b5190fa1cfa8b"} err="failed to get container status \"9d1007c7efd9a89e2d3643e0d705e2b4ee0a88a390e1413e420b5190fa1cfa8b\": rpc error: code = NotFound desc = could not find container \"9d1007c7efd9a89e2d3643e0d705e2b4ee0a88a390e1413e420b5190fa1cfa8b\": container with ID starting with 9d1007c7efd9a89e2d3643e0d705e2b4ee0a88a390e1413e420b5190fa1cfa8b not found: ID does not exist"
Jul 28 08:15:00.216189 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:00.216151    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84b8f44b84-7k5hw"]
Jul 28 08:15:00.221355 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:00.221320    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84b8f44b84-7k5hw"]
Jul 28 08:15:01.334351 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:01.334315    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdf1bc2c-8229-4788-bc52-9dbee3903abb" path="/var/lib/kubelet/pods/bdf1bc2c-8229-4788-bc52-9dbee3903abb/volumes"
Jul 28 08:15:02.212908 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:02.212876    2583 generic.go:356] "Generic (PLEG): container finished" podID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerID="9cce7942ed6b12447cf22fb1d45c96a731da531439cd1441f71516b551b87a9e" exitCode=0
Jul 28 08:15:02.213072 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:02.212943    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" event={"ID":"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9","Type":"ContainerDied","Data":"9cce7942ed6b12447cf22fb1d45c96a731da531439cd1441f71516b551b87a9e"}
Jul 28 08:15:03.223822 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:03.223772    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" event={"ID":"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9","Type":"ContainerStarted","Data":"99c623e6d931fd5a476ea5433c173afd43a2763671f189c7a758d8c8e54b1647"}
Jul 28 08:15:03.224273 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:03.223853    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" event={"ID":"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9","Type":"ContainerStarted","Data":"3364c361651c877b9894f98e3644dd04ab46080f14ddb0184d631db7e6746801"}
Jul 28 08:15:03.224273 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:03.223878    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" event={"ID":"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9","Type":"ContainerStarted","Data":"d6f0e3754d816f9cccc4c4249b74836c4da9c85283aa26286913541392884a9e"}
Jul 28 08:15:03.224273 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:03.223897    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" event={"ID":"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9","Type":"ContainerStarted","Data":"18c543123e76284819eebc944ba558437a677d3e7a1c68951aa6974abffe1886"}
Jul 28 08:15:03.252017 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:03.251942    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" podStartSLOduration=14.251916222 podStartE2EDuration="14.251916222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:14:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:15:03.249861308 +0000 UTC m=+738.437049432" watchObservedRunningTime="2026-07-28 08:15:03.251916222 +0000 UTC m=+738.439104354"
Jul 28 08:15:05.295114 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:05.295080    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:15:05.295734 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:05.295703    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:15:05.295734 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:05.295735    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:15:05.295921 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:05.295755    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:15:05.297284 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:05.297245    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Jul 28 08:15:05.297284 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:05.297269    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused"
Jul 28 08:15:05.297483 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:05.297264    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.27:6571: connect: connection refused"
Jul 28 08:15:05.297483 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:05.297424    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Jul 28 08:15:07.877798 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:07.877747    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
Jul 28 08:15:07.878589 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:07.877829    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Jul 28 08:15:08.295275 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:08.295167    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Jul 28 08:15:08.296206 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:08.296181    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:15:08.296357 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:08.296283    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:15:08.296788 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:08.296764    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:15:08.296915 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:08.296801    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:15:08.297118 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:08.297094    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:15:08.297222 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:08.297168    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:15:08.388526 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:08.388490    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:15:09.258944 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:09.258912    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:15:09.262473 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:09.262434    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:15:10.295205 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:10.295167    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:15:11.295742 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:11.295711    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:15:12.273558 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:12.273525    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:15:17.877588 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:17.877530    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
Jul 28 08:15:17.878039 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:17.877540    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Jul 28 08:15:17.878039 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:17.877694    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:15:17.878039 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:17.877784    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:15:19.306468 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:19.306420    2583 generic.go:356] "Generic (PLEG): container finished" podID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerID="560652f83f6043854348ff994b5bdd1985e31217ca3d94be738fe86d45cc0962" exitCode=137
Jul 28 08:15:19.306468 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:19.306458    2583 generic.go:356] "Generic (PLEG): container finished" podID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerID="43de53baea753b3d316716bc28bcb06810c6d3c5be534318aebc4842014f0fb0" exitCode=137
Jul 28 08:15:19.306878 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:19.306488    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" event={"ID":"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3","Type":"ContainerDied","Data":"560652f83f6043854348ff994b5bdd1985e31217ca3d94be738fe86d45cc0962"}
Jul 28 08:15:19.306878 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:19.306529    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" event={"ID":"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3","Type":"ContainerDied","Data":"43de53baea753b3d316716bc28bcb06810c6d3c5be534318aebc4842014f0fb0"}
Jul 28 08:15:19.768029 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:19.767999    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:15:19.921375 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:19.921270    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glp9c\" (UniqueName: \"kubernetes.io/projected/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-kube-api-access-glp9c\") pod \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") "
Jul 28 08:15:19.921375 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:19.921345    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-feast-data\") pod \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") "
Jul 28 08:15:19.921375 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:19.921376    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-online-tls\") pod \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") "
Jul 28 08:15:19.921683 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:19.921426    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-offline-tls\") pod \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") "
Jul 28 08:15:19.921683 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:19.921487    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-registry-tls\") pod \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") "
Jul 28 08:15:19.921683 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:19.921511    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-ui-tls\") pod \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\" (UID: \"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3\") "
Jul 28 08:15:19.921963 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:19.921936    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-feast-data" (OuterVolumeSpecName: "feast-data") pod "4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" (UID: "4bb15280-fd9c-4ef5-a1ee-11265c7aafb3"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 08:15:19.924052 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:19.924022    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" (UID: "4bb15280-fd9c-4ef5-a1ee-11265c7aafb3"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:15:19.924176 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:19.924160    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" (UID: "4bb15280-fd9c-4ef5-a1ee-11265c7aafb3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:15:19.924309 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:19.924280    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-kube-api-access-glp9c" (OuterVolumeSpecName: "kube-api-access-glp9c") pod "4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" (UID: "4bb15280-fd9c-4ef5-a1ee-11265c7aafb3"). InnerVolumeSpecName "kube-api-access-glp9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:15:19.924367 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:19.924332    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" (UID: "4bb15280-fd9c-4ef5-a1ee-11265c7aafb3"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:15:19.924367 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:19.924350    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-online-tls" (OuterVolumeSpecName: "online-tls") pod "4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" (UID: "4bb15280-fd9c-4ef5-a1ee-11265c7aafb3"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:15:20.022515 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:20.022474    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-offline-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:15:20.022515 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:20.022505    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-registry-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:15:20.022515 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:20.022515    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-ui-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:15:20.022515 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:20.022523    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glp9c\" (UniqueName: \"kubernetes.io/projected/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-kube-api-access-glp9c\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:15:20.022784 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:20.022532    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-feast-data\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:15:20.022784 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:20.022540    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3-online-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:15:20.313522 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:20.313422    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"
Jul 28 08:15:20.313522 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:20.313426    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj" event={"ID":"4bb15280-fd9c-4ef5-a1ee-11265c7aafb3","Type":"ContainerDied","Data":"1b6dc9342a92361f8cab095150aeae732ced3b0f28e226ae131fcb50c974327c"}
Jul 28 08:15:20.313522 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:20.313505    2583 scope.go:117] "RemoveContainer" containerID="ae7495001af901742b9e34c09bcce884c963a121c3941b22e1aa067ef356ad35"
Jul 28 08:15:20.322880 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:20.322862    2583 scope.go:117] "RemoveContainer" containerID="560652f83f6043854348ff994b5bdd1985e31217ca3d94be738fe86d45cc0962"
Jul 28 08:15:20.330868 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:20.330848    2583 scope.go:117] "RemoveContainer" containerID="0abd8473d23c92a5dd2fe0580fa034745069441b1b84319774cc5478fcf8073e"
Jul 28 08:15:20.335981 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:20.335951    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"]
Jul 28 08:15:20.339467 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:20.339417    2583 scope.go:117] "RemoveContainer" containerID="43de53baea753b3d316716bc28bcb06810c6d3c5be534318aebc4842014f0fb0"
Jul 28 08:15:20.341415 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:20.341392    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74c44d6f4-hwxjj"]
Jul 28 08:15:20.349793 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:20.349770    2583 scope.go:117] "RemoveContainer" containerID="70cd71043ca5172040676d52afc6b17eaed5b82bd55dd0a25cd4094fda9c300f"
Jul 28 08:15:20.357861 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:20.357843    2583 scope.go:117] "RemoveContainer" containerID="5ee47e1bf055eb8955b0b7a37ae96e072ea50ed7e902feab441da7c8847847df"
Jul 28 08:15:21.334304 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:15:21.334270    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" path="/var/lib/kubelet/pods/4bb15280-fd9c-4ef5-a1ee-11265c7aafb3/volumes"
Jul 28 08:16:15.194061 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.194025    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"]
Jul 28 08:16:15.194509 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.194336    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="feast-apply"
Jul 28 08:16:15.194509 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.194345    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="feast-apply"
Jul 28 08:16:15.194509 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.194358    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="offline"
Jul 28 08:16:15.194509 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.194364    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="offline"
Jul 28 08:16:15.194509 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.194371    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdf1bc2c-8229-4788-bc52-9dbee3903abb" containerName="console"
Jul 28 08:16:15.194509 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.194376    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdf1bc2c-8229-4788-bc52-9dbee3903abb" containerName="console"
Jul 28 08:16:15.194509 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.194393    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="registry"
Jul 28 08:16:15.194509 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.194398    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="registry"
Jul 28 08:16:15.194509 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.194406    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="online"
Jul 28 08:16:15.194509 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.194412    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="online"
Jul 28 08:16:15.194509 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.194420    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="feast-init"
Jul 28 08:16:15.194509 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.194425    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="feast-init"
Jul 28 08:16:15.194509 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.194432    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="ui"
Jul 28 08:16:15.194509 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.194436    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="ui"
Jul 28 08:16:15.194509 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.194503    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="ui"
Jul 28 08:16:15.194509 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.194512    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="online"
Jul 28 08:16:15.194509 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.194519    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="offline"
Jul 28 08:16:15.195007 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.194526    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdf1bc2c-8229-4788-bc52-9dbee3903abb" containerName="console"
Jul 28 08:16:15.195007 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.194531    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bb15280-fd9c-4ef5-a1ee-11265c7aafb3" containerName="registry"
Jul 28 08:16:15.197722 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.197706    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:15.200047 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.200020    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jul 28 08:16:15.200184 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.200168    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jul 28 08:16:15.200264 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.200194    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jul 28 08:16:15.200322 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.200267    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Jul 28 08:16:15.200322 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.200296    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jul 28 08:16:15.200322 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.200310    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-snfpn\""
Jul 28 08:16:15.200509 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.200315    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jul 28 08:16:15.200665 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.200649    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jul 28 08:16:15.208679 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.208658    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"]
Jul 28 08:16:15.284974 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.284936    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a9fb3972-29ee-42d3-acaa-50473f360ea7-online-tls\") pod \"feast-simple-feast-remote-setup-778689cc46-9mnss\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:15.285168 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.285009    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a9fb3972-29ee-42d3-acaa-50473f360ea7-registry-tls\") pod \"feast-simple-feast-remote-setup-778689cc46-9mnss\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:15.285168 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.285043    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a9fb3972-29ee-42d3-acaa-50473f360ea7-offline-tls\") pod \"feast-simple-feast-remote-setup-778689cc46-9mnss\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:15.285168 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.285057    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a9fb3972-29ee-42d3-acaa-50473f360ea7-ui-tls\") pod \"feast-simple-feast-remote-setup-778689cc46-9mnss\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:15.285168 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.285080    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a9fb3972-29ee-42d3-acaa-50473f360ea7-feast-data\") pod \"feast-simple-feast-remote-setup-778689cc46-9mnss\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:15.285168 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.285112    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn86h\" (UniqueName: \"kubernetes.io/projected/a9fb3972-29ee-42d3-acaa-50473f360ea7-kube-api-access-cn86h\") pod \"feast-simple-feast-remote-setup-778689cc46-9mnss\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:15.386533 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.386501    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a9fb3972-29ee-42d3-acaa-50473f360ea7-registry-tls\") pod \"feast-simple-feast-remote-setup-778689cc46-9mnss\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:15.386746 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.386542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a9fb3972-29ee-42d3-acaa-50473f360ea7-offline-tls\") pod \"feast-simple-feast-remote-setup-778689cc46-9mnss\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:15.386746 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.386559    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a9fb3972-29ee-42d3-acaa-50473f360ea7-ui-tls\") pod \"feast-simple-feast-remote-setup-778689cc46-9mnss\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:15.386746 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.386579    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a9fb3972-29ee-42d3-acaa-50473f360ea7-feast-data\") pod \"feast-simple-feast-remote-setup-778689cc46-9mnss\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:15.386746 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.386611    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn86h\" (UniqueName: \"kubernetes.io/projected/a9fb3972-29ee-42d3-acaa-50473f360ea7-kube-api-access-cn86h\") pod \"feast-simple-feast-remote-setup-778689cc46-9mnss\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:15.386746 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:16:15.386675    2583 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
Jul 28 08:16:15.386746 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.386701    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a9fb3972-29ee-42d3-acaa-50473f360ea7-online-tls\") pod \"feast-simple-feast-remote-setup-778689cc46-9mnss\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:15.386746 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:16:15.386741    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9fb3972-29ee-42d3-acaa-50473f360ea7-offline-tls podName:a9fb3972-29ee-42d3-acaa-50473f360ea7 nodeName:}" failed. No retries permitted until 2026-07-28 08:16:15.886720619 +0000 UTC m=+811.073908753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/a9fb3972-29ee-42d3-acaa-50473f360ea7-offline-tls") pod "feast-simple-feast-remote-setup-778689cc46-9mnss" (UID: "a9fb3972-29ee-42d3-acaa-50473f360ea7") : secret "feast-simple-feast-remote-setup-offline-tls" not found
Jul 28 08:16:15.387121 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.387016    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a9fb3972-29ee-42d3-acaa-50473f360ea7-feast-data\") pod \"feast-simple-feast-remote-setup-778689cc46-9mnss\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:15.387323 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.387301    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a9fb3972-29ee-42d3-acaa-50473f360ea7-registry-tls\") pod \"feast-simple-feast-remote-setup-778689cc46-9mnss\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:15.389167 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.389146    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a9fb3972-29ee-42d3-acaa-50473f360ea7-ui-tls\") pod \"feast-simple-feast-remote-setup-778689cc46-9mnss\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:15.389290 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.389274    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a9fb3972-29ee-42d3-acaa-50473f360ea7-online-tls\") pod \"feast-simple-feast-remote-setup-778689cc46-9mnss\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:15.398089 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.398058    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn86h\" (UniqueName: \"kubernetes.io/projected/a9fb3972-29ee-42d3-acaa-50473f360ea7-kube-api-access-cn86h\") pod \"feast-simple-feast-remote-setup-778689cc46-9mnss\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:15.891902 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.891866    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a9fb3972-29ee-42d3-acaa-50473f360ea7-offline-tls\") pod \"feast-simple-feast-remote-setup-778689cc46-9mnss\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:15.894402 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:15.894372    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a9fb3972-29ee-42d3-acaa-50473f360ea7-offline-tls\") pod \"feast-simple-feast-remote-setup-778689cc46-9mnss\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:16.107821 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:16.107781    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:16.248744 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:16.248710    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"]
Jul 28 08:16:16.251994 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:16:16.251968    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9fb3972_29ee_42d3_acaa_50473f360ea7.slice/crio-1eec32d72291a0d93f427f549a61f050f1d0a69353f12b2aa1eeb6c2c4962985 WatchSource:0}: Error finding container 1eec32d72291a0d93f427f549a61f050f1d0a69353f12b2aa1eeb6c2c4962985: Status 404 returned error can't find the container with id 1eec32d72291a0d93f427f549a61f050f1d0a69353f12b2aa1eeb6c2c4962985
Jul 28 08:16:16.552917 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:16.552830    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" event={"ID":"a9fb3972-29ee-42d3-acaa-50473f360ea7","Type":"ContainerStarted","Data":"1a142f0504df785e50991020b777e8966a549e6ec26d8487137146cdbd888395"}
Jul 28 08:16:16.553150 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:16.553134    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" event={"ID":"a9fb3972-29ee-42d3-acaa-50473f360ea7","Type":"ContainerStarted","Data":"1eec32d72291a0d93f427f549a61f050f1d0a69353f12b2aa1eeb6c2c4962985"}
Jul 28 08:16:21.575180 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:21.575143    2583 generic.go:356] "Generic (PLEG): container finished" podID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerID="1a142f0504df785e50991020b777e8966a549e6ec26d8487137146cdbd888395" exitCode=0
Jul 28 08:16:21.575690 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:21.575221    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" event={"ID":"a9fb3972-29ee-42d3-acaa-50473f360ea7","Type":"ContainerDied","Data":"1a142f0504df785e50991020b777e8966a549e6ec26d8487137146cdbd888395"}
Jul 28 08:16:22.581116 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:22.581085    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" event={"ID":"a9fb3972-29ee-42d3-acaa-50473f360ea7","Type":"ContainerStarted","Data":"51a9893b78aab52ca2a20374ff4e27fe23159b2814e2d978cbabf47bda9f366d"}
Jul 28 08:16:27.605477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:27.605428    2583 generic.go:356] "Generic (PLEG): container finished" podID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerID="51a9893b78aab52ca2a20374ff4e27fe23159b2814e2d978cbabf47bda9f366d" exitCode=0
Jul 28 08:16:27.605821 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:27.605472    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" event={"ID":"a9fb3972-29ee-42d3-acaa-50473f360ea7","Type":"ContainerDied","Data":"51a9893b78aab52ca2a20374ff4e27fe23159b2814e2d978cbabf47bda9f366d"}
Jul 28 08:16:28.614402 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:28.614364    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" event={"ID":"a9fb3972-29ee-42d3-acaa-50473f360ea7","Type":"ContainerStarted","Data":"72cf8b8da49eb56da9341d664d104d16a6e6d93f7dbbcaf88f06fa16f735d95d"}
Jul 28 08:16:28.614890 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:28.614415    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" event={"ID":"a9fb3972-29ee-42d3-acaa-50473f360ea7","Type":"ContainerStarted","Data":"a036a51ead6b5e9d618e4c16c41ae7343fa10093d5e7a243bf7a21c14e8b006a"}
Jul 28 08:16:28.614890 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:28.614429    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" event={"ID":"a9fb3972-29ee-42d3-acaa-50473f360ea7","Type":"ContainerStarted","Data":"59023d91a44f75263661b1bc76ee257bbb05f2840ebfca08a1906a34d644ef4e"}
Jul 28 08:16:28.639796 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:28.639734    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" podStartSLOduration=13.639713072 podStartE2EDuration="13.639713072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:16:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:16:28.637121568 +0000 UTC m=+823.824309699" watchObservedRunningTime="2026-07-28 08:16:28.639713072 +0000 UTC m=+823.826901204"
Jul 28 08:16:31.108806 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:31.108765    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:31.109307 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:31.108835    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:31.109307 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:31.108855    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:31.110350 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:31.110317    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Jul 28 08:16:31.110510 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:31.110358    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Jul 28 08:16:31.110510 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:31.110362    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.28:8816: connect: connection refused"
Jul 28 08:16:34.109097 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:34.109061    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:34.109602 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:34.109236    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:34.109736 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:34.109634    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:34.109736 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:34.109676    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:34.110063 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:34.110041    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:34.110194 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:34.110179    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:34.115637 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:34.115615    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:34.646029 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:34.645995    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:16:34.650815 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:16:34.650789    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:17:36.422102 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:36.418484    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"]
Jul 28 08:17:36.423486 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:36.423115    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="online" containerID="cri-o://59023d91a44f75263661b1bc76ee257bbb05f2840ebfca08a1906a34d644ef4e" gracePeriod=30
Jul 28 08:17:36.423634 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:36.423528    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="ui" containerID="cri-o://72cf8b8da49eb56da9341d664d104d16a6e6d93f7dbbcaf88f06fa16f735d95d" gracePeriod=30
Jul 28 08:17:36.425773 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:36.423728    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="offline" containerID="cri-o://a036a51ead6b5e9d618e4c16c41ae7343fa10093d5e7a243bf7a21c14e8b006a" gracePeriod=30
Jul 28 08:17:36.529804 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:36.529764    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"]
Jul 28 08:17:36.530093 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:36.530039    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="registry" containerID="cri-o://18c543123e76284819eebc944ba558437a677d3e7a1c68951aa6974abffe1886" gracePeriod=30
Jul 28 08:17:36.530236 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:36.530133    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="online" containerID="cri-o://d6f0e3754d816f9cccc4c4249b74836c4da9c85283aa26286913541392884a9e" gracePeriod=30
Jul 28 08:17:36.530236 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:36.530096    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="offline" containerID="cri-o://3364c361651c877b9894f98e3644dd04ab46080f14ddb0184d631db7e6746801" gracePeriod=30
Jul 28 08:17:36.530236 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:36.530096    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="ui" containerID="cri-o://99c623e6d931fd5a476ea5433c173afd43a2763671f189c7a758d8c8e54b1647" gracePeriod=30
Jul 28 08:17:37.919121 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:37.919081    2583 generic.go:356] "Generic (PLEG): container finished" podID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerID="72cf8b8da49eb56da9341d664d104d16a6e6d93f7dbbcaf88f06fa16f735d95d" exitCode=0
Jul 28 08:17:37.919121 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:37.919107    2583 generic.go:356] "Generic (PLEG): container finished" podID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerID="59023d91a44f75263661b1bc76ee257bbb05f2840ebfca08a1906a34d644ef4e" exitCode=0
Jul 28 08:17:37.919613 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:37.919153    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" event={"ID":"a9fb3972-29ee-42d3-acaa-50473f360ea7","Type":"ContainerDied","Data":"72cf8b8da49eb56da9341d664d104d16a6e6d93f7dbbcaf88f06fa16f735d95d"}
Jul 28 08:17:37.919613 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:37.919202    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" event={"ID":"a9fb3972-29ee-42d3-acaa-50473f360ea7","Type":"ContainerDied","Data":"59023d91a44f75263661b1bc76ee257bbb05f2840ebfca08a1906a34d644ef4e"}
Jul 28 08:17:37.922228 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:37.922202    2583 generic.go:356] "Generic (PLEG): container finished" podID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerID="99c623e6d931fd5a476ea5433c173afd43a2763671f189c7a758d8c8e54b1647" exitCode=0
Jul 28 08:17:37.922228 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:37.922224    2583 generic.go:356] "Generic (PLEG): container finished" podID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerID="d6f0e3754d816f9cccc4c4249b74836c4da9c85283aa26286913541392884a9e" exitCode=0
Jul 28 08:17:37.922406 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:37.922249    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" event={"ID":"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9","Type":"ContainerDied","Data":"99c623e6d931fd5a476ea5433c173afd43a2763671f189c7a758d8c8e54b1647"}
Jul 28 08:17:37.922406 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:37.922287    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" event={"ID":"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9","Type":"ContainerDied","Data":"d6f0e3754d816f9cccc4c4249b74836c4da9c85283aa26286913541392884a9e"}
Jul 28 08:17:39.259864 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:39.259822    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Jul 28 08:17:42.273085 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:42.273040    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Jul 28 08:17:44.110070 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:44.110017    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Jul 28 08:17:44.647026 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:44.646982    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Jul 28 08:17:48.541075 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:48.540963    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vgzf4_dcf82623-a4f7-4511-aed0-7248950f1ca1/console-operator/1.log"
Jul 28 08:17:48.545254 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:48.543181    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vgzf4_dcf82623-a4f7-4511-aed0-7248950f1ca1/console-operator/1.log"
Jul 28 08:17:48.548157 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:48.548139    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-acl-logging/0.log"
Jul 28 08:17:48.550315 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:48.550298    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-acl-logging/0.log"
Jul 28 08:17:49.259375 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:49.259334    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Jul 28 08:17:52.273822 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:52.273764    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Jul 28 08:17:54.109844 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:54.109798    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Jul 28 08:17:54.647021 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:54.646978    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Jul 28 08:17:59.259692 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:59.259651    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Jul 28 08:17:59.260097 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:17:59.259778    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:18:02.273557 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:02.273511    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Jul 28 08:18:02.273971 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:02.273651    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:18:04.110372 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:04.110326    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Jul 28 08:18:04.110913 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:04.110519    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:18:04.646836 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:04.646795    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Jul 28 08:18:04.647039 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:04.646910    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:18:06.652439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:06.652412    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:18:06.748833 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:06.748752    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a9fb3972-29ee-42d3-acaa-50473f360ea7-registry-tls\") pod \"a9fb3972-29ee-42d3-acaa-50473f360ea7\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") "
Jul 28 08:18:06.748833 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:06.748791    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a9fb3972-29ee-42d3-acaa-50473f360ea7-feast-data\") pod \"a9fb3972-29ee-42d3-acaa-50473f360ea7\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") "
Jul 28 08:18:06.748833 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:06.748815    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a9fb3972-29ee-42d3-acaa-50473f360ea7-online-tls\") pod \"a9fb3972-29ee-42d3-acaa-50473f360ea7\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") "
Jul 28 08:18:06.749107 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:06.748851    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a9fb3972-29ee-42d3-acaa-50473f360ea7-offline-tls\") pod \"a9fb3972-29ee-42d3-acaa-50473f360ea7\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") "
Jul 28 08:18:06.749107 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:06.748894    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a9fb3972-29ee-42d3-acaa-50473f360ea7-ui-tls\") pod \"a9fb3972-29ee-42d3-acaa-50473f360ea7\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") "
Jul 28 08:18:06.749107 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:06.748923    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cn86h\" (UniqueName: \"kubernetes.io/projected/a9fb3972-29ee-42d3-acaa-50473f360ea7-kube-api-access-cn86h\") pod \"a9fb3972-29ee-42d3-acaa-50473f360ea7\" (UID: \"a9fb3972-29ee-42d3-acaa-50473f360ea7\") "
Jul 28 08:18:06.749265 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:06.749195    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9fb3972-29ee-42d3-acaa-50473f360ea7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a9fb3972-29ee-42d3-acaa-50473f360ea7" (UID: "a9fb3972-29ee-42d3-acaa-50473f360ea7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 08:18:06.749397 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:06.749360    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9fb3972-29ee-42d3-acaa-50473f360ea7-feast-data" (OuterVolumeSpecName: "feast-data") pod "a9fb3972-29ee-42d3-acaa-50473f360ea7" (UID: "a9fb3972-29ee-42d3-acaa-50473f360ea7"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 08:18:06.751381 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:06.751345    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9fb3972-29ee-42d3-acaa-50473f360ea7-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "a9fb3972-29ee-42d3-acaa-50473f360ea7" (UID: "a9fb3972-29ee-42d3-acaa-50473f360ea7"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:18:06.751513 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:06.751392    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9fb3972-29ee-42d3-acaa-50473f360ea7-online-tls" (OuterVolumeSpecName: "online-tls") pod "a9fb3972-29ee-42d3-acaa-50473f360ea7" (UID: "a9fb3972-29ee-42d3-acaa-50473f360ea7"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:18:06.751513 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:06.751404    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9fb3972-29ee-42d3-acaa-50473f360ea7-kube-api-access-cn86h" (OuterVolumeSpecName: "kube-api-access-cn86h") pod "a9fb3972-29ee-42d3-acaa-50473f360ea7" (UID: "a9fb3972-29ee-42d3-acaa-50473f360ea7"). InnerVolumeSpecName "kube-api-access-cn86h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:18:06.751513 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:06.751427    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9fb3972-29ee-42d3-acaa-50473f360ea7-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a9fb3972-29ee-42d3-acaa-50473f360ea7" (UID: "a9fb3972-29ee-42d3-acaa-50473f360ea7"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:18:06.850229 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:06.850193    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a9fb3972-29ee-42d3-acaa-50473f360ea7-registry-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:18:06.850229 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:06.850222    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a9fb3972-29ee-42d3-acaa-50473f360ea7-feast-data\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:18:06.850229 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:06.850232    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a9fb3972-29ee-42d3-acaa-50473f360ea7-online-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:18:06.850229 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:06.850239    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a9fb3972-29ee-42d3-acaa-50473f360ea7-offline-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:18:06.850515 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:06.850246    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a9fb3972-29ee-42d3-acaa-50473f360ea7-ui-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:18:06.850515 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:06.850254    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cn86h\" (UniqueName: \"kubernetes.io/projected/a9fb3972-29ee-42d3-acaa-50473f360ea7-kube-api-access-cn86h\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:18:07.052668 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.052638    2583 generic.go:356] "Generic (PLEG): container finished" podID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerID="a036a51ead6b5e9d618e4c16c41ae7343fa10093d5e7a243bf7a21c14e8b006a" exitCode=137
Jul 28 08:18:07.052792 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.052703    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"
Jul 28 08:18:07.052792 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.052721    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" event={"ID":"a9fb3972-29ee-42d3-acaa-50473f360ea7","Type":"ContainerDied","Data":"a036a51ead6b5e9d618e4c16c41ae7343fa10093d5e7a243bf7a21c14e8b006a"}
Jul 28 08:18:07.052792 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.052780    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss" event={"ID":"a9fb3972-29ee-42d3-acaa-50473f360ea7","Type":"ContainerDied","Data":"1eec32d72291a0d93f427f549a61f050f1d0a69353f12b2aa1eeb6c2c4962985"}
Jul 28 08:18:07.052916 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.052807    2583 scope.go:117] "RemoveContainer" containerID="72cf8b8da49eb56da9341d664d104d16a6e6d93f7dbbcaf88f06fa16f735d95d"
Jul 28 08:18:07.056601 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.056573    2583 generic.go:356] "Generic (PLEG): container finished" podID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerID="3364c361651c877b9894f98e3644dd04ab46080f14ddb0184d631db7e6746801" exitCode=137
Jul 28 08:18:07.056601 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.056600    2583 generic.go:356] "Generic (PLEG): container finished" podID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerID="18c543123e76284819eebc944ba558437a677d3e7a1c68951aa6974abffe1886" exitCode=137
Jul 28 08:18:07.056794 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.056690    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" event={"ID":"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9","Type":"ContainerDied","Data":"3364c361651c877b9894f98e3644dd04ab46080f14ddb0184d631db7e6746801"}
Jul 28 08:18:07.056794 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.056723    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" event={"ID":"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9","Type":"ContainerDied","Data":"18c543123e76284819eebc944ba558437a677d3e7a1c68951aa6974abffe1886"}
Jul 28 08:18:07.063794 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.063773    2583 scope.go:117] "RemoveContainer" containerID="a036a51ead6b5e9d618e4c16c41ae7343fa10093d5e7a243bf7a21c14e8b006a"
Jul 28 08:18:07.073091 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.073065    2583 scope.go:117] "RemoveContainer" containerID="59023d91a44f75263661b1bc76ee257bbb05f2840ebfca08a1906a34d644ef4e"
Jul 28 08:18:07.075862 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.075837    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"]
Jul 28 08:18:07.081529 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.081481    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-778689cc46-9mnss"]
Jul 28 08:18:07.082727 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.082701    2583 scope.go:117] "RemoveContainer" containerID="51a9893b78aab52ca2a20374ff4e27fe23159b2814e2d978cbabf47bda9f366d"
Jul 28 08:18:07.090842 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.090820    2583 scope.go:117] "RemoveContainer" containerID="1a142f0504df785e50991020b777e8966a549e6ec26d8487137146cdbd888395"
Jul 28 08:18:07.099441 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.099423    2583 scope.go:117] "RemoveContainer" containerID="72cf8b8da49eb56da9341d664d104d16a6e6d93f7dbbcaf88f06fa16f735d95d"
Jul 28 08:18:07.099737 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:18:07.099718    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72cf8b8da49eb56da9341d664d104d16a6e6d93f7dbbcaf88f06fa16f735d95d\": container with ID starting with 72cf8b8da49eb56da9341d664d104d16a6e6d93f7dbbcaf88f06fa16f735d95d not found: ID does not exist" containerID="72cf8b8da49eb56da9341d664d104d16a6e6d93f7dbbcaf88f06fa16f735d95d"
Jul 28 08:18:07.099797 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.099747    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72cf8b8da49eb56da9341d664d104d16a6e6d93f7dbbcaf88f06fa16f735d95d"} err="failed to get container status \"72cf8b8da49eb56da9341d664d104d16a6e6d93f7dbbcaf88f06fa16f735d95d\": rpc error: code = NotFound desc = could not find container \"72cf8b8da49eb56da9341d664d104d16a6e6d93f7dbbcaf88f06fa16f735d95d\": container with ID starting with 72cf8b8da49eb56da9341d664d104d16a6e6d93f7dbbcaf88f06fa16f735d95d not found: ID does not exist"
Jul 28 08:18:07.099797 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.099766    2583 scope.go:117] "RemoveContainer" containerID="a036a51ead6b5e9d618e4c16c41ae7343fa10093d5e7a243bf7a21c14e8b006a"
Jul 28 08:18:07.100058 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:18:07.100040    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a036a51ead6b5e9d618e4c16c41ae7343fa10093d5e7a243bf7a21c14e8b006a\": container with ID starting with a036a51ead6b5e9d618e4c16c41ae7343fa10093d5e7a243bf7a21c14e8b006a not found: ID does not exist" containerID="a036a51ead6b5e9d618e4c16c41ae7343fa10093d5e7a243bf7a21c14e8b006a"
Jul 28 08:18:07.100099 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.100070    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a036a51ead6b5e9d618e4c16c41ae7343fa10093d5e7a243bf7a21c14e8b006a"} err="failed to get container status \"a036a51ead6b5e9d618e4c16c41ae7343fa10093d5e7a243bf7a21c14e8b006a\": rpc error: code = NotFound desc = could not find container \"a036a51ead6b5e9d618e4c16c41ae7343fa10093d5e7a243bf7a21c14e8b006a\": container with ID starting with a036a51ead6b5e9d618e4c16c41ae7343fa10093d5e7a243bf7a21c14e8b006a not found: ID does not exist"
Jul 28 08:18:07.100099 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.100086    2583 scope.go:117] "RemoveContainer" containerID="59023d91a44f75263661b1bc76ee257bbb05f2840ebfca08a1906a34d644ef4e"
Jul 28 08:18:07.100304 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:18:07.100288    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59023d91a44f75263661b1bc76ee257bbb05f2840ebfca08a1906a34d644ef4e\": container with ID starting with 59023d91a44f75263661b1bc76ee257bbb05f2840ebfca08a1906a34d644ef4e not found: ID does not exist" containerID="59023d91a44f75263661b1bc76ee257bbb05f2840ebfca08a1906a34d644ef4e"
Jul 28 08:18:07.100362 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.100306    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59023d91a44f75263661b1bc76ee257bbb05f2840ebfca08a1906a34d644ef4e"} err="failed to get container status \"59023d91a44f75263661b1bc76ee257bbb05f2840ebfca08a1906a34d644ef4e\": rpc error: code = NotFound desc = could not find container \"59023d91a44f75263661b1bc76ee257bbb05f2840ebfca08a1906a34d644ef4e\": container with ID starting with 59023d91a44f75263661b1bc76ee257bbb05f2840ebfca08a1906a34d644ef4e not found: ID does not exist"
Jul 28 08:18:07.100362 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.100317    2583 scope.go:117] "RemoveContainer" containerID="51a9893b78aab52ca2a20374ff4e27fe23159b2814e2d978cbabf47bda9f366d"
Jul 28 08:18:07.100712 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:18:07.100695    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51a9893b78aab52ca2a20374ff4e27fe23159b2814e2d978cbabf47bda9f366d\": container with ID starting with 51a9893b78aab52ca2a20374ff4e27fe23159b2814e2d978cbabf47bda9f366d not found: ID does not exist" containerID="51a9893b78aab52ca2a20374ff4e27fe23159b2814e2d978cbabf47bda9f366d"
Jul 28 08:18:07.100760 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.100715    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51a9893b78aab52ca2a20374ff4e27fe23159b2814e2d978cbabf47bda9f366d"} err="failed to get container status \"51a9893b78aab52ca2a20374ff4e27fe23159b2814e2d978cbabf47bda9f366d\": rpc error: code = NotFound desc = could not find container \"51a9893b78aab52ca2a20374ff4e27fe23159b2814e2d978cbabf47bda9f366d\": container with ID starting with 51a9893b78aab52ca2a20374ff4e27fe23159b2814e2d978cbabf47bda9f366d not found: ID does not exist"
Jul 28 08:18:07.100760 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.100730    2583 scope.go:117] "RemoveContainer" containerID="1a142f0504df785e50991020b777e8966a549e6ec26d8487137146cdbd888395"
Jul 28 08:18:07.100983 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:18:07.100963    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a142f0504df785e50991020b777e8966a549e6ec26d8487137146cdbd888395\": container with ID starting with 1a142f0504df785e50991020b777e8966a549e6ec26d8487137146cdbd888395 not found: ID does not exist" containerID="1a142f0504df785e50991020b777e8966a549e6ec26d8487137146cdbd888395"
Jul 28 08:18:07.101026 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.100988    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a142f0504df785e50991020b777e8966a549e6ec26d8487137146cdbd888395"} err="failed to get container status \"1a142f0504df785e50991020b777e8966a549e6ec26d8487137146cdbd888395\": rpc error: code = NotFound desc = could not find container \"1a142f0504df785e50991020b777e8966a549e6ec26d8487137146cdbd888395\": container with ID starting with 1a142f0504df785e50991020b777e8966a549e6ec26d8487137146cdbd888395 not found: ID does not exist"
Jul 28 08:18:07.185647 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.185620    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:18:07.334551 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.334472    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" path="/var/lib/kubelet/pods/a9fb3972-29ee-42d3-acaa-50473f360ea7/volumes"
Jul 28 08:18:07.355085 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.355059    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klkqp\" (UniqueName: \"kubernetes.io/projected/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-kube-api-access-klkqp\") pod \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") "
Jul 28 08:18:07.355229 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.355100    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-online-tls\") pod \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") "
Jul 28 08:18:07.355229 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.355140    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-ui-tls\") pod \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") "
Jul 28 08:18:07.355229 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.355162    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-feast-data\") pod \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") "
Jul 28 08:18:07.355229 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.355176    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-offline-tls\") pod \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") "
Jul 28 08:18:07.355229 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.355209    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-registry-tls\") pod \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\" (UID: \"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9\") "
Jul 28 08:18:07.355780 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.355747    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-feast-data" (OuterVolumeSpecName: "feast-data") pod "a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" (UID: "a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 08:18:07.357541 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.357514    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" (UID: "a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:18:07.357667 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.357590    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" (UID: "a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:18:07.357706 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.357663    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" (UID: "a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:18:07.357911 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.357894    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-online-tls" (OuterVolumeSpecName: "online-tls") pod "a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" (UID: "a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:18:07.357974 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.357922    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-kube-api-access-klkqp" (OuterVolumeSpecName: "kube-api-access-klkqp") pod "a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" (UID: "a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9"). InnerVolumeSpecName "kube-api-access-klkqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:18:07.456814 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.456784    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klkqp\" (UniqueName: \"kubernetes.io/projected/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-kube-api-access-klkqp\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:18:07.456814 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.456815    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-online-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:18:07.456975 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.456827    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-ui-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:18:07.456975 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.456837    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-feast-data\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:18:07.456975 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.456844    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-offline-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:18:07.456975 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:07.456852    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9-registry-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:18:08.064462 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:08.064424    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"
Jul 28 08:18:08.064916 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:08.064416    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q" event={"ID":"a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9","Type":"ContainerDied","Data":"085cc6e6a58209f9b3c799bf9d744d04f09ddf005d8d0e63500858d3c3385489"}
Jul 28 08:18:08.064916 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:08.064565    2583 scope.go:117] "RemoveContainer" containerID="99c623e6d931fd5a476ea5433c173afd43a2763671f189c7a758d8c8e54b1647"
Jul 28 08:18:08.073407 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:08.073390    2583 scope.go:117] "RemoveContainer" containerID="3364c361651c877b9894f98e3644dd04ab46080f14ddb0184d631db7e6746801"
Jul 28 08:18:08.083477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:08.083433    2583 scope.go:117] "RemoveContainer" containerID="d6f0e3754d816f9cccc4c4249b74836c4da9c85283aa26286913541392884a9e"
Jul 28 08:18:08.087390 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:08.087365    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"]
Jul 28 08:18:08.093105 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:08.093086    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74c44d6f4-n6w6q"]
Jul 28 08:18:08.093614 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:08.093592    2583 scope.go:117] "RemoveContainer" containerID="18c543123e76284819eebc944ba558437a677d3e7a1c68951aa6974abffe1886"
Jul 28 08:18:08.101296 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:08.101268    2583 scope.go:117] "RemoveContainer" containerID="9cce7942ed6b12447cf22fb1d45c96a731da531439cd1441f71516b551b87a9e"
Jul 28 08:18:08.108520 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:08.108500    2583 scope.go:117] "RemoveContainer" containerID="4141c2a9c48f14c50cf92a453ac7f1206f8742da5d008acf7562bfc970a2d49f"
Jul 28 08:18:09.333981 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:09.333949    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" path="/var/lib/kubelet/pods/a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9/volumes"
Jul 28 08:18:19.540229 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540191    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-d8j7j"]
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540567    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="ui"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540581    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="ui"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540592    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="feast-apply"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540598    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="feast-apply"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540604    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="online"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540610    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="online"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540629    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="offline"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540637    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="offline"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540644    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="online"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540648    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="online"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540656    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="feast-init"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540662    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="feast-init"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540668    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="offline"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540672    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="offline"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540682    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="feast-apply"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540686    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="feast-apply"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540692    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="registry"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540698    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="registry"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540712    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="ui"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540718    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="ui"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540726    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="feast-init"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540731    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="feast-init"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540778    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="online"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540790    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="offline"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540800    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="registry"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540806    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="ui"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540814    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="ui"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540819    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a00e6e7c-4c3c-45e8-9ec3-1deb9976fee9" containerName="offline"
Jul 28 08:18:19.540886 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.540825    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9fb3972-29ee-42d3-acaa-50473f360ea7" containerName="online"
Jul 28 08:18:19.543922 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.543904    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-d8j7j"
Jul 28 08:18:19.546180 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.546158    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 28 08:18:19.547120 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.547091    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Jul 28 08:18:19.547120 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.547101    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 28 08:18:19.547296 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.547133    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-bwxdx\""
Jul 28 08:18:19.547973 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.547952    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/9ef86657-5460-44fd-b6bd-100878c85985-postgresdata\") pod \"postgres-864846d4f5-d8j7j\" (UID: \"9ef86657-5460-44fd-b6bd-100878c85985\") " pod="test-ns-feast/postgres-864846d4f5-d8j7j"
Jul 28 08:18:19.548093 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.548002    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6wtb\" (UniqueName: \"kubernetes.io/projected/9ef86657-5460-44fd-b6bd-100878c85985-kube-api-access-l6wtb\") pod \"postgres-864846d4f5-d8j7j\" (UID: \"9ef86657-5460-44fd-b6bd-100878c85985\") " pod="test-ns-feast/postgres-864846d4f5-d8j7j"
Jul 28 08:18:19.550667 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.550644    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-d8j7j"]
Jul 28 08:18:19.569847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.569822    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-4lpnw"]
Jul 28 08:18:19.573095 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.573076    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-4lpnw"
Jul 28 08:18:19.580335 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.580312    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-4lpnw"]
Jul 28 08:18:19.648717 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.648680    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/9ef86657-5460-44fd-b6bd-100878c85985-postgresdata\") pod \"postgres-864846d4f5-d8j7j\" (UID: \"9ef86657-5460-44fd-b6bd-100878c85985\") " pod="test-ns-feast/postgres-864846d4f5-d8j7j"
Jul 28 08:18:19.648915 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.648727    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6wtb\" (UniqueName: \"kubernetes.io/projected/9ef86657-5460-44fd-b6bd-100878c85985-kube-api-access-l6wtb\") pod \"postgres-864846d4f5-d8j7j\" (UID: \"9ef86657-5460-44fd-b6bd-100878c85985\") " pod="test-ns-feast/postgres-864846d4f5-d8j7j"
Jul 28 08:18:19.649079 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.649060    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/9ef86657-5460-44fd-b6bd-100878c85985-postgresdata\") pod \"postgres-864846d4f5-d8j7j\" (UID: \"9ef86657-5460-44fd-b6bd-100878c85985\") " pod="test-ns-feast/postgres-864846d4f5-d8j7j"
Jul 28 08:18:19.658465 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.658420    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6wtb\" (UniqueName: \"kubernetes.io/projected/9ef86657-5460-44fd-b6bd-100878c85985-kube-api-access-l6wtb\") pod \"postgres-864846d4f5-d8j7j\" (UID: \"9ef86657-5460-44fd-b6bd-100878c85985\") " pod="test-ns-feast/postgres-864846d4f5-d8j7j"
Jul 28 08:18:19.749547 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.749513    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6zs9\" (UniqueName: \"kubernetes.io/projected/112d02a0-6cf8-45f2-8e27-9ff370d4e873-kube-api-access-h6zs9\") pod \"redis-69bbd798b6-4lpnw\" (UID: \"112d02a0-6cf8-45f2-8e27-9ff370d4e873\") " pod="test-ns-feast/redis-69bbd798b6-4lpnw"
Jul 28 08:18:19.850830 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.850738    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6zs9\" (UniqueName: \"kubernetes.io/projected/112d02a0-6cf8-45f2-8e27-9ff370d4e873-kube-api-access-h6zs9\") pod \"redis-69bbd798b6-4lpnw\" (UID: \"112d02a0-6cf8-45f2-8e27-9ff370d4e873\") " pod="test-ns-feast/redis-69bbd798b6-4lpnw"
Jul 28 08:18:19.860239 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.860217    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6zs9\" (UniqueName: \"kubernetes.io/projected/112d02a0-6cf8-45f2-8e27-9ff370d4e873-kube-api-access-h6zs9\") pod \"redis-69bbd798b6-4lpnw\" (UID: \"112d02a0-6cf8-45f2-8e27-9ff370d4e873\") " pod="test-ns-feast/redis-69bbd798b6-4lpnw"
Jul 28 08:18:19.860329 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.860314    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-d8j7j"
Jul 28 08:18:19.883509 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:19.883482    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-4lpnw"
Jul 28 08:18:20.006151 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:20.006124    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-d8j7j"]
Jul 28 08:18:20.008659 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:18:20.008628    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ef86657_5460_44fd_b6bd_100878c85985.slice/crio-c4679ad862120fe1c277ccc6d1b0d17b1f250d2d8d76bea84993c2fba5a17ba4 WatchSource:0}: Error finding container c4679ad862120fe1c277ccc6d1b0d17b1f250d2d8d76bea84993c2fba5a17ba4: Status 404 returned error can't find the container with id c4679ad862120fe1c277ccc6d1b0d17b1f250d2d8d76bea84993c2fba5a17ba4
Jul 28 08:18:20.010698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:20.010679    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 08:18:20.029172 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:20.029125    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-4lpnw"]
Jul 28 08:18:20.031733 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:18:20.031709    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod112d02a0_6cf8_45f2_8e27_9ff370d4e873.slice/crio-ead43c0db3293bca6240c18264c4408716e84d23dbd5b6acdf9199cd5b4b99a3 WatchSource:0}: Error finding container ead43c0db3293bca6240c18264c4408716e84d23dbd5b6acdf9199cd5b4b99a3: Status 404 returned error can't find the container with id ead43c0db3293bca6240c18264c4408716e84d23dbd5b6acdf9199cd5b4b99a3
Jul 28 08:18:20.118318 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:20.118282    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-d8j7j" event={"ID":"9ef86657-5460-44fd-b6bd-100878c85985","Type":"ContainerStarted","Data":"c4679ad862120fe1c277ccc6d1b0d17b1f250d2d8d76bea84993c2fba5a17ba4"}
Jul 28 08:18:20.119438 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:20.119417    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-4lpnw" event={"ID":"112d02a0-6cf8-45f2-8e27-9ff370d4e873","Type":"ContainerStarted","Data":"ead43c0db3293bca6240c18264c4408716e84d23dbd5b6acdf9199cd5b4b99a3"}
Jul 28 08:18:22.130288 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:22.130259    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-4lpnw" event={"ID":"112d02a0-6cf8-45f2-8e27-9ff370d4e873","Type":"ContainerStarted","Data":"349dc77438f199198d4217d8073f01deaba7c4d74995829dbd8c5e12ad53b791"}
Jul 28 08:18:22.145156 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:22.145105    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-4lpnw" podStartSLOduration=1.5144585689999999 podStartE2EDuration="3.145089165s" totalImagesPullingTime="1.630630596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:18:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:18:22.144214993 +0000 UTC m=+937.331403124" watchObservedRunningTime="2026-07-28 08:18:22.145089165 +0000 UTC m=+937.332277295"
Jul 28 08:18:26.149179 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:26.149105    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-d8j7j" event={"ID":"9ef86657-5460-44fd-b6bd-100878c85985","Type":"ContainerStarted","Data":"241491e12cbb9db97035306e871da719249e88415a2926d5bf1337c93934be1d"}
Jul 28 08:18:26.164411 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:26.164362    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-d8j7j" podStartSLOduration=1.5249981369999999 podStartE2EDuration="7.164347336s" totalImagesPullingTime="5.639349199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:18:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:18:26.16306162 +0000 UTC m=+941.350249752" watchObservedRunningTime="2026-07-28 08:18:26.164347336 +0000 UTC m=+941.351535466"
Jul 28 08:18:30.170360 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.170328    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"]
Jul 28 08:18:30.176635 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.176615    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:30.181752 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.181672    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Jul 28 08:18:30.181752 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.181694    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Jul 28 08:18:30.181979 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.181814    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Jul 28 08:18:30.182469 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.182426    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Jul 28 08:18:30.182469 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.182437    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-vd99l\""
Jul 28 08:18:30.187703 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.187679    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"]
Jul 28 08:18:30.243528 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.243494    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-registry-tls\") pod \"feast-credit-scoring-9c5f48787-b4r6r\" (UID: \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\") " pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:30.243528 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.243529    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-feast-data\") pod \"feast-credit-scoring-9c5f48787-b4r6r\" (UID: \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\") " pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:30.243735 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.243549    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64mlf\" (UniqueName: \"kubernetes.io/projected/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-kube-api-access-64mlf\") pod \"feast-credit-scoring-9c5f48787-b4r6r\" (UID: \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\") " pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:30.243735 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.243619    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-offline-tls\") pod \"feast-credit-scoring-9c5f48787-b4r6r\" (UID: \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\") " pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:30.243735 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.243679    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-online-tls\") pod \"feast-credit-scoring-9c5f48787-b4r6r\" (UID: \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\") " pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:30.344182 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.344146    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-online-tls\") pod \"feast-credit-scoring-9c5f48787-b4r6r\" (UID: \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\") " pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:30.344373 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.344194    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-registry-tls\") pod \"feast-credit-scoring-9c5f48787-b4r6r\" (UID: \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\") " pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:30.344373 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.344210    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-feast-data\") pod \"feast-credit-scoring-9c5f48787-b4r6r\" (UID: \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\") " pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:30.344373 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.344226    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64mlf\" (UniqueName: \"kubernetes.io/projected/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-kube-api-access-64mlf\") pod \"feast-credit-scoring-9c5f48787-b4r6r\" (UID: \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\") " pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:30.344373 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.344259    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-offline-tls\") pod \"feast-credit-scoring-9c5f48787-b4r6r\" (UID: \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\") " pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:30.344691 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.344669    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-feast-data\") pod \"feast-credit-scoring-9c5f48787-b4r6r\" (UID: \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\") " pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:30.346907 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.346876    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-registry-tls\") pod \"feast-credit-scoring-9c5f48787-b4r6r\" (UID: \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\") " pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:30.347037 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.347027    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-offline-tls\") pod \"feast-credit-scoring-9c5f48787-b4r6r\" (UID: \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\") " pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:30.347095 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.347030    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-online-tls\") pod \"feast-credit-scoring-9c5f48787-b4r6r\" (UID: \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\") " pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:30.352377 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.352356    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64mlf\" (UniqueName: \"kubernetes.io/projected/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-kube-api-access-64mlf\") pod \"feast-credit-scoring-9c5f48787-b4r6r\" (UID: \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\") " pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:30.487273 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.487168    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:30.625115 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:30.625089    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"]
Jul 28 08:18:30.627984 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:18:30.627953    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96dd1d6b_4e95_4a4a_ab0f_9c2fba1631de.slice/crio-7f472d9c5e97cf1a77f34198e5f50899d75d3583a5c52aa35bee18a4bbbf8a46 WatchSource:0}: Error finding container 7f472d9c5e97cf1a77f34198e5f50899d75d3583a5c52aa35bee18a4bbbf8a46: Status 404 returned error can't find the container with id 7f472d9c5e97cf1a77f34198e5f50899d75d3583a5c52aa35bee18a4bbbf8a46
Jul 28 08:18:31.170743 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:31.170709    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" event={"ID":"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de","Type":"ContainerStarted","Data":"07ab8932691ffb873c8e08d0d1ba43a03891d98b7aa89a681061f34105777e8e"}
Jul 28 08:18:31.171127 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:31.170765    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" event={"ID":"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de","Type":"ContainerStarted","Data":"7f472d9c5e97cf1a77f34198e5f50899d75d3583a5c52aa35bee18a4bbbf8a46"}
Jul 28 08:18:32.176323 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:32.176289    2583 generic.go:356] "Generic (PLEG): container finished" podID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerID="07ab8932691ffb873c8e08d0d1ba43a03891d98b7aa89a681061f34105777e8e" exitCode=0
Jul 28 08:18:32.176734 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:32.176382    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" event={"ID":"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de","Type":"ContainerDied","Data":"07ab8932691ffb873c8e08d0d1ba43a03891d98b7aa89a681061f34105777e8e"}
Jul 28 08:18:33.183158 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:33.183123    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" event={"ID":"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de","Type":"ContainerStarted","Data":"6d601e8e429c65de1de350e8d22faec280a7b15811fc22a46984b62ca9cf60a1"}
Jul 28 08:18:39.209969 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:39.209924    2583 generic.go:356] "Generic (PLEG): container finished" podID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerID="6d601e8e429c65de1de350e8d22faec280a7b15811fc22a46984b62ca9cf60a1" exitCode=0
Jul 28 08:18:39.210413 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:39.209997    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" event={"ID":"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de","Type":"ContainerDied","Data":"6d601e8e429c65de1de350e8d22faec280a7b15811fc22a46984b62ca9cf60a1"}
Jul 28 08:18:40.219397 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:40.219353    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" event={"ID":"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de","Type":"ContainerStarted","Data":"beb0713a4a1c6601ff319cec3bf1ce57249913eea44cdbcd87686d54b245073f"}
Jul 28 08:18:40.219806 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:40.219468    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" event={"ID":"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de","Type":"ContainerStarted","Data":"64bb8a6209eedb80c7763d188935c52f277ec0490401b8fb5f10eced4ef286f5"}
Jul 28 08:18:40.219806 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:40.219502    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" event={"ID":"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de","Type":"ContainerStarted","Data":"8659a12e5bc77b605301f6592012fdb4b07e2697b36f49fba159f85d964c1aee"}
Jul 28 08:18:40.241424 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:40.241362    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" podStartSLOduration=10.241343097 podStartE2EDuration="10.241343097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:18:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:18:40.240197981 +0000 UTC m=+955.427386137" watchObservedRunningTime="2026-07-28 08:18:40.241343097 +0000 UTC m=+955.428531228"
Jul 28 08:18:40.487907 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:40.487739    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:40.487907 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:40.487862    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:40.487907 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:40.487880    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:42.488164 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:42.488107    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:42.488724 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:42.488322    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:42.488724 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:42.488370    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:42.489753 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:42.489707    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.31:8816: connect: connection refused"
Jul 28 08:18:42.489753 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:42.489732    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused"
Jul 28 08:18:42.489973 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:42.489739    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Jul 28 08:18:45.487796 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:45.487734    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused"
Jul 28 08:18:45.488804 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:45.488762    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:45.489870 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:45.489832    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:45.726936 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:45.726902    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:46.255225 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:46.255195    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:48.488462 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:48.488406    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused"
Jul 28 08:18:51.488471 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:51.488414    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:18:51.489314 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:18:51.489292    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:19:54.793127 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:54.793089    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"]
Jul 28 08:19:54.793649 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:54.793367    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="registry" containerID="cri-o://8659a12e5bc77b605301f6592012fdb4b07e2697b36f49fba159f85d964c1aee" gracePeriod=30
Jul 28 08:19:54.793649 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:54.793409    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="online" containerID="cri-o://64bb8a6209eedb80c7763d188935c52f277ec0490401b8fb5f10eced4ef286f5" gracePeriod=30
Jul 28 08:19:54.793649 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:54.793491    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="offline" containerID="cri-o://beb0713a4a1c6601ff319cec3bf1ce57249913eea44cdbcd87686d54b245073f" gracePeriod=30
Jul 28 08:19:54.811750 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:54.811720    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-d8j7j"]
Jul 28 08:19:54.811901 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:54.811885    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-d8j7j" podUID="9ef86657-5460-44fd-b6bd-100878c85985" containerName="postgres" containerID="cri-o://241491e12cbb9db97035306e871da719249e88415a2926d5bf1337c93934be1d" gracePeriod=30
Jul 28 08:19:54.821038 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:54.820999    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-4lpnw"]
Jul 28 08:19:54.821273 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:54.821231    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-4lpnw" podUID="112d02a0-6cf8-45f2-8e27-9ff370d4e873" containerName="redis" containerID="cri-o://349dc77438f199198d4217d8073f01deaba7c4d74995829dbd8c5e12ad53b791" gracePeriod=30
Jul 28 08:19:55.085285 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.085255    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-d8j7j"
Jul 28 08:19:55.088259 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.088238    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-4lpnw"
Jul 28 08:19:55.192692 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.192631    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6zs9\" (UniqueName: \"kubernetes.io/projected/112d02a0-6cf8-45f2-8e27-9ff370d4e873-kube-api-access-h6zs9\") pod \"112d02a0-6cf8-45f2-8e27-9ff370d4e873\" (UID: \"112d02a0-6cf8-45f2-8e27-9ff370d4e873\") "
Jul 28 08:19:55.192692 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.192692    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/9ef86657-5460-44fd-b6bd-100878c85985-postgresdata\") pod \"9ef86657-5460-44fd-b6bd-100878c85985\" (UID: \"9ef86657-5460-44fd-b6bd-100878c85985\") "
Jul 28 08:19:55.192962 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.192719    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6wtb\" (UniqueName: \"kubernetes.io/projected/9ef86657-5460-44fd-b6bd-100878c85985-kube-api-access-l6wtb\") pod \"9ef86657-5460-44fd-b6bd-100878c85985\" (UID: \"9ef86657-5460-44fd-b6bd-100878c85985\") "
Jul 28 08:19:55.194975 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.194938    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/112d02a0-6cf8-45f2-8e27-9ff370d4e873-kube-api-access-h6zs9" (OuterVolumeSpecName: "kube-api-access-h6zs9") pod "112d02a0-6cf8-45f2-8e27-9ff370d4e873" (UID: "112d02a0-6cf8-45f2-8e27-9ff370d4e873"). InnerVolumeSpecName "kube-api-access-h6zs9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:19:55.195094 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.195016    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ef86657-5460-44fd-b6bd-100878c85985-kube-api-access-l6wtb" (OuterVolumeSpecName: "kube-api-access-l6wtb") pod "9ef86657-5460-44fd-b6bd-100878c85985" (UID: "9ef86657-5460-44fd-b6bd-100878c85985"). InnerVolumeSpecName "kube-api-access-l6wtb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:19:55.222706 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.222662    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ef86657-5460-44fd-b6bd-100878c85985-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "9ef86657-5460-44fd-b6bd-100878c85985" (UID: "9ef86657-5460-44fd-b6bd-100878c85985"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 08:19:55.293969 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.293924    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6zs9\" (UniqueName: \"kubernetes.io/projected/112d02a0-6cf8-45f2-8e27-9ff370d4e873-kube-api-access-h6zs9\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:19:55.293969 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.293969    2583 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/9ef86657-5460-44fd-b6bd-100878c85985-postgresdata\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:19:55.293969 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.293979    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6wtb\" (UniqueName: \"kubernetes.io/projected/9ef86657-5460-44fd-b6bd-100878c85985-kube-api-access-l6wtb\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:19:55.562179 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.562141    2583 generic.go:356] "Generic (PLEG): container finished" podID="9ef86657-5460-44fd-b6bd-100878c85985" containerID="241491e12cbb9db97035306e871da719249e88415a2926d5bf1337c93934be1d" exitCode=0
Jul 28 08:19:55.562179 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.562183    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-d8j7j"
Jul 28 08:19:55.562413 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.562230    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-d8j7j" event={"ID":"9ef86657-5460-44fd-b6bd-100878c85985","Type":"ContainerDied","Data":"241491e12cbb9db97035306e871da719249e88415a2926d5bf1337c93934be1d"}
Jul 28 08:19:55.562413 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.562279    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-d8j7j" event={"ID":"9ef86657-5460-44fd-b6bd-100878c85985","Type":"ContainerDied","Data":"c4679ad862120fe1c277ccc6d1b0d17b1f250d2d8d76bea84993c2fba5a17ba4"}
Jul 28 08:19:55.562413 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.562301    2583 scope.go:117] "RemoveContainer" containerID="241491e12cbb9db97035306e871da719249e88415a2926d5bf1337c93934be1d"
Jul 28 08:19:55.564610 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.564584    2583 generic.go:356] "Generic (PLEG): container finished" podID="112d02a0-6cf8-45f2-8e27-9ff370d4e873" containerID="349dc77438f199198d4217d8073f01deaba7c4d74995829dbd8c5e12ad53b791" exitCode=0
Jul 28 08:19:55.564817 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.564799    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-4lpnw" event={"ID":"112d02a0-6cf8-45f2-8e27-9ff370d4e873","Type":"ContainerDied","Data":"349dc77438f199198d4217d8073f01deaba7c4d74995829dbd8c5e12ad53b791"}
Jul 28 08:19:55.564943 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.564929    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-4lpnw" event={"ID":"112d02a0-6cf8-45f2-8e27-9ff370d4e873","Type":"ContainerDied","Data":"ead43c0db3293bca6240c18264c4408716e84d23dbd5b6acdf9199cd5b4b99a3"}
Jul 28 08:19:55.565107 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.565094    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-4lpnw"
Jul 28 08:19:55.582324 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.582285    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-d8j7j"]
Jul 28 08:19:55.584620 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.584588    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-d8j7j"]
Jul 28 08:19:55.594434 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.594363    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-4lpnw"]
Jul 28 08:19:55.598387 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.598364    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-4lpnw"]
Jul 28 08:19:55.604829 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.604805    2583 scope.go:117] "RemoveContainer" containerID="241491e12cbb9db97035306e871da719249e88415a2926d5bf1337c93934be1d"
Jul 28 08:19:55.605129 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:19:55.605106    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"241491e12cbb9db97035306e871da719249e88415a2926d5bf1337c93934be1d\": container with ID starting with 241491e12cbb9db97035306e871da719249e88415a2926d5bf1337c93934be1d not found: ID does not exist" containerID="241491e12cbb9db97035306e871da719249e88415a2926d5bf1337c93934be1d"
Jul 28 08:19:55.605208 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.605143    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"241491e12cbb9db97035306e871da719249e88415a2926d5bf1337c93934be1d"} err="failed to get container status \"241491e12cbb9db97035306e871da719249e88415a2926d5bf1337c93934be1d\": rpc error: code = NotFound desc = could not find container \"241491e12cbb9db97035306e871da719249e88415a2926d5bf1337c93934be1d\": container with ID starting with 241491e12cbb9db97035306e871da719249e88415a2926d5bf1337c93934be1d not found: ID does not exist"
Jul 28 08:19:55.605208 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.605170    2583 scope.go:117] "RemoveContainer" containerID="349dc77438f199198d4217d8073f01deaba7c4d74995829dbd8c5e12ad53b791"
Jul 28 08:19:55.613012 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.612990    2583 scope.go:117] "RemoveContainer" containerID="349dc77438f199198d4217d8073f01deaba7c4d74995829dbd8c5e12ad53b791"
Jul 28 08:19:55.613313 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:19:55.613293    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"349dc77438f199198d4217d8073f01deaba7c4d74995829dbd8c5e12ad53b791\": container with ID starting with 349dc77438f199198d4217d8073f01deaba7c4d74995829dbd8c5e12ad53b791 not found: ID does not exist" containerID="349dc77438f199198d4217d8073f01deaba7c4d74995829dbd8c5e12ad53b791"
Jul 28 08:19:55.613379 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:55.613324    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"349dc77438f199198d4217d8073f01deaba7c4d74995829dbd8c5e12ad53b791"} err="failed to get container status \"349dc77438f199198d4217d8073f01deaba7c4d74995829dbd8c5e12ad53b791\": rpc error: code = NotFound desc = could not find container \"349dc77438f199198d4217d8073f01deaba7c4d74995829dbd8c5e12ad53b791\": container with ID starting with 349dc77438f199198d4217d8073f01deaba7c4d74995829dbd8c5e12ad53b791 not found: ID does not exist"
Jul 28 08:19:56.252196 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:56.252149    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Jul 28 08:19:56.571315 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:56.571234    2583 generic.go:356] "Generic (PLEG): container finished" podID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerID="64bb8a6209eedb80c7763d188935c52f277ec0490401b8fb5f10eced4ef286f5" exitCode=0
Jul 28 08:19:56.571478 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:56.571308    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" event={"ID":"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de","Type":"ContainerDied","Data":"64bb8a6209eedb80c7763d188935c52f277ec0490401b8fb5f10eced4ef286f5"}
Jul 28 08:19:57.333634 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:57.333600    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="112d02a0-6cf8-45f2-8e27-9ff370d4e873" path="/var/lib/kubelet/pods/112d02a0-6cf8-45f2-8e27-9ff370d4e873/volumes"
Jul 28 08:19:57.334019 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:19:57.333962    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ef86657-5460-44fd-b6bd-100878c85985" path="/var/lib/kubelet/pods/9ef86657-5460-44fd-b6bd-100878c85985/volumes"
Jul 28 08:20:06.251785 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:06.251741    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Jul 28 08:20:16.252503 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:16.252432    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Jul 28 08:20:16.253003 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:16.252597    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:20:25.449348 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.449316    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:20:25.542881 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.542849    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-online-tls\") pod \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\" (UID: \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\") "
Jul 28 08:20:25.543059 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.542898    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-offline-tls\") pod \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\" (UID: \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\") "
Jul 28 08:20:25.543059 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.542941    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-registry-tls\") pod \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\" (UID: \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\") "
Jul 28 08:20:25.543059 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.542998    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64mlf\" (UniqueName: \"kubernetes.io/projected/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-kube-api-access-64mlf\") pod \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\" (UID: \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\") "
Jul 28 08:20:25.543186 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.543150    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-feast-data\") pod \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\" (UID: \"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de\") "
Jul 28 08:20:25.545232 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.545183    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-online-tls" (OuterVolumeSpecName: "online-tls") pod "96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" (UID: "96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:20:25.545370 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.545278    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" (UID: "96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:20:25.545370 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.545301    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" (UID: "96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:20:25.545509 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.545399    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-kube-api-access-64mlf" (OuterVolumeSpecName: "kube-api-access-64mlf") pod "96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" (UID: "96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de"). InnerVolumeSpecName "kube-api-access-64mlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:20:25.552628 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.552593    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-feast-data" (OuterVolumeSpecName: "feast-data") pod "96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" (UID: "96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 08:20:25.644546 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.644513    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-registry-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:20:25.644546 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.644545    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64mlf\" (UniqueName: \"kubernetes.io/projected/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-kube-api-access-64mlf\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:20:25.644742 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.644554    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-feast-data\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:20:25.644742 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.644564    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-online-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:20:25.644742 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.644572    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de-offline-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:20:25.695477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.695425    2583 generic.go:356] "Generic (PLEG): container finished" podID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerID="beb0713a4a1c6601ff319cec3bf1ce57249913eea44cdbcd87686d54b245073f" exitCode=137
Jul 28 08:20:25.695477 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.695473    2583 generic.go:356] "Generic (PLEG): container finished" podID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerID="8659a12e5bc77b605301f6592012fdb4b07e2697b36f49fba159f85d964c1aee" exitCode=137
Jul 28 08:20:25.695685 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.695482    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" event={"ID":"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de","Type":"ContainerDied","Data":"beb0713a4a1c6601ff319cec3bf1ce57249913eea44cdbcd87686d54b245073f"}
Jul 28 08:20:25.695685 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.695516    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"
Jul 28 08:20:25.695685 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.695540    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" event={"ID":"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de","Type":"ContainerDied","Data":"8659a12e5bc77b605301f6592012fdb4b07e2697b36f49fba159f85d964c1aee"}
Jul 28 08:20:25.695685 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.695559    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r" event={"ID":"96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de","Type":"ContainerDied","Data":"7f472d9c5e97cf1a77f34198e5f50899d75d3583a5c52aa35bee18a4bbbf8a46"}
Jul 28 08:20:25.695685 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.695581    2583 scope.go:117] "RemoveContainer" containerID="beb0713a4a1c6601ff319cec3bf1ce57249913eea44cdbcd87686d54b245073f"
Jul 28 08:20:25.704784 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.704768    2583 scope.go:117] "RemoveContainer" containerID="64bb8a6209eedb80c7763d188935c52f277ec0490401b8fb5f10eced4ef286f5"
Jul 28 08:20:25.715379 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.715358    2583 scope.go:117] "RemoveContainer" containerID="8659a12e5bc77b605301f6592012fdb4b07e2697b36f49fba159f85d964c1aee"
Jul 28 08:20:25.717029 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.717004    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"]
Jul 28 08:20:25.721081 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.721060    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-9c5f48787-b4r6r"]
Jul 28 08:20:25.724603 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.724581    2583 scope.go:117] "RemoveContainer" containerID="6d601e8e429c65de1de350e8d22faec280a7b15811fc22a46984b62ca9cf60a1"
Jul 28 08:20:25.732212 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.732192    2583 scope.go:117] "RemoveContainer" containerID="07ab8932691ffb873c8e08d0d1ba43a03891d98b7aa89a681061f34105777e8e"
Jul 28 08:20:25.739621 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.739605    2583 scope.go:117] "RemoveContainer" containerID="beb0713a4a1c6601ff319cec3bf1ce57249913eea44cdbcd87686d54b245073f"
Jul 28 08:20:25.739922 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:20:25.739901    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"beb0713a4a1c6601ff319cec3bf1ce57249913eea44cdbcd87686d54b245073f\": container with ID starting with beb0713a4a1c6601ff319cec3bf1ce57249913eea44cdbcd87686d54b245073f not found: ID does not exist" containerID="beb0713a4a1c6601ff319cec3bf1ce57249913eea44cdbcd87686d54b245073f"
Jul 28 08:20:25.740015 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.739946    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beb0713a4a1c6601ff319cec3bf1ce57249913eea44cdbcd87686d54b245073f"} err="failed to get container status \"beb0713a4a1c6601ff319cec3bf1ce57249913eea44cdbcd87686d54b245073f\": rpc error: code = NotFound desc = could not find container \"beb0713a4a1c6601ff319cec3bf1ce57249913eea44cdbcd87686d54b245073f\": container with ID starting with beb0713a4a1c6601ff319cec3bf1ce57249913eea44cdbcd87686d54b245073f not found: ID does not exist"
Jul 28 08:20:25.740015 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.739972    2583 scope.go:117] "RemoveContainer" containerID="64bb8a6209eedb80c7763d188935c52f277ec0490401b8fb5f10eced4ef286f5"
Jul 28 08:20:25.740221 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:20:25.740197    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64bb8a6209eedb80c7763d188935c52f277ec0490401b8fb5f10eced4ef286f5\": container with ID starting with 64bb8a6209eedb80c7763d188935c52f277ec0490401b8fb5f10eced4ef286f5 not found: ID does not exist" containerID="64bb8a6209eedb80c7763d188935c52f277ec0490401b8fb5f10eced4ef286f5"
Jul 28 08:20:25.740270 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.740231    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64bb8a6209eedb80c7763d188935c52f277ec0490401b8fb5f10eced4ef286f5"} err="failed to get container status \"64bb8a6209eedb80c7763d188935c52f277ec0490401b8fb5f10eced4ef286f5\": rpc error: code = NotFound desc = could not find container \"64bb8a6209eedb80c7763d188935c52f277ec0490401b8fb5f10eced4ef286f5\": container with ID starting with 64bb8a6209eedb80c7763d188935c52f277ec0490401b8fb5f10eced4ef286f5 not found: ID does not exist"
Jul 28 08:20:25.740270 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.740255    2583 scope.go:117] "RemoveContainer" containerID="8659a12e5bc77b605301f6592012fdb4b07e2697b36f49fba159f85d964c1aee"
Jul 28 08:20:25.740526 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:20:25.740507    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8659a12e5bc77b605301f6592012fdb4b07e2697b36f49fba159f85d964c1aee\": container with ID starting with 8659a12e5bc77b605301f6592012fdb4b07e2697b36f49fba159f85d964c1aee not found: ID does not exist" containerID="8659a12e5bc77b605301f6592012fdb4b07e2697b36f49fba159f85d964c1aee"
Jul 28 08:20:25.740565 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.740532    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8659a12e5bc77b605301f6592012fdb4b07e2697b36f49fba159f85d964c1aee"} err="failed to get container status \"8659a12e5bc77b605301f6592012fdb4b07e2697b36f49fba159f85d964c1aee\": rpc error: code = NotFound desc = could not find container \"8659a12e5bc77b605301f6592012fdb4b07e2697b36f49fba159f85d964c1aee\": container with ID starting with 8659a12e5bc77b605301f6592012fdb4b07e2697b36f49fba159f85d964c1aee not found: ID does not exist"
Jul 28 08:20:25.740565 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.740548    2583 scope.go:117] "RemoveContainer" containerID="6d601e8e429c65de1de350e8d22faec280a7b15811fc22a46984b62ca9cf60a1"
Jul 28 08:20:25.740799 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:20:25.740784    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d601e8e429c65de1de350e8d22faec280a7b15811fc22a46984b62ca9cf60a1\": container with ID starting with 6d601e8e429c65de1de350e8d22faec280a7b15811fc22a46984b62ca9cf60a1 not found: ID does not exist" containerID="6d601e8e429c65de1de350e8d22faec280a7b15811fc22a46984b62ca9cf60a1"
Jul 28 08:20:25.740850 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.740801    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d601e8e429c65de1de350e8d22faec280a7b15811fc22a46984b62ca9cf60a1"} err="failed to get container status \"6d601e8e429c65de1de350e8d22faec280a7b15811fc22a46984b62ca9cf60a1\": rpc error: code = NotFound desc = could not find container \"6d601e8e429c65de1de350e8d22faec280a7b15811fc22a46984b62ca9cf60a1\": container with ID starting with 6d601e8e429c65de1de350e8d22faec280a7b15811fc22a46984b62ca9cf60a1 not found: ID does not exist"
Jul 28 08:20:25.740850 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.740814    2583 scope.go:117] "RemoveContainer" containerID="07ab8932691ffb873c8e08d0d1ba43a03891d98b7aa89a681061f34105777e8e"
Jul 28 08:20:25.741065 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:20:25.741043    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07ab8932691ffb873c8e08d0d1ba43a03891d98b7aa89a681061f34105777e8e\": container with ID starting with 07ab8932691ffb873c8e08d0d1ba43a03891d98b7aa89a681061f34105777e8e not found: ID does not exist" containerID="07ab8932691ffb873c8e08d0d1ba43a03891d98b7aa89a681061f34105777e8e"
Jul 28 08:20:25.741114 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.741078    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07ab8932691ffb873c8e08d0d1ba43a03891d98b7aa89a681061f34105777e8e"} err="failed to get container status \"07ab8932691ffb873c8e08d0d1ba43a03891d98b7aa89a681061f34105777e8e\": rpc error: code = NotFound desc = could not find container \"07ab8932691ffb873c8e08d0d1ba43a03891d98b7aa89a681061f34105777e8e\": container with ID starting with 07ab8932691ffb873c8e08d0d1ba43a03891d98b7aa89a681061f34105777e8e not found: ID does not exist"
Jul 28 08:20:25.741114 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.741094    2583 scope.go:117] "RemoveContainer" containerID="beb0713a4a1c6601ff319cec3bf1ce57249913eea44cdbcd87686d54b245073f"
Jul 28 08:20:25.741330 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.741310    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beb0713a4a1c6601ff319cec3bf1ce57249913eea44cdbcd87686d54b245073f"} err="failed to get container status \"beb0713a4a1c6601ff319cec3bf1ce57249913eea44cdbcd87686d54b245073f\": rpc error: code = NotFound desc = could not find container \"beb0713a4a1c6601ff319cec3bf1ce57249913eea44cdbcd87686d54b245073f\": container with ID starting with beb0713a4a1c6601ff319cec3bf1ce57249913eea44cdbcd87686d54b245073f not found: ID does not exist"
Jul 28 08:20:25.741370 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.741332    2583 scope.go:117] "RemoveContainer" containerID="64bb8a6209eedb80c7763d188935c52f277ec0490401b8fb5f10eced4ef286f5"
Jul 28 08:20:25.741587 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.741572    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64bb8a6209eedb80c7763d188935c52f277ec0490401b8fb5f10eced4ef286f5"} err="failed to get container status \"64bb8a6209eedb80c7763d188935c52f277ec0490401b8fb5f10eced4ef286f5\": rpc error: code = NotFound desc = could not find container \"64bb8a6209eedb80c7763d188935c52f277ec0490401b8fb5f10eced4ef286f5\": container with ID starting with 64bb8a6209eedb80c7763d188935c52f277ec0490401b8fb5f10eced4ef286f5 not found: ID does not exist"
Jul 28 08:20:25.741658 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.741588    2583 scope.go:117] "RemoveContainer" containerID="8659a12e5bc77b605301f6592012fdb4b07e2697b36f49fba159f85d964c1aee"
Jul 28 08:20:25.741794 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.741778    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8659a12e5bc77b605301f6592012fdb4b07e2697b36f49fba159f85d964c1aee"} err="failed to get container status \"8659a12e5bc77b605301f6592012fdb4b07e2697b36f49fba159f85d964c1aee\": rpc error: code = NotFound desc = could not find container \"8659a12e5bc77b605301f6592012fdb4b07e2697b36f49fba159f85d964c1aee\": container with ID starting with 8659a12e5bc77b605301f6592012fdb4b07e2697b36f49fba159f85d964c1aee not found: ID does not exist"
Jul 28 08:20:25.741846 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.741794    2583 scope.go:117] "RemoveContainer" containerID="6d601e8e429c65de1de350e8d22faec280a7b15811fc22a46984b62ca9cf60a1"
Jul 28 08:20:25.742008 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.741992    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d601e8e429c65de1de350e8d22faec280a7b15811fc22a46984b62ca9cf60a1"} err="failed to get container status \"6d601e8e429c65de1de350e8d22faec280a7b15811fc22a46984b62ca9cf60a1\": rpc error: code = NotFound desc = could not find container \"6d601e8e429c65de1de350e8d22faec280a7b15811fc22a46984b62ca9cf60a1\": container with ID starting with 6d601e8e429c65de1de350e8d22faec280a7b15811fc22a46984b62ca9cf60a1 not found: ID does not exist"
Jul 28 08:20:25.742008 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.742007    2583 scope.go:117] "RemoveContainer" containerID="07ab8932691ffb873c8e08d0d1ba43a03891d98b7aa89a681061f34105777e8e"
Jul 28 08:20:25.742195 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:25.742180    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07ab8932691ffb873c8e08d0d1ba43a03891d98b7aa89a681061f34105777e8e"} err="failed to get container status \"07ab8932691ffb873c8e08d0d1ba43a03891d98b7aa89a681061f34105777e8e\": rpc error: code = NotFound desc = could not find container \"07ab8932691ffb873c8e08d0d1ba43a03891d98b7aa89a681061f34105777e8e\": container with ID starting with 07ab8932691ffb873c8e08d0d1ba43a03891d98b7aa89a681061f34105777e8e not found: ID does not exist"
Jul 28 08:20:27.333920 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:20:27.333882    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" path="/var/lib/kubelet/pods/96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de/volumes"
Jul 28 08:22:48.567631 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:22:48.567506    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vgzf4_dcf82623-a4f7-4511-aed0-7248950f1ca1/console-operator/1.log"
Jul 28 08:22:48.572899 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:22:48.572875    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vgzf4_dcf82623-a4f7-4511-aed0-7248950f1ca1/console-operator/1.log"
Jul 28 08:22:48.575103 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:22:48.575081    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-acl-logging/0.log"
Jul 28 08:22:48.579709 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:22:48.579694    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-acl-logging/0.log"
Jul 28 08:24:04.086732 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.086652    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-bngnj"]
Jul 28 08:24:04.087182 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.087018    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="feast-apply"
Jul 28 08:24:04.087182 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.087034    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="feast-apply"
Jul 28 08:24:04.087182 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.087043    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="112d02a0-6cf8-45f2-8e27-9ff370d4e873" containerName="redis"
Jul 28 08:24:04.087182 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.087048    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="112d02a0-6cf8-45f2-8e27-9ff370d4e873" containerName="redis"
Jul 28 08:24:04.087182 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.087060    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ef86657-5460-44fd-b6bd-100878c85985" containerName="postgres"
Jul 28 08:24:04.087182 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.087066    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ef86657-5460-44fd-b6bd-100878c85985" containerName="postgres"
Jul 28 08:24:04.087182 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.087073    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="offline"
Jul 28 08:24:04.087182 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.087078    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="offline"
Jul 28 08:24:04.087182 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.087094    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="registry"
Jul 28 08:24:04.087182 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.087104    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="registry"
Jul 28 08:24:04.087182 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.087110    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="online"
Jul 28 08:24:04.087182 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.087116    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="online"
Jul 28 08:24:04.087182 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.087131    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="feast-init"
Jul 28 08:24:04.087182 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.087136    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="feast-init"
Jul 28 08:24:04.087182 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.087186    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="offline"
Jul 28 08:24:04.087683 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.087195    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="online"
Jul 28 08:24:04.087683 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.087203    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="96dd1d6b-4e95-4a4a-ab0f-9c2fba1631de" containerName="registry"
Jul 28 08:24:04.087683 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.087207    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="112d02a0-6cf8-45f2-8e27-9ff370d4e873" containerName="redis"
Jul 28 08:24:04.087683 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.087212    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ef86657-5460-44fd-b6bd-100878c85985" containerName="postgres"
Jul 28 08:24:04.090089 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.090070    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-bngnj"
Jul 28 08:24:04.092427 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.092407    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Jul 28 08:24:04.092427 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.092426    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-rz824\""
Jul 28 08:24:04.092626 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.092473    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Jul 28 08:24:04.106349 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.106327    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-bngnj"]
Jul 28 08:24:04.197589 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.197557    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt9jz\" (UniqueName: \"kubernetes.io/projected/ed4491a6-2fed-49dc-8509-692f2d9de18b-kube-api-access-tt9jz\") pod \"redis-69bbd798b6-bngnj\" (UID: \"ed4491a6-2fed-49dc-8509-692f2d9de18b\") " pod="test-ns-feast-rest/redis-69bbd798b6-bngnj"
Jul 28 08:24:04.298068 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.298030    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt9jz\" (UniqueName: \"kubernetes.io/projected/ed4491a6-2fed-49dc-8509-692f2d9de18b-kube-api-access-tt9jz\") pod \"redis-69bbd798b6-bngnj\" (UID: \"ed4491a6-2fed-49dc-8509-692f2d9de18b\") " pod="test-ns-feast-rest/redis-69bbd798b6-bngnj"
Jul 28 08:24:04.306533 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.306499    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt9jz\" (UniqueName: \"kubernetes.io/projected/ed4491a6-2fed-49dc-8509-692f2d9de18b-kube-api-access-tt9jz\") pod \"redis-69bbd798b6-bngnj\" (UID: \"ed4491a6-2fed-49dc-8509-692f2d9de18b\") " pod="test-ns-feast-rest/redis-69bbd798b6-bngnj"
Jul 28 08:24:04.408687 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.408658    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-bngnj"
Jul 28 08:24:04.537940 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.537861    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-bngnj"]
Jul 28 08:24:04.540584 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:24:04.540556    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded4491a6_2fed_49dc_8509_692f2d9de18b.slice/crio-862a1fb603ff7b5046124525657945c4750fc687db23e1bb115d1016a4641345 WatchSource:0}: Error finding container 862a1fb603ff7b5046124525657945c4750fc687db23e1bb115d1016a4641345: Status 404 returned error can't find the container with id 862a1fb603ff7b5046124525657945c4750fc687db23e1bb115d1016a4641345
Jul 28 08:24:04.569012 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:04.568984    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-bngnj" event={"ID":"ed4491a6-2fed-49dc-8509-692f2d9de18b","Type":"ContainerStarted","Data":"862a1fb603ff7b5046124525657945c4750fc687db23e1bb115d1016a4641345"}
Jul 28 08:24:05.574034 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:05.573996    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-bngnj" event={"ID":"ed4491a6-2fed-49dc-8509-692f2d9de18b","Type":"ContainerStarted","Data":"86f137e1a29cd2ede4f97b54cac72c728073fbb1435d838ec078e7a459eeb464"}
Jul 28 08:24:05.587988 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:05.587938    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-bngnj" podStartSLOduration=1.587918001 podStartE2EDuration="1.587918001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:24:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:24:05.587290497 +0000 UTC m=+1280.774478630" watchObservedRunningTime="2026-07-28 08:24:05.587918001 +0000 UTC m=+1280.775106172"
Jul 28 08:24:09.550176 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:09.550145    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-kd9pc"]
Jul 28 08:24:09.553405 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:09.553384    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-kd9pc"
Jul 28 08:24:09.555795 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:09.555772    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Jul 28 08:24:09.560140 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:09.560115    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-kd9pc"]
Jul 28 08:24:09.643051 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:09.643012    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6njt\" (UniqueName: \"kubernetes.io/projected/d08894c5-9e47-4b56-91dd-a88285405963-kube-api-access-j6njt\") pod \"postgres-864846d4f5-kd9pc\" (UID: \"d08894c5-9e47-4b56-91dd-a88285405963\") " pod="test-ns-feast-rest/postgres-864846d4f5-kd9pc"
Jul 28 08:24:09.643051 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:09.643050    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d08894c5-9e47-4b56-91dd-a88285405963-postgresdata\") pod \"postgres-864846d4f5-kd9pc\" (UID: \"d08894c5-9e47-4b56-91dd-a88285405963\") " pod="test-ns-feast-rest/postgres-864846d4f5-kd9pc"
Jul 28 08:24:09.743608 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:09.743579    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6njt\" (UniqueName: \"kubernetes.io/projected/d08894c5-9e47-4b56-91dd-a88285405963-kube-api-access-j6njt\") pod \"postgres-864846d4f5-kd9pc\" (UID: \"d08894c5-9e47-4b56-91dd-a88285405963\") " pod="test-ns-feast-rest/postgres-864846d4f5-kd9pc"
Jul 28 08:24:09.743719 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:09.743620    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d08894c5-9e47-4b56-91dd-a88285405963-postgresdata\") pod \"postgres-864846d4f5-kd9pc\" (UID: \"d08894c5-9e47-4b56-91dd-a88285405963\") " pod="test-ns-feast-rest/postgres-864846d4f5-kd9pc"
Jul 28 08:24:09.744078 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:09.744060    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d08894c5-9e47-4b56-91dd-a88285405963-postgresdata\") pod \"postgres-864846d4f5-kd9pc\" (UID: \"d08894c5-9e47-4b56-91dd-a88285405963\") " pod="test-ns-feast-rest/postgres-864846d4f5-kd9pc"
Jul 28 08:24:09.751379 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:09.751353    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6njt\" (UniqueName: \"kubernetes.io/projected/d08894c5-9e47-4b56-91dd-a88285405963-kube-api-access-j6njt\") pod \"postgres-864846d4f5-kd9pc\" (UID: \"d08894c5-9e47-4b56-91dd-a88285405963\") " pod="test-ns-feast-rest/postgres-864846d4f5-kd9pc"
Jul 28 08:24:09.863898 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:09.863805    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-kd9pc"
Jul 28 08:24:09.997960 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:09.997937    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-kd9pc"]
Jul 28 08:24:10.000241 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:24:10.000198    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd08894c5_9e47_4b56_91dd_a88285405963.slice/crio-06686ed2a3a9577696049535ce03de92c87dbd6d79e6fc455f9e178708b726ed WatchSource:0}: Error finding container 06686ed2a3a9577696049535ce03de92c87dbd6d79e6fc455f9e178708b726ed: Status 404 returned error can't find the container with id 06686ed2a3a9577696049535ce03de92c87dbd6d79e6fc455f9e178708b726ed
Jul 28 08:24:10.596967 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:10.596935    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-kd9pc" event={"ID":"d08894c5-9e47-4b56-91dd-a88285405963","Type":"ContainerStarted","Data":"fd0ee596182e58fc080c645c5aa3612e372c4fecff244e61e8c545e2cdc56105"}
Jul 28 08:24:10.596967 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:10.596973    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-kd9pc" event={"ID":"d08894c5-9e47-4b56-91dd-a88285405963","Type":"ContainerStarted","Data":"06686ed2a3a9577696049535ce03de92c87dbd6d79e6fc455f9e178708b726ed"}
Jul 28 08:24:10.612872 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:10.612801    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-kd9pc" podStartSLOduration=1.612780186 podStartE2EDuration="1.612780186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:24:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:24:10.610295876 +0000 UTC m=+1285.797484006" watchObservedRunningTime="2026-07-28 08:24:10.612780186 +0000 UTC m=+1285.799968319"
Jul 28 08:24:15.107043 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:15.107004    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"]
Jul 28 08:24:15.110643 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:15.110625    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:15.113027 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:15.112929    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-qgjh8\""
Jul 28 08:24:15.113027 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:15.112980    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Jul 28 08:24:15.115256 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:15.113281    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Jul 28 08:24:15.115256 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:15.113304    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Jul 28 08:24:15.120974 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:15.120948    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"]
Jul 28 08:24:15.184295 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:15.184252    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/dbde2363-1f48-40ed-8bed-15653c2f29c2-feast-data\") pod \"feast-credit-scoring-f6ff77ccc-rwnq7\" (UID: \"dbde2363-1f48-40ed-8bed-15653c2f29c2\") " pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:15.184531 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:15.184347    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/dbde2363-1f48-40ed-8bed-15653c2f29c2-online-tls\") pod \"feast-credit-scoring-f6ff77ccc-rwnq7\" (UID: \"dbde2363-1f48-40ed-8bed-15653c2f29c2\") " pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:15.184531 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:15.184390    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swpj2\" (UniqueName: \"kubernetes.io/projected/dbde2363-1f48-40ed-8bed-15653c2f29c2-kube-api-access-swpj2\") pod \"feast-credit-scoring-f6ff77ccc-rwnq7\" (UID: \"dbde2363-1f48-40ed-8bed-15653c2f29c2\") " pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:15.184531 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:15.184428    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/dbde2363-1f48-40ed-8bed-15653c2f29c2-registry-tls\") pod \"feast-credit-scoring-f6ff77ccc-rwnq7\" (UID: \"dbde2363-1f48-40ed-8bed-15653c2f29c2\") " pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:15.284898 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:15.284857    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/dbde2363-1f48-40ed-8bed-15653c2f29c2-registry-tls\") pod \"feast-credit-scoring-f6ff77ccc-rwnq7\" (UID: \"dbde2363-1f48-40ed-8bed-15653c2f29c2\") " pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:15.284898 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:15.284907    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/dbde2363-1f48-40ed-8bed-15653c2f29c2-feast-data\") pod \"feast-credit-scoring-f6ff77ccc-rwnq7\" (UID: \"dbde2363-1f48-40ed-8bed-15653c2f29c2\") " pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:15.285148 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:15.284953    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/dbde2363-1f48-40ed-8bed-15653c2f29c2-online-tls\") pod \"feast-credit-scoring-f6ff77ccc-rwnq7\" (UID: \"dbde2363-1f48-40ed-8bed-15653c2f29c2\") " pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:15.285148 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:15.284978    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swpj2\" (UniqueName: \"kubernetes.io/projected/dbde2363-1f48-40ed-8bed-15653c2f29c2-kube-api-access-swpj2\") pod \"feast-credit-scoring-f6ff77ccc-rwnq7\" (UID: \"dbde2363-1f48-40ed-8bed-15653c2f29c2\") " pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:15.285148 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:24:15.285094    2583 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
Jul 28 08:24:15.285303 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:24:15.285169    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbde2363-1f48-40ed-8bed-15653c2f29c2-online-tls podName:dbde2363-1f48-40ed-8bed-15653c2f29c2 nodeName:}" failed. No retries permitted until 2026-07-28 08:24:15.785153963 +0000 UTC m=+1290.972342070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/dbde2363-1f48-40ed-8bed-15653c2f29c2-online-tls") pod "feast-credit-scoring-f6ff77ccc-rwnq7" (UID: "dbde2363-1f48-40ed-8bed-15653c2f29c2") : secret "feast-credit-scoring-online-tls" not found
Jul 28 08:24:15.285371 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:15.285315    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/dbde2363-1f48-40ed-8bed-15653c2f29c2-feast-data\") pod \"feast-credit-scoring-f6ff77ccc-rwnq7\" (UID: \"dbde2363-1f48-40ed-8bed-15653c2f29c2\") " pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:15.287548 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:15.287524    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/dbde2363-1f48-40ed-8bed-15653c2f29c2-registry-tls\") pod \"feast-credit-scoring-f6ff77ccc-rwnq7\" (UID: \"dbde2363-1f48-40ed-8bed-15653c2f29c2\") " pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:15.293000 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:15.292977    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swpj2\" (UniqueName: \"kubernetes.io/projected/dbde2363-1f48-40ed-8bed-15653c2f29c2-kube-api-access-swpj2\") pod \"feast-credit-scoring-f6ff77ccc-rwnq7\" (UID: \"dbde2363-1f48-40ed-8bed-15653c2f29c2\") " pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:15.789184 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:15.789143    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/dbde2363-1f48-40ed-8bed-15653c2f29c2-online-tls\") pod \"feast-credit-scoring-f6ff77ccc-rwnq7\" (UID: \"dbde2363-1f48-40ed-8bed-15653c2f29c2\") " pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:15.791710 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:15.791679    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/dbde2363-1f48-40ed-8bed-15653c2f29c2-online-tls\") pod \"feast-credit-scoring-f6ff77ccc-rwnq7\" (UID: \"dbde2363-1f48-40ed-8bed-15653c2f29c2\") " pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:16.024833 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:16.024786    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:16.166852 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:16.166821    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"]
Jul 28 08:24:16.168763 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:24:16.168737    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbde2363_1f48_40ed_8bed_15653c2f29c2.slice/crio-21f6cee9eae993918c75e04b75e3475d38c409326e28e1f007da6abea78efec7 WatchSource:0}: Error finding container 21f6cee9eae993918c75e04b75e3475d38c409326e28e1f007da6abea78efec7: Status 404 returned error can't find the container with id 21f6cee9eae993918c75e04b75e3475d38c409326e28e1f007da6abea78efec7
Jul 28 08:24:16.621790 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:16.621715    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" event={"ID":"dbde2363-1f48-40ed-8bed-15653c2f29c2","Type":"ContainerStarted","Data":"08b7c3d08f848837b87d886b21d5b3743cee00b2127b2086fd233ea6bbe8e90d"}
Jul 28 08:24:16.622021 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:16.621818    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" event={"ID":"dbde2363-1f48-40ed-8bed-15653c2f29c2","Type":"ContainerStarted","Data":"21f6cee9eae993918c75e04b75e3475d38c409326e28e1f007da6abea78efec7"}
Jul 28 08:24:17.626737 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:17.626706    2583 generic.go:356] "Generic (PLEG): container finished" podID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerID="08b7c3d08f848837b87d886b21d5b3743cee00b2127b2086fd233ea6bbe8e90d" exitCode=0
Jul 28 08:24:17.627149 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:17.626765    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" event={"ID":"dbde2363-1f48-40ed-8bed-15653c2f29c2","Type":"ContainerDied","Data":"08b7c3d08f848837b87d886b21d5b3743cee00b2127b2086fd233ea6bbe8e90d"}
Jul 28 08:24:18.632394 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:18.632363    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" event={"ID":"dbde2363-1f48-40ed-8bed-15653c2f29c2","Type":"ContainerStarted","Data":"91c02e308979015f385bdad7dfe04ea919e47d7e83a863a7003d88698b9ffa73"}
Jul 28 08:24:25.663130 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:25.663096    2583 generic.go:356] "Generic (PLEG): container finished" podID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerID="91c02e308979015f385bdad7dfe04ea919e47d7e83a863a7003d88698b9ffa73" exitCode=0
Jul 28 08:24:25.663535 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:25.663143    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" event={"ID":"dbde2363-1f48-40ed-8bed-15653c2f29c2","Type":"ContainerDied","Data":"91c02e308979015f385bdad7dfe04ea919e47d7e83a863a7003d88698b9ffa73"}
Jul 28 08:24:26.671424 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:26.671380    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" event={"ID":"dbde2363-1f48-40ed-8bed-15653c2f29c2","Type":"ContainerStarted","Data":"ea701e9e1b4b1e0e42fd7c24163f24554821b395a86a897d580dd7f0ca00b2aa"}
Jul 28 08:24:26.671906 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:26.671506    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" event={"ID":"dbde2363-1f48-40ed-8bed-15653c2f29c2","Type":"ContainerStarted","Data":"5ddcec4d9e68402264dcc27f6c0b8c6ee006315844400ea0ec4a97575f8c434f"}
Jul 28 08:24:26.692693 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:26.692621    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" podStartSLOduration=11.692600338 podStartE2EDuration="11.692600338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:24:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:24:26.690924838 +0000 UTC m=+1301.878112967" watchObservedRunningTime="2026-07-28 08:24:26.692600338 +0000 UTC m=+1301.879788470"
Jul 28 08:24:28.025976 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:28.025935    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:28.026357 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:28.026016    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:28.027772 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:28.027741    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Jul 28 08:24:28.027854 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:28.027761    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jul 28 08:24:31.025312 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:31.025263    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Jul 28 08:24:31.025747 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:31.025284    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jul 28 08:24:34.025705 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:34.025657    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Jul 28 08:24:34.031315 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:34.031271    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:34.031744 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:34.031720    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:34.035099 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:34.035076    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:36.025754 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:36.025713    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:37.025774 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:37.025726    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Jul 28 08:24:40.025657 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:40.025622    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:40.026493 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:40.026438    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:24:41.040682 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.040645    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"]
Jul 28 08:24:41.045439 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.045422    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:24:41.047646 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.047610    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Jul 28 08:24:41.047778 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.047644    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Jul 28 08:24:41.047778 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.047667    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Jul 28 08:24:41.047778 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.047679    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-rxqh4\""
Jul 28 08:24:41.054167 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.054144    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"]
Jul 28 08:24:41.111471 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.111407    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4c63b1c0-e1a8-471f-92f2-53c480f0b943-feast-data\") pod \"feast-driver-ranking-6f46cd4454-l2nz8\" (UID: \"4c63b1c0-e1a8-471f-92f2-53c480f0b943\") " pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:24:41.111653 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.111545    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4c63b1c0-e1a8-471f-92f2-53c480f0b943-online-tls\") pod \"feast-driver-ranking-6f46cd4454-l2nz8\" (UID: \"4c63b1c0-e1a8-471f-92f2-53c480f0b943\") " pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:24:41.111653 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.111577    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8rqx\" (UniqueName: \"kubernetes.io/projected/4c63b1c0-e1a8-471f-92f2-53c480f0b943-kube-api-access-m8rqx\") pod \"feast-driver-ranking-6f46cd4454-l2nz8\" (UID: \"4c63b1c0-e1a8-471f-92f2-53c480f0b943\") " pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:24:41.111653 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.111600    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4c63b1c0-e1a8-471f-92f2-53c480f0b943-registry-tls\") pod \"feast-driver-ranking-6f46cd4454-l2nz8\" (UID: \"4c63b1c0-e1a8-471f-92f2-53c480f0b943\") " pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:24:41.212250 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.212208    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4c63b1c0-e1a8-471f-92f2-53c480f0b943-online-tls\") pod \"feast-driver-ranking-6f46cd4454-l2nz8\" (UID: \"4c63b1c0-e1a8-471f-92f2-53c480f0b943\") " pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:24:41.212250 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.212250    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8rqx\" (UniqueName: \"kubernetes.io/projected/4c63b1c0-e1a8-471f-92f2-53c480f0b943-kube-api-access-m8rqx\") pod \"feast-driver-ranking-6f46cd4454-l2nz8\" (UID: \"4c63b1c0-e1a8-471f-92f2-53c480f0b943\") " pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:24:41.212517 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.212269    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4c63b1c0-e1a8-471f-92f2-53c480f0b943-registry-tls\") pod \"feast-driver-ranking-6f46cd4454-l2nz8\" (UID: \"4c63b1c0-e1a8-471f-92f2-53c480f0b943\") " pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:24:41.212517 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.212292    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4c63b1c0-e1a8-471f-92f2-53c480f0b943-feast-data\") pod \"feast-driver-ranking-6f46cd4454-l2nz8\" (UID: \"4c63b1c0-e1a8-471f-92f2-53c480f0b943\") " pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:24:41.212706 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.212688    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4c63b1c0-e1a8-471f-92f2-53c480f0b943-feast-data\") pod \"feast-driver-ranking-6f46cd4454-l2nz8\" (UID: \"4c63b1c0-e1a8-471f-92f2-53c480f0b943\") " pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:24:41.215039 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.215013    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4c63b1c0-e1a8-471f-92f2-53c480f0b943-registry-tls\") pod \"feast-driver-ranking-6f46cd4454-l2nz8\" (UID: \"4c63b1c0-e1a8-471f-92f2-53c480f0b943\") " pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:24:41.215163 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.215063    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4c63b1c0-e1a8-471f-92f2-53c480f0b943-online-tls\") pod \"feast-driver-ranking-6f46cd4454-l2nz8\" (UID: \"4c63b1c0-e1a8-471f-92f2-53c480f0b943\") " pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:24:41.220045 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.220020    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8rqx\" (UniqueName: \"kubernetes.io/projected/4c63b1c0-e1a8-471f-92f2-53c480f0b943-kube-api-access-m8rqx\") pod \"feast-driver-ranking-6f46cd4454-l2nz8\" (UID: \"4c63b1c0-e1a8-471f-92f2-53c480f0b943\") " pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:24:41.355795 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.355702    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:24:41.497758 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.497719    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"]
Jul 28 08:24:41.501216 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:24:41.501182    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c63b1c0_e1a8_471f_92f2_53c480f0b943.slice/crio-726c1f96eedbfb28f189514d9ad0202f319eb60ec1c35adb265ad05c9e6b937d WatchSource:0}: Error finding container 726c1f96eedbfb28f189514d9ad0202f319eb60ec1c35adb265ad05c9e6b937d: Status 404 returned error can't find the container with id 726c1f96eedbfb28f189514d9ad0202f319eb60ec1c35adb265ad05c9e6b937d
Jul 28 08:24:41.746480 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.746426    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" event={"ID":"4c63b1c0-e1a8-471f-92f2-53c480f0b943","Type":"ContainerStarted","Data":"b9ebc9a409f115606d61090ca8ba65b3dacfbc67ba9ad86b130e41e89dde32c1"}
Jul 28 08:24:41.746681 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:41.746505    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" event={"ID":"4c63b1c0-e1a8-471f-92f2-53c480f0b943","Type":"ContainerStarted","Data":"726c1f96eedbfb28f189514d9ad0202f319eb60ec1c35adb265ad05c9e6b937d"}
Jul 28 08:24:46.768412 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:46.768327    2583 generic.go:356] "Generic (PLEG): container finished" podID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerID="b9ebc9a409f115606d61090ca8ba65b3dacfbc67ba9ad86b130e41e89dde32c1" exitCode=0
Jul 28 08:24:46.768867 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:46.768402    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" event={"ID":"4c63b1c0-e1a8-471f-92f2-53c480f0b943","Type":"ContainerDied","Data":"b9ebc9a409f115606d61090ca8ba65b3dacfbc67ba9ad86b130e41e89dde32c1"}
Jul 28 08:24:47.774024 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:47.773986    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" event={"ID":"4c63b1c0-e1a8-471f-92f2-53c480f0b943","Type":"ContainerStarted","Data":"0ce5172d0081a271264bf2b8c7b6d44b9b0a7cc9dd054acdf9cf80d33f83baf8"}
Jul 28 08:24:53.808050 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:53.808012    2583 generic.go:356] "Generic (PLEG): container finished" podID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerID="0ce5172d0081a271264bf2b8c7b6d44b9b0a7cc9dd054acdf9cf80d33f83baf8" exitCode=0
Jul 28 08:24:53.808486 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:53.808078    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" event={"ID":"4c63b1c0-e1a8-471f-92f2-53c480f0b943","Type":"ContainerDied","Data":"0ce5172d0081a271264bf2b8c7b6d44b9b0a7cc9dd054acdf9cf80d33f83baf8"}
Jul 28 08:24:53.811539 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:53.811505    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Jul 28 08:24:54.817058 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:54.817016    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" event={"ID":"4c63b1c0-e1a8-471f-92f2-53c480f0b943","Type":"ContainerStarted","Data":"e5af3e697dc60e9114d3099d5172b0a16048e96743c879effb2e4cde129f4e5e"}
Jul 28 08:24:54.817585 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:54.817080    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" event={"ID":"4c63b1c0-e1a8-471f-92f2-53c480f0b943","Type":"ContainerStarted","Data":"eeb9ceca4d7eb7cc4d026e19724872c08d755894f65eab5f3b68e771e51c1efd"}
Jul 28 08:24:54.838054 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:54.838005    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" podStartSLOduration=13.83798457 podStartE2EDuration="13.83798457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:24:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:24:54.837327519 +0000 UTC m=+1330.024515650" watchObservedRunningTime="2026-07-28 08:24:54.83798457 +0000 UTC m=+1330.025172701"
Jul 28 08:24:56.356141 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:56.356082    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:24:56.356655 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:56.356157    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:24:56.357708 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:56.357676    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Jul 28 08:24:56.357867 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:56.357720    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jul 28 08:24:59.356328 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:59.356293    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jul 28 08:24:59.356751 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:24:59.356286    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Jul 28 08:25:01.355833 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:25:01.355784    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:25:01.356314 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:25:01.355851    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:25:02.357097 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:25:02.357044    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Jul 28 08:25:02.365424 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:25:02.365388    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:25:02.369185 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:25:02.369154    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:25:05.356812 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:25:05.356771    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Jul 28 08:25:08.357682 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:25:08.357598    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:25:08.358479 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:25:08.358434    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:26:26.935592 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:26.935553    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"]
Jul 28 08:26:26.936125 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:26.935869    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerName="registry" containerID="cri-o://5ddcec4d9e68402264dcc27f6c0b8c6ee006315844400ea0ec4a97575f8c434f" gracePeriod=30
Jul 28 08:26:26.936125 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:26.935972    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerName="online" containerID="cri-o://ea701e9e1b4b1e0e42fd7c24163f24554821b395a86a897d580dd7f0ca00b2aa" gracePeriod=30
Jul 28 08:26:26.941736 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:26.941707    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"]
Jul 28 08:26:26.942048 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:26.941988    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerName="registry" containerID="cri-o://eeb9ceca4d7eb7cc4d026e19724872c08d755894f65eab5f3b68e771e51c1efd" gracePeriod=30
Jul 28 08:26:26.942185 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:26.942034    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerName="online" containerID="cri-o://e5af3e697dc60e9114d3099d5172b0a16048e96743c879effb2e4cde129f4e5e" gracePeriod=30
Jul 28 08:26:28.245258 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:28.245227    2583 generic.go:356] "Generic (PLEG): container finished" podID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerID="ea701e9e1b4b1e0e42fd7c24163f24554821b395a86a897d580dd7f0ca00b2aa" exitCode=0
Jul 28 08:26:28.245715 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:28.245298    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" event={"ID":"dbde2363-1f48-40ed-8bed-15653c2f29c2","Type":"ContainerDied","Data":"ea701e9e1b4b1e0e42fd7c24163f24554821b395a86a897d580dd7f0ca00b2aa"}
Jul 28 08:26:28.247549 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:28.247525    2583 generic.go:356] "Generic (PLEG): container finished" podID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerID="e5af3e697dc60e9114d3099d5172b0a16048e96743c879effb2e4cde129f4e5e" exitCode=0
Jul 28 08:26:28.247664 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:28.247560    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" event={"ID":"4c63b1c0-e1a8-471f-92f2-53c480f0b943","Type":"ContainerDied","Data":"e5af3e697dc60e9114d3099d5172b0a16048e96743c879effb2e4cde129f4e5e"}
Jul 28 08:26:28.864412 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:28.864376    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-kd9pc"]
Jul 28 08:26:28.864638 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:28.864580    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-kd9pc" podUID="d08894c5-9e47-4b56-91dd-a88285405963" containerName="postgres" containerID="cri-o://fd0ee596182e58fc080c645c5aa3612e372c4fecff244e61e8c545e2cdc56105" gracePeriod=30
Jul 28 08:26:28.871298 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:28.871268    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-bngnj"]
Jul 28 08:26:28.871512 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:28.871485    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-bngnj" podUID="ed4491a6-2fed-49dc-8509-692f2d9de18b" containerName="redis" containerID="cri-o://86f137e1a29cd2ede4f97b54cac72c728073fbb1435d838ec078e7a459eeb464" gracePeriod=30
Jul 28 08:26:29.135540 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.135518    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-bngnj"
Jul 28 08:26:29.138235 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.138217    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-kd9pc"
Jul 28 08:26:29.146422 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.146403    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt9jz\" (UniqueName: \"kubernetes.io/projected/ed4491a6-2fed-49dc-8509-692f2d9de18b-kube-api-access-tt9jz\") pod \"ed4491a6-2fed-49dc-8509-692f2d9de18b\" (UID: \"ed4491a6-2fed-49dc-8509-692f2d9de18b\") "
Jul 28 08:26:29.148917 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.148855    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed4491a6-2fed-49dc-8509-692f2d9de18b-kube-api-access-tt9jz" (OuterVolumeSpecName: "kube-api-access-tt9jz") pod "ed4491a6-2fed-49dc-8509-692f2d9de18b" (UID: "ed4491a6-2fed-49dc-8509-692f2d9de18b"). InnerVolumeSpecName "kube-api-access-tt9jz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:26:29.247590 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.247555    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d08894c5-9e47-4b56-91dd-a88285405963-postgresdata\") pod \"d08894c5-9e47-4b56-91dd-a88285405963\" (UID: \"d08894c5-9e47-4b56-91dd-a88285405963\") "
Jul 28 08:26:29.248049 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.247669    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6njt\" (UniqueName: \"kubernetes.io/projected/d08894c5-9e47-4b56-91dd-a88285405963-kube-api-access-j6njt\") pod \"d08894c5-9e47-4b56-91dd-a88285405963\" (UID: \"d08894c5-9e47-4b56-91dd-a88285405963\") "
Jul 28 08:26:29.248049 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.247895    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt9jz\" (UniqueName: \"kubernetes.io/projected/ed4491a6-2fed-49dc-8509-692f2d9de18b-kube-api-access-tt9jz\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:26:29.249974 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.249946    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d08894c5-9e47-4b56-91dd-a88285405963-kube-api-access-j6njt" (OuterVolumeSpecName: "kube-api-access-j6njt") pod "d08894c5-9e47-4b56-91dd-a88285405963" (UID: "d08894c5-9e47-4b56-91dd-a88285405963"). InnerVolumeSpecName "kube-api-access-j6njt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:26:29.253069 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.253042    2583 generic.go:356] "Generic (PLEG): container finished" podID="d08894c5-9e47-4b56-91dd-a88285405963" containerID="fd0ee596182e58fc080c645c5aa3612e372c4fecff244e61e8c545e2cdc56105" exitCode=0
Jul 28 08:26:29.253194 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.253087    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-kd9pc"
Jul 28 08:26:29.253194 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.253119    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-kd9pc" event={"ID":"d08894c5-9e47-4b56-91dd-a88285405963","Type":"ContainerDied","Data":"fd0ee596182e58fc080c645c5aa3612e372c4fecff244e61e8c545e2cdc56105"}
Jul 28 08:26:29.253194 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.253158    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-kd9pc" event={"ID":"d08894c5-9e47-4b56-91dd-a88285405963","Type":"ContainerDied","Data":"06686ed2a3a9577696049535ce03de92c87dbd6d79e6fc455f9e178708b726ed"}
Jul 28 08:26:29.253194 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.253177    2583 scope.go:117] "RemoveContainer" containerID="fd0ee596182e58fc080c645c5aa3612e372c4fecff244e61e8c545e2cdc56105"
Jul 28 08:26:29.254437 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.254412    2583 generic.go:356] "Generic (PLEG): container finished" podID="ed4491a6-2fed-49dc-8509-692f2d9de18b" containerID="86f137e1a29cd2ede4f97b54cac72c728073fbb1435d838ec078e7a459eeb464" exitCode=0
Jul 28 08:26:29.254571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.254463    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-bngnj"
Jul 28 08:26:29.254571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.254479    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-bngnj" event={"ID":"ed4491a6-2fed-49dc-8509-692f2d9de18b","Type":"ContainerDied","Data":"86f137e1a29cd2ede4f97b54cac72c728073fbb1435d838ec078e7a459eeb464"}
Jul 28 08:26:29.254571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.254513    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-bngnj" event={"ID":"ed4491a6-2fed-49dc-8509-692f2d9de18b","Type":"ContainerDied","Data":"862a1fb603ff7b5046124525657945c4750fc687db23e1bb115d1016a4641345"}
Jul 28 08:26:29.263338 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.263312    2583 scope.go:117] "RemoveContainer" containerID="fd0ee596182e58fc080c645c5aa3612e372c4fecff244e61e8c545e2cdc56105"
Jul 28 08:26:29.263684 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:26:29.263663    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd0ee596182e58fc080c645c5aa3612e372c4fecff244e61e8c545e2cdc56105\": container with ID starting with fd0ee596182e58fc080c645c5aa3612e372c4fecff244e61e8c545e2cdc56105 not found: ID does not exist" containerID="fd0ee596182e58fc080c645c5aa3612e372c4fecff244e61e8c545e2cdc56105"
Jul 28 08:26:29.263775 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.263703    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd0ee596182e58fc080c645c5aa3612e372c4fecff244e61e8c545e2cdc56105"} err="failed to get container status \"fd0ee596182e58fc080c645c5aa3612e372c4fecff244e61e8c545e2cdc56105\": rpc error: code = NotFound desc = could not find container \"fd0ee596182e58fc080c645c5aa3612e372c4fecff244e61e8c545e2cdc56105\": container with ID starting with fd0ee596182e58fc080c645c5aa3612e372c4fecff244e61e8c545e2cdc56105 not found: ID does not exist"
Jul 28 08:26:29.263775 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.263721    2583 scope.go:117] "RemoveContainer" containerID="86f137e1a29cd2ede4f97b54cac72c728073fbb1435d838ec078e7a459eeb464"
Jul 28 08:26:29.272237 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.272219    2583 scope.go:117] "RemoveContainer" containerID="86f137e1a29cd2ede4f97b54cac72c728073fbb1435d838ec078e7a459eeb464"
Jul 28 08:26:29.272587 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:26:29.272564    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86f137e1a29cd2ede4f97b54cac72c728073fbb1435d838ec078e7a459eeb464\": container with ID starting with 86f137e1a29cd2ede4f97b54cac72c728073fbb1435d838ec078e7a459eeb464 not found: ID does not exist" containerID="86f137e1a29cd2ede4f97b54cac72c728073fbb1435d838ec078e7a459eeb464"
Jul 28 08:26:29.272678 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.272593    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86f137e1a29cd2ede4f97b54cac72c728073fbb1435d838ec078e7a459eeb464"} err="failed to get container status \"86f137e1a29cd2ede4f97b54cac72c728073fbb1435d838ec078e7a459eeb464\": rpc error: code = NotFound desc = could not find container \"86f137e1a29cd2ede4f97b54cac72c728073fbb1435d838ec078e7a459eeb464\": container with ID starting with 86f137e1a29cd2ede4f97b54cac72c728073fbb1435d838ec078e7a459eeb464 not found: ID does not exist"
Jul 28 08:26:29.275044 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.275024    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-bngnj"]
Jul 28 08:26:29.279050 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.279031    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-bngnj"]
Jul 28 08:26:29.280597 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.280572    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d08894c5-9e47-4b56-91dd-a88285405963-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "d08894c5-9e47-4b56-91dd-a88285405963" (UID: "d08894c5-9e47-4b56-91dd-a88285405963"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 08:26:29.334381 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.334354    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed4491a6-2fed-49dc-8509-692f2d9de18b" path="/var/lib/kubelet/pods/ed4491a6-2fed-49dc-8509-692f2d9de18b/volumes"
Jul 28 08:26:29.348481 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.348437    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6njt\" (UniqueName: \"kubernetes.io/projected/d08894c5-9e47-4b56-91dd-a88285405963-kube-api-access-j6njt\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:26:29.348583 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.348484    2583 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d08894c5-9e47-4b56-91dd-a88285405963-postgresdata\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:26:29.569195 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.569156    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-kd9pc"]
Jul 28 08:26:29.572752 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:29.572725    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-kd9pc"]
Jul 28 08:26:31.333580 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:31.333548    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d08894c5-9e47-4b56-91dd-a88285405963" path="/var/lib/kubelet/pods/d08894c5-9e47-4b56-91dd-a88285405963/volumes"
Jul 28 08:26:32.366958 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:32.366920    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jul 28 08:26:34.032114 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:34.032068    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jul 28 08:26:42.366928 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:42.366888    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jul 28 08:26:44.032373 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:44.032327    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jul 28 08:26:52.366690 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:52.366647    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jul 28 08:26:52.367075 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:52.366773    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:26:54.032270 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:54.032231    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jul 28 08:26:54.032717 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:54.032353    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:26:57.375666 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.375630    2583 generic.go:356] "Generic (PLEG): container finished" podID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerID="eeb9ceca4d7eb7cc4d026e19724872c08d755894f65eab5f3b68e771e51c1efd" exitCode=137
Jul 28 08:26:57.376130 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.375702    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" event={"ID":"4c63b1c0-e1a8-471f-92f2-53c480f0b943","Type":"ContainerDied","Data":"eeb9ceca4d7eb7cc4d026e19724872c08d755894f65eab5f3b68e771e51c1efd"}
Jul 28 08:26:57.378119 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.378096    2583 generic.go:356] "Generic (PLEG): container finished" podID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerID="5ddcec4d9e68402264dcc27f6c0b8c6ee006315844400ea0ec4a97575f8c434f" exitCode=137
Jul 28 08:26:57.378240 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.378155    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" event={"ID":"dbde2363-1f48-40ed-8bed-15653c2f29c2","Type":"ContainerDied","Data":"5ddcec4d9e68402264dcc27f6c0b8c6ee006315844400ea0ec4a97575f8c434f"}
Jul 28 08:26:57.614515 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.614487    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:26:57.617296 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.617277    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:26:57.689891 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.689800    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4c63b1c0-e1a8-471f-92f2-53c480f0b943-feast-data\") pod \"4c63b1c0-e1a8-471f-92f2-53c480f0b943\" (UID: \"4c63b1c0-e1a8-471f-92f2-53c480f0b943\") "
Jul 28 08:26:57.689891 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.689852    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/dbde2363-1f48-40ed-8bed-15653c2f29c2-feast-data\") pod \"dbde2363-1f48-40ed-8bed-15653c2f29c2\" (UID: \"dbde2363-1f48-40ed-8bed-15653c2f29c2\") "
Jul 28 08:26:57.689891 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.689884    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8rqx\" (UniqueName: \"kubernetes.io/projected/4c63b1c0-e1a8-471f-92f2-53c480f0b943-kube-api-access-m8rqx\") pod \"4c63b1c0-e1a8-471f-92f2-53c480f0b943\" (UID: \"4c63b1c0-e1a8-471f-92f2-53c480f0b943\") "
Jul 28 08:26:57.690250 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.689906    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/dbde2363-1f48-40ed-8bed-15653c2f29c2-online-tls\") pod \"dbde2363-1f48-40ed-8bed-15653c2f29c2\" (UID: \"dbde2363-1f48-40ed-8bed-15653c2f29c2\") "
Jul 28 08:26:57.690250 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.689920    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4c63b1c0-e1a8-471f-92f2-53c480f0b943-registry-tls\") pod \"4c63b1c0-e1a8-471f-92f2-53c480f0b943\" (UID: \"4c63b1c0-e1a8-471f-92f2-53c480f0b943\") "
Jul 28 08:26:57.690250 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.689954    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/dbde2363-1f48-40ed-8bed-15653c2f29c2-registry-tls\") pod \"dbde2363-1f48-40ed-8bed-15653c2f29c2\" (UID: \"dbde2363-1f48-40ed-8bed-15653c2f29c2\") "
Jul 28 08:26:57.690250 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.690008    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swpj2\" (UniqueName: \"kubernetes.io/projected/dbde2363-1f48-40ed-8bed-15653c2f29c2-kube-api-access-swpj2\") pod \"dbde2363-1f48-40ed-8bed-15653c2f29c2\" (UID: \"dbde2363-1f48-40ed-8bed-15653c2f29c2\") "
Jul 28 08:26:57.690250 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.690032    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4c63b1c0-e1a8-471f-92f2-53c480f0b943-online-tls\") pod \"4c63b1c0-e1a8-471f-92f2-53c480f0b943\" (UID: \"4c63b1c0-e1a8-471f-92f2-53c480f0b943\") "
Jul 28 08:26:57.690590 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.690329    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c63b1c0-e1a8-471f-92f2-53c480f0b943-feast-data" (OuterVolumeSpecName: "feast-data") pod "4c63b1c0-e1a8-471f-92f2-53c480f0b943" (UID: "4c63b1c0-e1a8-471f-92f2-53c480f0b943"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 08:26:57.692822 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.692790    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c63b1c0-e1a8-471f-92f2-53c480f0b943-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4c63b1c0-e1a8-471f-92f2-53c480f0b943" (UID: "4c63b1c0-e1a8-471f-92f2-53c480f0b943"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:26:57.692822 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.692807    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c63b1c0-e1a8-471f-92f2-53c480f0b943-online-tls" (OuterVolumeSpecName: "online-tls") pod "4c63b1c0-e1a8-471f-92f2-53c480f0b943" (UID: "4c63b1c0-e1a8-471f-92f2-53c480f0b943"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:26:57.693050 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.692790    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbde2363-1f48-40ed-8bed-15653c2f29c2-online-tls" (OuterVolumeSpecName: "online-tls") pod "dbde2363-1f48-40ed-8bed-15653c2f29c2" (UID: "dbde2363-1f48-40ed-8bed-15653c2f29c2"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:26:57.693050 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.692838    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c63b1c0-e1a8-471f-92f2-53c480f0b943-kube-api-access-m8rqx" (OuterVolumeSpecName: "kube-api-access-m8rqx") pod "4c63b1c0-e1a8-471f-92f2-53c480f0b943" (UID: "4c63b1c0-e1a8-471f-92f2-53c480f0b943"). InnerVolumeSpecName "kube-api-access-m8rqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:26:57.693246 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.693219    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbde2363-1f48-40ed-8bed-15653c2f29c2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "dbde2363-1f48-40ed-8bed-15653c2f29c2" (UID: "dbde2363-1f48-40ed-8bed-15653c2f29c2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:26:57.693351 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.693252    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbde2363-1f48-40ed-8bed-15653c2f29c2-kube-api-access-swpj2" (OuterVolumeSpecName: "kube-api-access-swpj2") pod "dbde2363-1f48-40ed-8bed-15653c2f29c2" (UID: "dbde2363-1f48-40ed-8bed-15653c2f29c2"). InnerVolumeSpecName "kube-api-access-swpj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:26:57.700061 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.700032    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbde2363-1f48-40ed-8bed-15653c2f29c2-feast-data" (OuterVolumeSpecName: "feast-data") pod "dbde2363-1f48-40ed-8bed-15653c2f29c2" (UID: "dbde2363-1f48-40ed-8bed-15653c2f29c2"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 08:26:57.790962 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.790923    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/dbde2363-1f48-40ed-8bed-15653c2f29c2-feast-data\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:26:57.790962 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.790957    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8rqx\" (UniqueName: \"kubernetes.io/projected/4c63b1c0-e1a8-471f-92f2-53c480f0b943-kube-api-access-m8rqx\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:26:57.791159 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.790990    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/dbde2363-1f48-40ed-8bed-15653c2f29c2-online-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:26:57.791159 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.790999    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4c63b1c0-e1a8-471f-92f2-53c480f0b943-registry-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:26:57.791159 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.791007    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/dbde2363-1f48-40ed-8bed-15653c2f29c2-registry-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:26:57.791159 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.791015    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swpj2\" (UniqueName: \"kubernetes.io/projected/dbde2363-1f48-40ed-8bed-15653c2f29c2-kube-api-access-swpj2\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:26:57.791159 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.791024    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4c63b1c0-e1a8-471f-92f2-53c480f0b943-online-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:26:57.791159 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:57.791032    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4c63b1c0-e1a8-471f-92f2-53c480f0b943-feast-data\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:26:58.384892 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:58.384864    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"
Jul 28 08:26:58.385342 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:58.384890    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8" event={"ID":"4c63b1c0-e1a8-471f-92f2-53c480f0b943","Type":"ContainerDied","Data":"726c1f96eedbfb28f189514d9ad0202f319eb60ec1c35adb265ad05c9e6b937d"}
Jul 28 08:26:58.385342 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:58.384953    2583 scope.go:117] "RemoveContainer" containerID="e5af3e697dc60e9114d3099d5172b0a16048e96743c879effb2e4cde129f4e5e"
Jul 28 08:26:58.387386 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:58.387369    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"
Jul 28 08:26:58.387513 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:58.387363    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7" event={"ID":"dbde2363-1f48-40ed-8bed-15653c2f29c2","Type":"ContainerDied","Data":"21f6cee9eae993918c75e04b75e3475d38c409326e28e1f007da6abea78efec7"}
Jul 28 08:26:58.394635 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:58.394477    2583 scope.go:117] "RemoveContainer" containerID="eeb9ceca4d7eb7cc4d026e19724872c08d755894f65eab5f3b68e771e51c1efd"
Jul 28 08:26:58.403025 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:58.403003    2583 scope.go:117] "RemoveContainer" containerID="0ce5172d0081a271264bf2b8c7b6d44b9b0a7cc9dd054acdf9cf80d33f83baf8"
Jul 28 08:26:58.410305 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:58.410276    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"]
Jul 28 08:26:58.410915 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:58.410894    2583 scope.go:117] "RemoveContainer" containerID="b9ebc9a409f115606d61090ca8ba65b3dacfbc67ba9ad86b130e41e89dde32c1"
Jul 28 08:26:58.414734 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:58.414707    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-f6ff77ccc-rwnq7"]
Jul 28 08:26:58.421145 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:58.421121    2583 scope.go:117] "RemoveContainer" containerID="ea701e9e1b4b1e0e42fd7c24163f24554821b395a86a897d580dd7f0ca00b2aa"
Jul 28 08:26:58.425999 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:58.425976    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"]
Jul 28 08:26:58.428795 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:58.428772    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6f46cd4454-l2nz8"]
Jul 28 08:26:58.430679 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:58.430658    2583 scope.go:117] "RemoveContainer" containerID="5ddcec4d9e68402264dcc27f6c0b8c6ee006315844400ea0ec4a97575f8c434f"
Jul 28 08:26:58.438824 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:58.438803    2583 scope.go:117] "RemoveContainer" containerID="91c02e308979015f385bdad7dfe04ea919e47d7e83a863a7003d88698b9ffa73"
Jul 28 08:26:58.446065 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:58.446045    2583 scope.go:117] "RemoveContainer" containerID="08b7c3d08f848837b87d886b21d5b3743cee00b2127b2086fd233ea6bbe8e90d"
Jul 28 08:26:59.333484 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:59.333434    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" path="/var/lib/kubelet/pods/4c63b1c0-e1a8-471f-92f2-53c480f0b943/volumes"
Jul 28 08:26:59.333965 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:26:59.333951    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" path="/var/lib/kubelet/pods/dbde2363-1f48-40ed-8bed-15653c2f29c2/volumes"
Jul 28 08:27:15.755880 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.755843    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"]
Jul 28 08:27:15.756511 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756335    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerName="feast-apply"
Jul 28 08:27:15.756511 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756356    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerName="feast-apply"
Jul 28 08:27:15.756511 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756370    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerName="online"
Jul 28 08:27:15.756511 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756378    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerName="online"
Jul 28 08:27:15.756511 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756397    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerName="feast-init"
Jul 28 08:27:15.756511 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756405    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerName="feast-init"
Jul 28 08:27:15.756511 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756421    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d08894c5-9e47-4b56-91dd-a88285405963" containerName="postgres"
Jul 28 08:27:15.756511 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756429    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d08894c5-9e47-4b56-91dd-a88285405963" containerName="postgres"
Jul 28 08:27:15.756511 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756441    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerName="feast-apply"
Jul 28 08:27:15.756511 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756468    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerName="feast-apply"
Jul 28 08:27:15.756511 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756481    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed4491a6-2fed-49dc-8509-692f2d9de18b" containerName="redis"
Jul 28 08:27:15.756511 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756489    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed4491a6-2fed-49dc-8509-692f2d9de18b" containerName="redis"
Jul 28 08:27:15.756511 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756504    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerName="registry"
Jul 28 08:27:15.756511 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756511    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerName="registry"
Jul 28 08:27:15.757295 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756523    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerName="online"
Jul 28 08:27:15.757295 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756531    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerName="online"
Jul 28 08:27:15.757295 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756538    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerName="registry"
Jul 28 08:27:15.757295 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756545    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerName="registry"
Jul 28 08:27:15.757295 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756556    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerName="feast-init"
Jul 28 08:27:15.757295 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756564    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerName="feast-init"
Jul 28 08:27:15.757295 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756650    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed4491a6-2fed-49dc-8509-692f2d9de18b" containerName="redis"
Jul 28 08:27:15.757295 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756663    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerName="registry"
Jul 28 08:27:15.757295 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756672    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbde2363-1f48-40ed-8bed-15653c2f29c2" containerName="online"
Jul 28 08:27:15.757295 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756681    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerName="online"
Jul 28 08:27:15.757295 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756692    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d08894c5-9e47-4b56-91dd-a88285405963" containerName="postgres"
Jul 28 08:27:15.757295 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.756701    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c63b1c0-e1a8-471f-92f2-53c480f0b943" containerName="registry"
Jul 28 08:27:15.760480 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.760437    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:15.763565 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.763542    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jul 28 08:27:15.763671 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.763567    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jul 28 08:27:15.763671 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.763574    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jul 28 08:27:15.763671 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.763626    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 28 08:27:15.763919 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.763901    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jul 28 08:27:15.764524 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.764501    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-chlx7\""
Jul 28 08:27:15.764710 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.764692    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 28 08:27:15.773527 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.773505    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"]
Jul 28 08:27:15.842347 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.842315    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-5d9dj\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:15.842347 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.842349    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-5d9dj\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:15.842594 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.842374    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkxgv\" (UniqueName: \"kubernetes.io/projected/8c035c04-f79b-4429-844b-43108887fe85-kube-api-access-rkxgv\") pod \"feast-simple-feast-setup-777d6cc998-5d9dj\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:15.842594 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.842473    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8c035c04-f79b-4429-844b-43108887fe85-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-5d9dj\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:15.842594 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.842530    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-5d9dj\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:15.842594 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.842578    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-5d9dj\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:15.943122 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.943086    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8c035c04-f79b-4429-844b-43108887fe85-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-5d9dj\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:15.943313 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.943140    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-5d9dj\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:15.943313 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.943167    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-5d9dj\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:15.943313 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.943209    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-5d9dj\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:15.943313 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.943227    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-5d9dj\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:15.943313 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.943253    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkxgv\" (UniqueName: \"kubernetes.io/projected/8c035c04-f79b-4429-844b-43108887fe85-kube-api-access-rkxgv\") pod \"feast-simple-feast-setup-777d6cc998-5d9dj\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:15.943313 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:27:15.943288    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jul 28 08:27:15.943628 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:27:15.943369    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-ui-tls podName:8c035c04-f79b-4429-844b-43108887fe85 nodeName:}" failed. No retries permitted until 2026-07-28 08:27:16.443347249 +0000 UTC m=+1471.630535380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-ui-tls") pod "feast-simple-feast-setup-777d6cc998-5d9dj" (UID: "8c035c04-f79b-4429-844b-43108887fe85") : secret "feast-simple-feast-setup-ui-tls" not found
Jul 28 08:27:15.943628 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:27:15.943377    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jul 28 08:27:15.943628 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:27:15.943475    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-online-tls podName:8c035c04-f79b-4429-844b-43108887fe85 nodeName:}" failed. No retries permitted until 2026-07-28 08:27:16.44342934 +0000 UTC m=+1471.630617453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-online-tls") pod "feast-simple-feast-setup-777d6cc998-5d9dj" (UID: "8c035c04-f79b-4429-844b-43108887fe85") : secret "feast-simple-feast-setup-online-tls" not found
Jul 28 08:27:15.943628 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.943572    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8c035c04-f79b-4429-844b-43108887fe85-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-5d9dj\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:15.945759 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.945739    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-5d9dj\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:15.945923 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.945902    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-5d9dj\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:15.951270 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:15.951246    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkxgv\" (UniqueName: \"kubernetes.io/projected/8c035c04-f79b-4429-844b-43108887fe85-kube-api-access-rkxgv\") pod \"feast-simple-feast-setup-777d6cc998-5d9dj\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:16.447134 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:16.447094    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-5d9dj\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:16.447319 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:16.447175    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-5d9dj\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:16.449945 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:16.449922    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-5d9dj\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:16.450022 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:16.449933    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-5d9dj\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:16.686421 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:16.686375    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:16.837402 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:16.837377    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"]
Jul 28 08:27:16.839457 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:27:16.839420    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c035c04_f79b_4429_844b_43108887fe85.slice/crio-244388f0942337595516a019e60010ceb5f69b82b0161d87ea434f6b8991906c WatchSource:0}: Error finding container 244388f0942337595516a019e60010ceb5f69b82b0161d87ea434f6b8991906c: Status 404 returned error can't find the container with id 244388f0942337595516a019e60010ceb5f69b82b0161d87ea434f6b8991906c
Jul 28 08:27:16.841292 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:16.841274    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 08:27:17.467587 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:17.467553    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" event={"ID":"8c035c04-f79b-4429-844b-43108887fe85","Type":"ContainerStarted","Data":"244388f0942337595516a019e60010ceb5f69b82b0161d87ea434f6b8991906c"}
Jul 28 08:27:31.543416 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:31.543379    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" event={"ID":"8c035c04-f79b-4429-844b-43108887fe85","Type":"ContainerStarted","Data":"fcebb6cc9885cad0631da8711e60596abe947fffbcff52962456b36ce17a8224"}
Jul 28 08:27:36.565284 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:36.565253    2583 generic.go:356] "Generic (PLEG): container finished" podID="8c035c04-f79b-4429-844b-43108887fe85" containerID="fcebb6cc9885cad0631da8711e60596abe947fffbcff52962456b36ce17a8224" exitCode=0
Jul 28 08:27:36.565701 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:36.565336    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" event={"ID":"8c035c04-f79b-4429-844b-43108887fe85","Type":"ContainerDied","Data":"fcebb6cc9885cad0631da8711e60596abe947fffbcff52962456b36ce17a8224"}
Jul 28 08:27:37.572497 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:37.572463    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" event={"ID":"8c035c04-f79b-4429-844b-43108887fe85","Type":"ContainerStarted","Data":"5c155eebe803c0aa03101bf90cbee338b233877273cdc77d2ae27a467dd30407"}
Jul 28 08:27:42.597307 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:42.597218    2583 generic.go:356] "Generic (PLEG): container finished" podID="8c035c04-f79b-4429-844b-43108887fe85" containerID="5c155eebe803c0aa03101bf90cbee338b233877273cdc77d2ae27a467dd30407" exitCode=0
Jul 28 08:27:42.597307 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:42.597264    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" event={"ID":"8c035c04-f79b-4429-844b-43108887fe85","Type":"ContainerDied","Data":"5c155eebe803c0aa03101bf90cbee338b233877273cdc77d2ae27a467dd30407"}
Jul 28 08:27:43.607671 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:43.607632    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" event={"ID":"8c035c04-f79b-4429-844b-43108887fe85","Type":"ContainerStarted","Data":"f28541756cd66483daee60d468a94eedbdbd2af8c9bc19e550488ac0292526e7"}
Jul 28 08:27:43.608135 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:43.607709    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" event={"ID":"8c035c04-f79b-4429-844b-43108887fe85","Type":"ContainerStarted","Data":"4503890a4c971445d82d8d6c980e207019abd1e10baee10eae1b8cdf964b46bb"}
Jul 28 08:27:43.608135 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:43.607734    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" event={"ID":"8c035c04-f79b-4429-844b-43108887fe85","Type":"ContainerStarted","Data":"1bab481a21efe5db49c1921f4129f5c86b49edcad7b57478b52d0e51b8b71885"}
Jul 28 08:27:43.608135 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:43.607752    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" event={"ID":"8c035c04-f79b-4429-844b-43108887fe85","Type":"ContainerStarted","Data":"bdc63cab93a484ef27ac8a1b75e6092cb50ee6eb4d5e5f26fca9b4a5b2f668e6"}
Jul 28 08:27:43.634112 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:43.634043    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" podStartSLOduration=14.544439601 podStartE2EDuration="28.634019013s" totalImagesPullingTime="14.089579412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:27:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:27:43.632574996 +0000 UTC m=+1498.819763127" watchObservedRunningTime="2026-07-28 08:27:43.634019013 +0000 UTC m=+1498.821207144"
Jul 28 08:27:43.687587 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:43.687504    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:43.687587 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:43.687569    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:43.687587 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:43.687591    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:43.687910 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:43.687609    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:43.689885 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:43.689837    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Jul 28 08:27:43.690034 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:43.689837    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.36:6571: connect: connection refused"
Jul 28 08:27:43.690034 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:43.689884    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.36:8816: connect: connection refused"
Jul 28 08:27:43.690199 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:43.690169    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Jul 28 08:27:46.686539 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:46.686498    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:46.687046 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:46.686565    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:46.687046 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:46.686588    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:46.687046 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:46.686607    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:46.687046 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:46.686775    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Jul 28 08:27:46.687046 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:46.686775    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.36:6571: connect: connection refused"
Jul 28 08:27:46.687339 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:46.687265    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Jul 28 08:27:46.687339 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:46.687306    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.36:8816: connect: connection refused"
Jul 28 08:27:48.603003 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:48.602892    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vgzf4_dcf82623-a4f7-4511-aed0-7248950f1ca1/console-operator/1.log"
Jul 28 08:27:48.621990 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:48.606051    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vgzf4_dcf82623-a4f7-4511-aed0-7248950f1ca1/console-operator/1.log"
Jul 28 08:27:48.621990 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:48.611217    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-acl-logging/0.log"
Jul 28 08:27:48.621990 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:48.614138    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-acl-logging/0.log"
Jul 28 08:27:49.687934 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:49.687901    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:49.688314 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:49.688003    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:49.688314 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:49.688224    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:49.688939 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:49.688896    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:49.689076 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:49.688964    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:49.689132 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:49.689116    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:49.695116 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:49.695101    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:27:50.650355 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:27:50.650329    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:28:52.141079 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.141041    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"]
Jul 28 08:28:52.141643 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.141335    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="registry" containerID="cri-o://bdc63cab93a484ef27ac8a1b75e6092cb50ee6eb4d5e5f26fca9b4a5b2f668e6" gracePeriod=30
Jul 28 08:28:52.141643 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.141597    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="ui" containerID="cri-o://f28541756cd66483daee60d468a94eedbdbd2af8c9bc19e550488ac0292526e7" gracePeriod=30
Jul 28 08:28:52.142680 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.141773    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="offline" containerID="cri-o://4503890a4c971445d82d8d6c980e207019abd1e10baee10eae1b8cdf964b46bb" gracePeriod=30
Jul 28 08:28:52.142680 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.141988    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="online" containerID="cri-o://1bab481a21efe5db49c1921f4129f5c86b49edcad7b57478b52d0e51b8b71885" gracePeriod=30
Jul 28 08:28:52.428998 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.428914    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"]
Jul 28 08:28:52.432931 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.432915    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:28:52.435263 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.435239    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-8792n\""
Jul 28 08:28:52.443520 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.443494    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"]
Jul 28 08:28:52.483901 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.483864    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtb6d\" (UniqueName: \"kubernetes.io/projected/398ff389-11f1-4dd5-812b-89b2df67bfdc-kube-api-access-gtb6d\") pod \"feast-simple-feast-setup-777d6cc998-xrk56\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:28:52.484103 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.483928    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-xrk56\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:28:52.484103 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.484016    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-xrk56\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:28:52.484103 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.484056    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-xrk56\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:28:52.484103 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.484091    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/398ff389-11f1-4dd5-812b-89b2df67bfdc-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-xrk56\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:28:52.484276 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.484127    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-xrk56\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:28:52.585087 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.585052    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtb6d\" (UniqueName: \"kubernetes.io/projected/398ff389-11f1-4dd5-812b-89b2df67bfdc-kube-api-access-gtb6d\") pod \"feast-simple-feast-setup-777d6cc998-xrk56\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:28:52.585304 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.585118    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-xrk56\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:28:52.585304 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.585154    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-xrk56\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:28:52.585304 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.585179    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-xrk56\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:28:52.585304 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.585204    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/398ff389-11f1-4dd5-812b-89b2df67bfdc-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-xrk56\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:28:52.585304 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.585238    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-xrk56\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:28:52.585613 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:28:52.585355    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jul 28 08:28:52.585613 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:28:52.585428    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-ui-tls podName:398ff389-11f1-4dd5-812b-89b2df67bfdc nodeName:}" failed. No retries permitted until 2026-07-28 08:28:53.085406987 +0000 UTC m=+1568.272595115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-ui-tls") pod "feast-simple-feast-setup-777d6cc998-xrk56" (UID: "398ff389-11f1-4dd5-812b-89b2df67bfdc") : secret "feast-simple-feast-setup-ui-tls" not found
Jul 28 08:28:52.585737 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.585685    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/398ff389-11f1-4dd5-812b-89b2df67bfdc-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-xrk56\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:28:52.588152 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.588122    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-xrk56\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:28:52.588295 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.588122    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-xrk56\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:28:52.588295 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.588244    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-xrk56\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:28:52.593475 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.593434    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtb6d\" (UniqueName: \"kubernetes.io/projected/398ff389-11f1-4dd5-812b-89b2df67bfdc-kube-api-access-gtb6d\") pod \"feast-simple-feast-setup-777d6cc998-xrk56\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:28:52.906507 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.906471    2583 generic.go:356] "Generic (PLEG): container finished" podID="8c035c04-f79b-4429-844b-43108887fe85" containerID="f28541756cd66483daee60d468a94eedbdbd2af8c9bc19e550488ac0292526e7" exitCode=0
Jul 28 08:28:52.906507 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.906495    2583 generic.go:356] "Generic (PLEG): container finished" podID="8c035c04-f79b-4429-844b-43108887fe85" containerID="1bab481a21efe5db49c1921f4129f5c86b49edcad7b57478b52d0e51b8b71885" exitCode=0
Jul 28 08:28:52.906715 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.906549    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" event={"ID":"8c035c04-f79b-4429-844b-43108887fe85","Type":"ContainerDied","Data":"f28541756cd66483daee60d468a94eedbdbd2af8c9bc19e550488ac0292526e7"}
Jul 28 08:28:52.906715 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:52.906592    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" event={"ID":"8c035c04-f79b-4429-844b-43108887fe85","Type":"ContainerDied","Data":"1bab481a21efe5db49c1921f4129f5c86b49edcad7b57478b52d0e51b8b71885"}
Jul 28 08:28:53.089081 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:53.088996    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-xrk56\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:28:53.091573 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:53.091551    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-xrk56\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:28:53.342649 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:53.342569    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:28:53.483261 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:53.483148    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"]
Jul 28 08:28:53.485534 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:28:53.485510    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod398ff389_11f1_4dd5_812b_89b2df67bfdc.slice/crio-f907ece6a562d5e85306a9d0eb8ea753a807a77e63d25e132aee00a0faca2acb WatchSource:0}: Error finding container f907ece6a562d5e85306a9d0eb8ea753a807a77e63d25e132aee00a0faca2acb: Status 404 returned error can't find the container with id f907ece6a562d5e85306a9d0eb8ea753a807a77e63d25e132aee00a0faca2acb
Jul 28 08:28:53.911804 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:53.911764    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" event={"ID":"398ff389-11f1-4dd5-812b-89b2df67bfdc","Type":"ContainerStarted","Data":"aa7816c000942b18b400f7eb19fd8dd49dc1e8272de63ecf0a864be24a03bec9"}
Jul 28 08:28:53.911804 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:53.911814    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" event={"ID":"398ff389-11f1-4dd5-812b-89b2df67bfdc","Type":"ContainerStarted","Data":"f907ece6a562d5e85306a9d0eb8ea753a807a77e63d25e132aee00a0faca2acb"}
Jul 28 08:28:58.934544 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:58.934510    2583 generic.go:356] "Generic (PLEG): container finished" podID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerID="aa7816c000942b18b400f7eb19fd8dd49dc1e8272de63ecf0a864be24a03bec9" exitCode=0
Jul 28 08:28:58.934951 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:58.934585    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" event={"ID":"398ff389-11f1-4dd5-812b-89b2df67bfdc","Type":"ContainerDied","Data":"aa7816c000942b18b400f7eb19fd8dd49dc1e8272de63ecf0a864be24a03bec9"}
Jul 28 08:28:59.689206 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:59.689156    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Jul 28 08:28:59.941497 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:28:59.941400    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" event={"ID":"398ff389-11f1-4dd5-812b-89b2df67bfdc","Type":"ContainerStarted","Data":"ab531146a1b866014893e70c43e7648591797beee4ed627b62c6b3e9c0cbe9e8"}
Jul 28 08:29:00.647723 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:00.647672    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Jul 28 08:29:04.966040 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:04.965956    2583 generic.go:356] "Generic (PLEG): container finished" podID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerID="ab531146a1b866014893e70c43e7648591797beee4ed627b62c6b3e9c0cbe9e8" exitCode=0
Jul 28 08:29:04.966482 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:04.966034    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" event={"ID":"398ff389-11f1-4dd5-812b-89b2df67bfdc","Type":"ContainerDied","Data":"ab531146a1b866014893e70c43e7648591797beee4ed627b62c6b3e9c0cbe9e8"}
Jul 28 08:29:05.977609 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:05.977566    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" event={"ID":"398ff389-11f1-4dd5-812b-89b2df67bfdc","Type":"ContainerStarted","Data":"c69a6a196e03c42795e7d2bdd0e6d2005f5fe885ef90571f9759ab67a9224804"}
Jul 28 08:29:05.978121 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:05.977638    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" event={"ID":"398ff389-11f1-4dd5-812b-89b2df67bfdc","Type":"ContainerStarted","Data":"00dc0b2abedc7e85d6bc85d7880eec77ef55263f4b959f98de7048ed9fad0bf9"}
Jul 28 08:29:05.978121 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:05.977660    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" event={"ID":"398ff389-11f1-4dd5-812b-89b2df67bfdc","Type":"ContainerStarted","Data":"3988710100d8e33325f0142602d15ee9478f25173119f00860353fdcaed21275"}
Jul 28 08:29:05.978121 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:05.977678    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" event={"ID":"398ff389-11f1-4dd5-812b-89b2df67bfdc","Type":"ContainerStarted","Data":"cdb53732ccc62ce9eebad6be8df2f20cc2ba375c963c59225874ee542ca5849c"}
Jul 28 08:29:08.343249 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:08.343207    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:29:08.344010 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:08.343977    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:29:08.344010 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:08.344013    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:29:08.344209 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:08.344031    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:29:08.345514 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:08.345480    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Jul 28 08:29:08.345634 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:08.345524    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Jul 28 08:29:08.345698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:08.345633    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.37:8816: connect: connection refused"
Jul 28 08:29:08.345797 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:08.345503    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.37:6571: connect: connection refused"
Jul 28 08:29:09.688986 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:09.688941    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Jul 28 08:29:10.647800 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:10.647753    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Jul 28 08:29:11.343757 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:11.343710    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Jul 28 08:29:11.344597 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:11.344574    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:29:11.344726 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:11.344704    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:29:11.345190 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:11.345169    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:29:11.345293 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:11.345204    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:29:11.345433 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:11.345415    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:29:11.345567 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:11.345553    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:29:11.351621 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:11.351598    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:29:11.372018 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:11.371970    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" podStartSLOduration=19.371954212 podStartE2EDuration="19.371954212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:28:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:29:06.005056673 +0000 UTC m=+1581.192244828" watchObservedRunningTime="2026-07-28 08:29:11.371954212 +0000 UTC m=+1586.559142343"
Jul 28 08:29:12.011108 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:12.011078    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:29:12.014369 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:12.014349    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:29:13.343653 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:13.343615    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:29:14.343651 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:14.343613    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:29:15.023986 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:15.023953    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:29:19.689719 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:19.689666    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Jul 28 08:29:19.690181 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:19.689818    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:29:20.647707 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:20.647664    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Jul 28 08:29:20.647903 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:20.647785    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:29:22.790874 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:22.790850    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:29:22.951572 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:22.951492    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-registry-tls\") pod \"8c035c04-f79b-4429-844b-43108887fe85\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") "
Jul 28 08:29:22.951572 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:22.951555    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkxgv\" (UniqueName: \"kubernetes.io/projected/8c035c04-f79b-4429-844b-43108887fe85-kube-api-access-rkxgv\") pod \"8c035c04-f79b-4429-844b-43108887fe85\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") "
Jul 28 08:29:22.951801 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:22.951579    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8c035c04-f79b-4429-844b-43108887fe85-feast-data\") pod \"8c035c04-f79b-4429-844b-43108887fe85\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") "
Jul 28 08:29:22.951801 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:22.951597    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-online-tls\") pod \"8c035c04-f79b-4429-844b-43108887fe85\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") "
Jul 28 08:29:22.951801 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:22.951622    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-offline-tls\") pod \"8c035c04-f79b-4429-844b-43108887fe85\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") "
Jul 28 08:29:22.951801 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:22.951673    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-ui-tls\") pod \"8c035c04-f79b-4429-844b-43108887fe85\" (UID: \"8c035c04-f79b-4429-844b-43108887fe85\") "
Jul 28 08:29:22.952197 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:22.952168    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c035c04-f79b-4429-844b-43108887fe85-feast-data" (OuterVolumeSpecName: "feast-data") pod "8c035c04-f79b-4429-844b-43108887fe85" (UID: "8c035c04-f79b-4429-844b-43108887fe85"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 08:29:22.954167 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:22.954136    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "8c035c04-f79b-4429-844b-43108887fe85" (UID: "8c035c04-f79b-4429-844b-43108887fe85"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:29:22.954167 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:22.954149    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-online-tls" (OuterVolumeSpecName: "online-tls") pod "8c035c04-f79b-4429-844b-43108887fe85" (UID: "8c035c04-f79b-4429-844b-43108887fe85"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:29:22.954314 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:22.954173    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "8c035c04-f79b-4429-844b-43108887fe85" (UID: "8c035c04-f79b-4429-844b-43108887fe85"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:29:22.954314 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:22.954285    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8c035c04-f79b-4429-844b-43108887fe85" (UID: "8c035c04-f79b-4429-844b-43108887fe85"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:29:22.954314 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:22.954301    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c035c04-f79b-4429-844b-43108887fe85-kube-api-access-rkxgv" (OuterVolumeSpecName: "kube-api-access-rkxgv") pod "8c035c04-f79b-4429-844b-43108887fe85" (UID: "8c035c04-f79b-4429-844b-43108887fe85"). InnerVolumeSpecName "kube-api-access-rkxgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:29:23.052808 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.052759    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-registry-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:29:23.052808 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.052793    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkxgv\" (UniqueName: \"kubernetes.io/projected/8c035c04-f79b-4429-844b-43108887fe85-kube-api-access-rkxgv\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:29:23.052808 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.052803    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8c035c04-f79b-4429-844b-43108887fe85-feast-data\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:29:23.052808 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.052811    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-online-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:29:23.052808 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.052821    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-offline-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:29:23.053169 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.052828    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8c035c04-f79b-4429-844b-43108887fe85-ui-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:29:23.063885 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.063836    2583 generic.go:356] "Generic (PLEG): container finished" podID="8c035c04-f79b-4429-844b-43108887fe85" containerID="4503890a4c971445d82d8d6c980e207019abd1e10baee10eae1b8cdf964b46bb" exitCode=137
Jul 28 08:29:23.063885 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.063875    2583 generic.go:356] "Generic (PLEG): container finished" podID="8c035c04-f79b-4429-844b-43108887fe85" containerID="bdc63cab93a484ef27ac8a1b75e6092cb50ee6eb4d5e5f26fca9b4a5b2f668e6" exitCode=137
Jul 28 08:29:23.064118 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.063951    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" event={"ID":"8c035c04-f79b-4429-844b-43108887fe85","Type":"ContainerDied","Data":"4503890a4c971445d82d8d6c980e207019abd1e10baee10eae1b8cdf964b46bb"}
Jul 28 08:29:23.064118 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.063999    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" event={"ID":"8c035c04-f79b-4429-844b-43108887fe85","Type":"ContainerDied","Data":"bdc63cab93a484ef27ac8a1b75e6092cb50ee6eb4d5e5f26fca9b4a5b2f668e6"}
Jul 28 08:29:23.064118 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.064021    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj" event={"ID":"8c035c04-f79b-4429-844b-43108887fe85","Type":"ContainerDied","Data":"244388f0942337595516a019e60010ceb5f69b82b0161d87ea434f6b8991906c"}
Jul 28 08:29:23.064118 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.064051    2583 scope.go:117] "RemoveContainer" containerID="f28541756cd66483daee60d468a94eedbdbd2af8c9bc19e550488ac0292526e7"
Jul 28 08:29:23.064314 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.064307    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"
Jul 28 08:29:23.074252 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.074235    2583 scope.go:117] "RemoveContainer" containerID="4503890a4c971445d82d8d6c980e207019abd1e10baee10eae1b8cdf964b46bb"
Jul 28 08:29:23.082122 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.082103    2583 scope.go:117] "RemoveContainer" containerID="1bab481a21efe5db49c1921f4129f5c86b49edcad7b57478b52d0e51b8b71885"
Jul 28 08:29:23.090155 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.090136    2583 scope.go:117] "RemoveContainer" containerID="bdc63cab93a484ef27ac8a1b75e6092cb50ee6eb4d5e5f26fca9b4a5b2f668e6"
Jul 28 08:29:23.090435 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.090413    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"]
Jul 28 08:29:23.093796 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.093774    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-5d9dj"]
Jul 28 08:29:23.098262 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.098236    2583 scope.go:117] "RemoveContainer" containerID="5c155eebe803c0aa03101bf90cbee338b233877273cdc77d2ae27a467dd30407"
Jul 28 08:29:23.105698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.105679    2583 scope.go:117] "RemoveContainer" containerID="fcebb6cc9885cad0631da8711e60596abe947fffbcff52962456b36ce17a8224"
Jul 28 08:29:23.112986 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.112971    2583 scope.go:117] "RemoveContainer" containerID="f28541756cd66483daee60d468a94eedbdbd2af8c9bc19e550488ac0292526e7"
Jul 28 08:29:23.113255 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:29:23.113236    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f28541756cd66483daee60d468a94eedbdbd2af8c9bc19e550488ac0292526e7\": container with ID starting with f28541756cd66483daee60d468a94eedbdbd2af8c9bc19e550488ac0292526e7 not found: ID does not exist" containerID="f28541756cd66483daee60d468a94eedbdbd2af8c9bc19e550488ac0292526e7"
Jul 28 08:29:23.113297 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.113265    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f28541756cd66483daee60d468a94eedbdbd2af8c9bc19e550488ac0292526e7"} err="failed to get container status \"f28541756cd66483daee60d468a94eedbdbd2af8c9bc19e550488ac0292526e7\": rpc error: code = NotFound desc = could not find container \"f28541756cd66483daee60d468a94eedbdbd2af8c9bc19e550488ac0292526e7\": container with ID starting with f28541756cd66483daee60d468a94eedbdbd2af8c9bc19e550488ac0292526e7 not found: ID does not exist"
Jul 28 08:29:23.113297 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.113284    2583 scope.go:117] "RemoveContainer" containerID="4503890a4c971445d82d8d6c980e207019abd1e10baee10eae1b8cdf964b46bb"
Jul 28 08:29:23.113548 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:29:23.113527    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4503890a4c971445d82d8d6c980e207019abd1e10baee10eae1b8cdf964b46bb\": container with ID starting with 4503890a4c971445d82d8d6c980e207019abd1e10baee10eae1b8cdf964b46bb not found: ID does not exist" containerID="4503890a4c971445d82d8d6c980e207019abd1e10baee10eae1b8cdf964b46bb"
Jul 28 08:29:23.113607 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.113554    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4503890a4c971445d82d8d6c980e207019abd1e10baee10eae1b8cdf964b46bb"} err="failed to get container status \"4503890a4c971445d82d8d6c980e207019abd1e10baee10eae1b8cdf964b46bb\": rpc error: code = NotFound desc = could not find container \"4503890a4c971445d82d8d6c980e207019abd1e10baee10eae1b8cdf964b46bb\": container with ID starting with 4503890a4c971445d82d8d6c980e207019abd1e10baee10eae1b8cdf964b46bb not found: ID does not exist"
Jul 28 08:29:23.113607 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.113571    2583 scope.go:117] "RemoveContainer" containerID="1bab481a21efe5db49c1921f4129f5c86b49edcad7b57478b52d0e51b8b71885"
Jul 28 08:29:23.113813 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:29:23.113798    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bab481a21efe5db49c1921f4129f5c86b49edcad7b57478b52d0e51b8b71885\": container with ID starting with 1bab481a21efe5db49c1921f4129f5c86b49edcad7b57478b52d0e51b8b71885 not found: ID does not exist" containerID="1bab481a21efe5db49c1921f4129f5c86b49edcad7b57478b52d0e51b8b71885"
Jul 28 08:29:23.113849 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.113817    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bab481a21efe5db49c1921f4129f5c86b49edcad7b57478b52d0e51b8b71885"} err="failed to get container status \"1bab481a21efe5db49c1921f4129f5c86b49edcad7b57478b52d0e51b8b71885\": rpc error: code = NotFound desc = could not find container \"1bab481a21efe5db49c1921f4129f5c86b49edcad7b57478b52d0e51b8b71885\": container with ID starting with 1bab481a21efe5db49c1921f4129f5c86b49edcad7b57478b52d0e51b8b71885 not found: ID does not exist"
Jul 28 08:29:23.113849 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.113835    2583 scope.go:117] "RemoveContainer" containerID="bdc63cab93a484ef27ac8a1b75e6092cb50ee6eb4d5e5f26fca9b4a5b2f668e6"
Jul 28 08:29:23.114073 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:29:23.114058    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdc63cab93a484ef27ac8a1b75e6092cb50ee6eb4d5e5f26fca9b4a5b2f668e6\": container with ID starting with bdc63cab93a484ef27ac8a1b75e6092cb50ee6eb4d5e5f26fca9b4a5b2f668e6 not found: ID does not exist" containerID="bdc63cab93a484ef27ac8a1b75e6092cb50ee6eb4d5e5f26fca9b4a5b2f668e6"
Jul 28 08:29:23.114109 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.114079    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdc63cab93a484ef27ac8a1b75e6092cb50ee6eb4d5e5f26fca9b4a5b2f668e6"} err="failed to get container status \"bdc63cab93a484ef27ac8a1b75e6092cb50ee6eb4d5e5f26fca9b4a5b2f668e6\": rpc error: code = NotFound desc = could not find container \"bdc63cab93a484ef27ac8a1b75e6092cb50ee6eb4d5e5f26fca9b4a5b2f668e6\": container with ID starting with bdc63cab93a484ef27ac8a1b75e6092cb50ee6eb4d5e5f26fca9b4a5b2f668e6 not found: ID does not exist"
Jul 28 08:29:23.114109 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.114093    2583 scope.go:117] "RemoveContainer" containerID="5c155eebe803c0aa03101bf90cbee338b233877273cdc77d2ae27a467dd30407"
Jul 28 08:29:23.114319 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:29:23.114304    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c155eebe803c0aa03101bf90cbee338b233877273cdc77d2ae27a467dd30407\": container with ID starting with 5c155eebe803c0aa03101bf90cbee338b233877273cdc77d2ae27a467dd30407 not found: ID does not exist" containerID="5c155eebe803c0aa03101bf90cbee338b233877273cdc77d2ae27a467dd30407"
Jul 28 08:29:23.114357 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.114322    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c155eebe803c0aa03101bf90cbee338b233877273cdc77d2ae27a467dd30407"} err="failed to get container status \"5c155eebe803c0aa03101bf90cbee338b233877273cdc77d2ae27a467dd30407\": rpc error: code = NotFound desc = could not find container \"5c155eebe803c0aa03101bf90cbee338b233877273cdc77d2ae27a467dd30407\": container with ID starting with 5c155eebe803c0aa03101bf90cbee338b233877273cdc77d2ae27a467dd30407 not found: ID does not exist"
Jul 28 08:29:23.114357 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.114334    2583 scope.go:117] "RemoveContainer" containerID="fcebb6cc9885cad0631da8711e60596abe947fffbcff52962456b36ce17a8224"
Jul 28 08:29:23.114552 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:29:23.114535    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcebb6cc9885cad0631da8711e60596abe947fffbcff52962456b36ce17a8224\": container with ID starting with fcebb6cc9885cad0631da8711e60596abe947fffbcff52962456b36ce17a8224 not found: ID does not exist" containerID="fcebb6cc9885cad0631da8711e60596abe947fffbcff52962456b36ce17a8224"
Jul 28 08:29:23.114596 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.114556    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcebb6cc9885cad0631da8711e60596abe947fffbcff52962456b36ce17a8224"} err="failed to get container status \"fcebb6cc9885cad0631da8711e60596abe947fffbcff52962456b36ce17a8224\": rpc error: code = NotFound desc = could not find container \"fcebb6cc9885cad0631da8711e60596abe947fffbcff52962456b36ce17a8224\": container with ID starting with fcebb6cc9885cad0631da8711e60596abe947fffbcff52962456b36ce17a8224 not found: ID does not exist"
Jul 28 08:29:23.114596 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.114572    2583 scope.go:117] "RemoveContainer" containerID="f28541756cd66483daee60d468a94eedbdbd2af8c9bc19e550488ac0292526e7"
Jul 28 08:29:23.114804 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.114787    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f28541756cd66483daee60d468a94eedbdbd2af8c9bc19e550488ac0292526e7"} err="failed to get container status \"f28541756cd66483daee60d468a94eedbdbd2af8c9bc19e550488ac0292526e7\": rpc error: code = NotFound desc = could not find container \"f28541756cd66483daee60d468a94eedbdbd2af8c9bc19e550488ac0292526e7\": container with ID starting with f28541756cd66483daee60d468a94eedbdbd2af8c9bc19e550488ac0292526e7 not found: ID does not exist"
Jul 28 08:29:23.114853 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.114805    2583 scope.go:117] "RemoveContainer" containerID="4503890a4c971445d82d8d6c980e207019abd1e10baee10eae1b8cdf964b46bb"
Jul 28 08:29:23.115011 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.114991    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4503890a4c971445d82d8d6c980e207019abd1e10baee10eae1b8cdf964b46bb"} err="failed to get container status \"4503890a4c971445d82d8d6c980e207019abd1e10baee10eae1b8cdf964b46bb\": rpc error: code = NotFound desc = could not find container \"4503890a4c971445d82d8d6c980e207019abd1e10baee10eae1b8cdf964b46bb\": container with ID starting with 4503890a4c971445d82d8d6c980e207019abd1e10baee10eae1b8cdf964b46bb not found: ID does not exist"
Jul 28 08:29:23.115051 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.115012    2583 scope.go:117] "RemoveContainer" containerID="1bab481a21efe5db49c1921f4129f5c86b49edcad7b57478b52d0e51b8b71885"
Jul 28 08:29:23.115276 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.115257    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bab481a21efe5db49c1921f4129f5c86b49edcad7b57478b52d0e51b8b71885"} err="failed to get container status \"1bab481a21efe5db49c1921f4129f5c86b49edcad7b57478b52d0e51b8b71885\": rpc error: code = NotFound desc = could not find container \"1bab481a21efe5db49c1921f4129f5c86b49edcad7b57478b52d0e51b8b71885\": container with ID starting with 1bab481a21efe5db49c1921f4129f5c86b49edcad7b57478b52d0e51b8b71885 not found: ID does not exist"
Jul 28 08:29:23.115323 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.115278    2583 scope.go:117] "RemoveContainer" containerID="bdc63cab93a484ef27ac8a1b75e6092cb50ee6eb4d5e5f26fca9b4a5b2f668e6"
Jul 28 08:29:23.115504 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.115486    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdc63cab93a484ef27ac8a1b75e6092cb50ee6eb4d5e5f26fca9b4a5b2f668e6"} err="failed to get container status \"bdc63cab93a484ef27ac8a1b75e6092cb50ee6eb4d5e5f26fca9b4a5b2f668e6\": rpc error: code = NotFound desc = could not find container \"bdc63cab93a484ef27ac8a1b75e6092cb50ee6eb4d5e5f26fca9b4a5b2f668e6\": container with ID starting with bdc63cab93a484ef27ac8a1b75e6092cb50ee6eb4d5e5f26fca9b4a5b2f668e6 not found: ID does not exist"
Jul 28 08:29:23.115565 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.115507    2583 scope.go:117] "RemoveContainer" containerID="5c155eebe803c0aa03101bf90cbee338b233877273cdc77d2ae27a467dd30407"
Jul 28 08:29:23.115755 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.115734    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c155eebe803c0aa03101bf90cbee338b233877273cdc77d2ae27a467dd30407"} err="failed to get container status \"5c155eebe803c0aa03101bf90cbee338b233877273cdc77d2ae27a467dd30407\": rpc error: code = NotFound desc = could not find container \"5c155eebe803c0aa03101bf90cbee338b233877273cdc77d2ae27a467dd30407\": container with ID starting with 5c155eebe803c0aa03101bf90cbee338b233877273cdc77d2ae27a467dd30407 not found: ID does not exist"
Jul 28 08:29:23.115830 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.115757    2583 scope.go:117] "RemoveContainer" containerID="fcebb6cc9885cad0631da8711e60596abe947fffbcff52962456b36ce17a8224"
Jul 28 08:29:23.116002 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.115984    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcebb6cc9885cad0631da8711e60596abe947fffbcff52962456b36ce17a8224"} err="failed to get container status \"fcebb6cc9885cad0631da8711e60596abe947fffbcff52962456b36ce17a8224\": rpc error: code = NotFound desc = could not find container \"fcebb6cc9885cad0631da8711e60596abe947fffbcff52962456b36ce17a8224\": container with ID starting with fcebb6cc9885cad0631da8711e60596abe947fffbcff52962456b36ce17a8224 not found: ID does not exist"
Jul 28 08:29:23.334381 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:29:23.334299    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c035c04-f79b-4429-844b-43108887fe85" path="/var/lib/kubelet/pods/8c035c04-f79b-4429-844b-43108887fe85/volumes"
Jul 28 08:30:18.146932 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.146888    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"]
Jul 28 08:30:18.147578 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.147383    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="ui"
Jul 28 08:30:18.147578 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.147403    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="ui"
Jul 28 08:30:18.147578 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.147432    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="feast-init"
Jul 28 08:30:18.147578 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.147441    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="feast-init"
Jul 28 08:30:18.147578 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.147474    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="registry"
Jul 28 08:30:18.147578 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.147483    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="registry"
Jul 28 08:30:18.147578 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.147496    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="online"
Jul 28 08:30:18.147578 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.147505    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="online"
Jul 28 08:30:18.147578 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.147519    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="feast-apply"
Jul 28 08:30:18.147578 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.147528    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="feast-apply"
Jul 28 08:30:18.147578 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.147543    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="offline"
Jul 28 08:30:18.147578 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.147553    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="offline"
Jul 28 08:30:18.148221 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.147648    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="online"
Jul 28 08:30:18.148221 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.147663    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="registry"
Jul 28 08:30:18.148221 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.147672    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="offline"
Jul 28 08:30:18.148221 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.147685    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c035c04-f79b-4429-844b-43108887fe85" containerName="ui"
Jul 28 08:30:18.151300 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.151274    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:18.153717 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.153694    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jul 28 08:30:18.153935 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.153915    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jul 28 08:30:18.154099 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.154073    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jul 28 08:30:18.154223 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.154201    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jul 28 08:30:18.154307 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.154292    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jul 28 08:30:18.154665 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.154649    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jul 28 08:30:18.154742 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.154654    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-jh6bw\""
Jul 28 08:30:18.162430 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.162403    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"]
Jul 28 08:30:18.317914 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.317871    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-fmkxd\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:18.318110 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.317949    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr55s\" (UniqueName: \"kubernetes.io/projected/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-kube-api-access-pr55s\") pod \"feast-simple-feast-remote-setup-db6955c6c-fmkxd\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:18.318110 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.317992    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-fmkxd\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:18.318110 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.318008    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-fmkxd\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:18.318110 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.318073    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-fmkxd\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:18.318110 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.318090    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-fmkxd\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:18.419005 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.418915    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-fmkxd\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:18.419005 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.418955    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-fmkxd\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:18.419005 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.418978    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-fmkxd\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:18.419287 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.419066    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr55s\" (UniqueName: \"kubernetes.io/projected/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-kube-api-access-pr55s\") pod \"feast-simple-feast-remote-setup-db6955c6c-fmkxd\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:18.419287 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.419107    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-fmkxd\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:18.419287 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.419124    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-fmkxd\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:18.422151 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.420518    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-fmkxd\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:18.422151 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.420534    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-fmkxd\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:18.427110 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.427026    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-fmkxd\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:18.427235 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.427159    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-fmkxd\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:18.427914 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.427887    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-fmkxd\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:18.429510 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.429488    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr55s\" (UniqueName: \"kubernetes.io/projected/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-kube-api-access-pr55s\") pod \"feast-simple-feast-remote-setup-db6955c6c-fmkxd\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:18.461554 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.461510    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:18.608537 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:18.608513    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"]
Jul 28 08:30:18.610855 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:30:18.610823    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff2ccf98_9e07_43b5_88ae_a06ce2e91364.slice/crio-1210c9e679556b57387ab62c54d538f0b225c3739837d4c86e34fb4108ccb38a WatchSource:0}: Error finding container 1210c9e679556b57387ab62c54d538f0b225c3739837d4c86e34fb4108ccb38a: Status 404 returned error can't find the container with id 1210c9e679556b57387ab62c54d538f0b225c3739837d4c86e34fb4108ccb38a
Jul 28 08:30:19.303986 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:19.303949    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" event={"ID":"ff2ccf98-9e07-43b5-88ae-a06ce2e91364","Type":"ContainerStarted","Data":"b6b8fe17f73a08627d055751301414a1532f96f57704545e6a384aea37ea1483"}
Jul 28 08:30:19.304486 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:19.304000    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" event={"ID":"ff2ccf98-9e07-43b5-88ae-a06ce2e91364","Type":"ContainerStarted","Data":"1210c9e679556b57387ab62c54d538f0b225c3739837d4c86e34fb4108ccb38a"}
Jul 28 08:30:24.329008 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:24.328969    2583 generic.go:356] "Generic (PLEG): container finished" podID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerID="b6b8fe17f73a08627d055751301414a1532f96f57704545e6a384aea37ea1483" exitCode=0
Jul 28 08:30:24.329466 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:24.329042    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" event={"ID":"ff2ccf98-9e07-43b5-88ae-a06ce2e91364","Type":"ContainerDied","Data":"b6b8fe17f73a08627d055751301414a1532f96f57704545e6a384aea37ea1483"}
Jul 28 08:30:25.344331 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:25.344290    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" event={"ID":"ff2ccf98-9e07-43b5-88ae-a06ce2e91364","Type":"ContainerStarted","Data":"08bee654fd622f2b2a376617c7746155422379fcea97809c7539e4c2f948394a"}
Jul 28 08:30:30.369859 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:30.369820    2583 generic.go:356] "Generic (PLEG): container finished" podID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerID="08bee654fd622f2b2a376617c7746155422379fcea97809c7539e4c2f948394a" exitCode=0
Jul 28 08:30:30.370249 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:30.369867    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" event={"ID":"ff2ccf98-9e07-43b5-88ae-a06ce2e91364","Type":"ContainerDied","Data":"08bee654fd622f2b2a376617c7746155422379fcea97809c7539e4c2f948394a"}
Jul 28 08:30:31.379023 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:31.378980    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" event={"ID":"ff2ccf98-9e07-43b5-88ae-a06ce2e91364","Type":"ContainerStarted","Data":"5a4c4cb38ead8504e3421beab3381d3acaa6e199a382b519e61d19edd9c54ce7"}
Jul 28 08:30:31.379023 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:31.379032    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" event={"ID":"ff2ccf98-9e07-43b5-88ae-a06ce2e91364","Type":"ContainerStarted","Data":"c25e2868ec3c31cd7dd941245ad507f85f5471230ff16ed3323ff8a90c3d1091"}
Jul 28 08:30:31.379658 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:31.379044    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" event={"ID":"ff2ccf98-9e07-43b5-88ae-a06ce2e91364","Type":"ContainerStarted","Data":"f3c94240cefe36892fd1e7b0a9b133037808516d7e471d4a8f50b8ebb54795bb"}
Jul 28 08:30:31.403292 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:31.403228    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" podStartSLOduration=13.40321264 podStartE2EDuration="13.40321264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:30:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:30:31.401755211 +0000 UTC m=+1666.588943342" watchObservedRunningTime="2026-07-28 08:30:31.40321264 +0000 UTC m=+1666.590400771"
Jul 28 08:30:33.462364 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:33.462328    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:33.462991 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:33.462966    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:33.462991 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:33.463000    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:33.464286 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:33.464195    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.38:8443: connect: connection refused"
Jul 28 08:30:33.464286 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:33.464212    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.38:8816: connect: connection refused"
Jul 28 08:30:33.464286 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:33.464257    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Jul 28 08:30:36.462349 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:36.462306    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.38:8443: connect: connection refused"
Jul 28 08:30:36.463287 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:36.463263    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:36.463730 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:36.463706    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:36.464190 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:36.464172    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:36.469734 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:36.469709    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:37.408110 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:37.408074    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:37.412954 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:37.412927    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:38.461867 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:38.461831    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:39.463142 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:39.463103    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:30:40.421064 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:30:40.421039    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:31:41.523416 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:41.523378    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"]
Jul 28 08:31:41.524301 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:41.524252    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="online" containerID="cri-o://f3c94240cefe36892fd1e7b0a9b133037808516d7e471d4a8f50b8ebb54795bb" gracePeriod=30
Jul 28 08:31:41.524510 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:41.524484    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="ui" containerID="cri-o://5a4c4cb38ead8504e3421beab3381d3acaa6e199a382b519e61d19edd9c54ce7" gracePeriod=30
Jul 28 08:31:41.525051 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:41.524563    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="offline" containerID="cri-o://c25e2868ec3c31cd7dd941245ad507f85f5471230ff16ed3323ff8a90c3d1091" gracePeriod=30
Jul 28 08:31:41.678125 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:41.678084    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"]
Jul 28 08:31:41.678428 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:41.678396    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="registry" containerID="cri-o://cdb53732ccc62ce9eebad6be8df2f20cc2ba375c963c59225874ee542ca5849c" gracePeriod=30
Jul 28 08:31:41.678600 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:41.678440    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="ui" containerID="cri-o://c69a6a196e03c42795e7d2bdd0e6d2005f5fe885ef90571f9759ab67a9224804" gracePeriod=30
Jul 28 08:31:41.678600 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:41.678479    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="offline" containerID="cri-o://00dc0b2abedc7e85d6bc85d7880eec77ef55263f4b959f98de7048ed9fad0bf9" gracePeriod=30
Jul 28 08:31:41.678600 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:41.678479    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="online" containerID="cri-o://3988710100d8e33325f0142602d15ee9478f25173119f00860353fdcaed21275" gracePeriod=30
Jul 28 08:31:42.011955 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:42.011899    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Jul 28 08:31:42.693292 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:42.693258    2583 generic.go:356] "Generic (PLEG): container finished" podID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerID="c69a6a196e03c42795e7d2bdd0e6d2005f5fe885ef90571f9759ab67a9224804" exitCode=0
Jul 28 08:31:42.693292 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:42.693284    2583 generic.go:356] "Generic (PLEG): container finished" podID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerID="3988710100d8e33325f0142602d15ee9478f25173119f00860353fdcaed21275" exitCode=0
Jul 28 08:31:42.693806 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:42.693327    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" event={"ID":"398ff389-11f1-4dd5-812b-89b2df67bfdc","Type":"ContainerDied","Data":"c69a6a196e03c42795e7d2bdd0e6d2005f5fe885ef90571f9759ab67a9224804"}
Jul 28 08:31:42.693806 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:42.693371    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" event={"ID":"398ff389-11f1-4dd5-812b-89b2df67bfdc","Type":"ContainerDied","Data":"3988710100d8e33325f0142602d15ee9478f25173119f00860353fdcaed21275"}
Jul 28 08:31:42.695885 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:42.695865    2583 generic.go:356] "Generic (PLEG): container finished" podID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerID="5a4c4cb38ead8504e3421beab3381d3acaa6e199a382b519e61d19edd9c54ce7" exitCode=0
Jul 28 08:31:42.695885 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:42.695884    2583 generic.go:356] "Generic (PLEG): container finished" podID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerID="f3c94240cefe36892fd1e7b0a9b133037808516d7e471d4a8f50b8ebb54795bb" exitCode=0
Jul 28 08:31:42.696035 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:42.695903    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" event={"ID":"ff2ccf98-9e07-43b5-88ae-a06ce2e91364","Type":"ContainerDied","Data":"5a4c4cb38ead8504e3421beab3381d3acaa6e199a382b519e61d19edd9c54ce7"}
Jul 28 08:31:42.696035 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:42.695928    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" event={"ID":"ff2ccf98-9e07-43b5-88ae-a06ce2e91364","Type":"ContainerDied","Data":"f3c94240cefe36892fd1e7b0a9b133037808516d7e471d4a8f50b8ebb54795bb"}
Jul 28 08:31:45.024344 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:45.024298    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Jul 28 08:31:47.409026 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:47.408982    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Jul 28 08:31:50.420964 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:50.420917    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.38:8443: connect: connection refused"
Jul 28 08:31:52.011518 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:52.011472    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Jul 28 08:31:55.023610 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:55.023565    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Jul 28 08:31:57.409181 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:31:57.409140    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Jul 28 08:32:00.421315 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:00.421272    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.38:8443: connect: connection refused"
Jul 28 08:32:02.011765 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:02.011719    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Jul 28 08:32:02.012189 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:02.011844    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:32:05.023978 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:05.023931    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Jul 28 08:32:05.024381 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:05.024088    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:32:07.408678 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:07.408637    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Jul 28 08:32:07.409105 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:07.408757    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:32:10.420542 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:10.420492    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.38:8443: connect: connection refused"
Jul 28 08:32:10.421034 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:10.420646    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:32:11.784209 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.784145    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:32:11.833687 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.833654    2583 generic.go:356] "Generic (PLEG): container finished" podID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerID="00dc0b2abedc7e85d6bc85d7880eec77ef55263f4b959f98de7048ed9fad0bf9" exitCode=137
Jul 28 08:32:11.833687 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.833682    2583 generic.go:356] "Generic (PLEG): container finished" podID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerID="cdb53732ccc62ce9eebad6be8df2f20cc2ba375c963c59225874ee542ca5849c" exitCode=137
Jul 28 08:32:11.833928 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.833733    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" event={"ID":"398ff389-11f1-4dd5-812b-89b2df67bfdc","Type":"ContainerDied","Data":"00dc0b2abedc7e85d6bc85d7880eec77ef55263f4b959f98de7048ed9fad0bf9"}
Jul 28 08:32:11.833928 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.833781    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" event={"ID":"398ff389-11f1-4dd5-812b-89b2df67bfdc","Type":"ContainerDied","Data":"cdb53732ccc62ce9eebad6be8df2f20cc2ba375c963c59225874ee542ca5849c"}
Jul 28 08:32:11.836107 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.836081    2583 generic.go:356] "Generic (PLEG): container finished" podID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerID="c25e2868ec3c31cd7dd941245ad507f85f5471230ff16ed3323ff8a90c3d1091" exitCode=137
Jul 28 08:32:11.836235 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.836117    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" event={"ID":"ff2ccf98-9e07-43b5-88ae-a06ce2e91364","Type":"ContainerDied","Data":"c25e2868ec3c31cd7dd941245ad507f85f5471230ff16ed3323ff8a90c3d1091"}
Jul 28 08:32:11.836235 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.836157    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"
Jul 28 08:32:11.836235 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.836169    2583 scope.go:117] "RemoveContainer" containerID="5a4c4cb38ead8504e3421beab3381d3acaa6e199a382b519e61d19edd9c54ce7"
Jul 28 08:32:11.836353 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.836157    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd" event={"ID":"ff2ccf98-9e07-43b5-88ae-a06ce2e91364","Type":"ContainerDied","Data":"1210c9e679556b57387ab62c54d538f0b225c3739837d4c86e34fb4108ccb38a"}
Jul 28 08:32:11.845170 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.845153    2583 scope.go:117] "RemoveContainer" containerID="c25e2868ec3c31cd7dd941245ad507f85f5471230ff16ed3323ff8a90c3d1091"
Jul 28 08:32:11.853428 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.853401    2583 scope.go:117] "RemoveContainer" containerID="f3c94240cefe36892fd1e7b0a9b133037808516d7e471d4a8f50b8ebb54795bb"
Jul 28 08:32:11.861410 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.861392    2583 scope.go:117] "RemoveContainer" containerID="08bee654fd622f2b2a376617c7746155422379fcea97809c7539e4c2f948394a"
Jul 28 08:32:11.869184 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.869167    2583 scope.go:117] "RemoveContainer" containerID="b6b8fe17f73a08627d055751301414a1532f96f57704545e6a384aea37ea1483"
Jul 28 08:32:11.876838 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.876820    2583 scope.go:117] "RemoveContainer" containerID="5a4c4cb38ead8504e3421beab3381d3acaa6e199a382b519e61d19edd9c54ce7"
Jul 28 08:32:11.877115 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:32:11.877090    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a4c4cb38ead8504e3421beab3381d3acaa6e199a382b519e61d19edd9c54ce7\": container with ID starting with 5a4c4cb38ead8504e3421beab3381d3acaa6e199a382b519e61d19edd9c54ce7 not found: ID does not exist" containerID="5a4c4cb38ead8504e3421beab3381d3acaa6e199a382b519e61d19edd9c54ce7"
Jul 28 08:32:11.877163 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.877127    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a4c4cb38ead8504e3421beab3381d3acaa6e199a382b519e61d19edd9c54ce7"} err="failed to get container status \"5a4c4cb38ead8504e3421beab3381d3acaa6e199a382b519e61d19edd9c54ce7\": rpc error: code = NotFound desc = could not find container \"5a4c4cb38ead8504e3421beab3381d3acaa6e199a382b519e61d19edd9c54ce7\": container with ID starting with 5a4c4cb38ead8504e3421beab3381d3acaa6e199a382b519e61d19edd9c54ce7 not found: ID does not exist"
Jul 28 08:32:11.877163 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.877148    2583 scope.go:117] "RemoveContainer" containerID="c25e2868ec3c31cd7dd941245ad507f85f5471230ff16ed3323ff8a90c3d1091"
Jul 28 08:32:11.877380 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:32:11.877361    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c25e2868ec3c31cd7dd941245ad507f85f5471230ff16ed3323ff8a90c3d1091\": container with ID starting with c25e2868ec3c31cd7dd941245ad507f85f5471230ff16ed3323ff8a90c3d1091 not found: ID does not exist" containerID="c25e2868ec3c31cd7dd941245ad507f85f5471230ff16ed3323ff8a90c3d1091"
Jul 28 08:32:11.877484 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.877388    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c25e2868ec3c31cd7dd941245ad507f85f5471230ff16ed3323ff8a90c3d1091"} err="failed to get container status \"c25e2868ec3c31cd7dd941245ad507f85f5471230ff16ed3323ff8a90c3d1091\": rpc error: code = NotFound desc = could not find container \"c25e2868ec3c31cd7dd941245ad507f85f5471230ff16ed3323ff8a90c3d1091\": container with ID starting with c25e2868ec3c31cd7dd941245ad507f85f5471230ff16ed3323ff8a90c3d1091 not found: ID does not exist"
Jul 28 08:32:11.877484 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.877411    2583 scope.go:117] "RemoveContainer" containerID="f3c94240cefe36892fd1e7b0a9b133037808516d7e471d4a8f50b8ebb54795bb"
Jul 28 08:32:11.877665 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:32:11.877644    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3c94240cefe36892fd1e7b0a9b133037808516d7e471d4a8f50b8ebb54795bb\": container with ID starting with f3c94240cefe36892fd1e7b0a9b133037808516d7e471d4a8f50b8ebb54795bb not found: ID does not exist" containerID="f3c94240cefe36892fd1e7b0a9b133037808516d7e471d4a8f50b8ebb54795bb"
Jul 28 08:32:11.877721 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.877672    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3c94240cefe36892fd1e7b0a9b133037808516d7e471d4a8f50b8ebb54795bb"} err="failed to get container status \"f3c94240cefe36892fd1e7b0a9b133037808516d7e471d4a8f50b8ebb54795bb\": rpc error: code = NotFound desc = could not find container \"f3c94240cefe36892fd1e7b0a9b133037808516d7e471d4a8f50b8ebb54795bb\": container with ID starting with f3c94240cefe36892fd1e7b0a9b133037808516d7e471d4a8f50b8ebb54795bb not found: ID does not exist"
Jul 28 08:32:11.877721 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.877686    2583 scope.go:117] "RemoveContainer" containerID="08bee654fd622f2b2a376617c7746155422379fcea97809c7539e4c2f948394a"
Jul 28 08:32:11.877926 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:32:11.877904    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08bee654fd622f2b2a376617c7746155422379fcea97809c7539e4c2f948394a\": container with ID starting with 08bee654fd622f2b2a376617c7746155422379fcea97809c7539e4c2f948394a not found: ID does not exist" containerID="08bee654fd622f2b2a376617c7746155422379fcea97809c7539e4c2f948394a"
Jul 28 08:32:11.877970 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.877932    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08bee654fd622f2b2a376617c7746155422379fcea97809c7539e4c2f948394a"} err="failed to get container status \"08bee654fd622f2b2a376617c7746155422379fcea97809c7539e4c2f948394a\": rpc error: code = NotFound desc = could not find container \"08bee654fd622f2b2a376617c7746155422379fcea97809c7539e4c2f948394a\": container with ID starting with 08bee654fd622f2b2a376617c7746155422379fcea97809c7539e4c2f948394a not found: ID does not exist"
Jul 28 08:32:11.877970 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.877953    2583 scope.go:117] "RemoveContainer" containerID="b6b8fe17f73a08627d055751301414a1532f96f57704545e6a384aea37ea1483"
Jul 28 08:32:11.878177 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:32:11.878160    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6b8fe17f73a08627d055751301414a1532f96f57704545e6a384aea37ea1483\": container with ID starting with b6b8fe17f73a08627d055751301414a1532f96f57704545e6a384aea37ea1483 not found: ID does not exist" containerID="b6b8fe17f73a08627d055751301414a1532f96f57704545e6a384aea37ea1483"
Jul 28 08:32:11.878218 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.878181    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6b8fe17f73a08627d055751301414a1532f96f57704545e6a384aea37ea1483"} err="failed to get container status \"b6b8fe17f73a08627d055751301414a1532f96f57704545e6a384aea37ea1483\": rpc error: code = NotFound desc = could not find container \"b6b8fe17f73a08627d055751301414a1532f96f57704545e6a384aea37ea1483\": container with ID starting with b6b8fe17f73a08627d055751301414a1532f96f57704545e6a384aea37ea1483 not found: ID does not exist"
Jul 28 08:32:11.905169 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.905135    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-online-tls\") pod \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") "
Jul 28 08:32:11.905334 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.905181    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-registry-tls\") pod \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") "
Jul 28 08:32:11.905334 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.905202    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr55s\" (UniqueName: \"kubernetes.io/projected/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-kube-api-access-pr55s\") pod \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") "
Jul 28 08:32:11.905334 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.905241    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-feast-data\") pod \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") "
Jul 28 08:32:11.905334 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.905294    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-ui-tls\") pod \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") "
Jul 28 08:32:11.905334 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.905308    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-offline-tls\") pod \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\" (UID: \"ff2ccf98-9e07-43b5-88ae-a06ce2e91364\") "
Jul 28 08:32:11.905647 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.905621    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ff2ccf98-9e07-43b5-88ae-a06ce2e91364" (UID: "ff2ccf98-9e07-43b5-88ae-a06ce2e91364"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 08:32:11.905877 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.905835    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-feast-data" (OuterVolumeSpecName: "feast-data") pod "ff2ccf98-9e07-43b5-88ae-a06ce2e91364" (UID: "ff2ccf98-9e07-43b5-88ae-a06ce2e91364"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 08:32:11.907666 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.907636    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "ff2ccf98-9e07-43b5-88ae-a06ce2e91364" (UID: "ff2ccf98-9e07-43b5-88ae-a06ce2e91364"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:32:11.907759 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.907716    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-kube-api-access-pr55s" (OuterVolumeSpecName: "kube-api-access-pr55s") pod "ff2ccf98-9e07-43b5-88ae-a06ce2e91364" (UID: "ff2ccf98-9e07-43b5-88ae-a06ce2e91364"). InnerVolumeSpecName "kube-api-access-pr55s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:32:11.907993 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.907979    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-online-tls" (OuterVolumeSpecName: "online-tls") pod "ff2ccf98-9e07-43b5-88ae-a06ce2e91364" (UID: "ff2ccf98-9e07-43b5-88ae-a06ce2e91364"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:32:11.908034 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:11.907998    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "ff2ccf98-9e07-43b5-88ae-a06ce2e91364" (UID: "ff2ccf98-9e07-43b5-88ae-a06ce2e91364"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:32:12.006469 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.006423    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-registry-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:32:12.006660 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.006484    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr55s\" (UniqueName: \"kubernetes.io/projected/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-kube-api-access-pr55s\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:32:12.006660 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.006499    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-feast-data\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:32:12.006660 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.006511    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-ui-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:32:12.006660 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.006521    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-offline-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:32:12.006660 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.006558    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ff2ccf98-9e07-43b5-88ae-a06ce2e91364-online-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:32:12.011663 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.011626    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Jul 28 08:32:12.160623 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.160583    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"]
Jul 28 08:32:12.163652 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.163626    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-fmkxd"]
Jul 28 08:32:12.329485 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.329461    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:32:12.511236 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.511137    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-offline-tls\") pod \"398ff389-11f1-4dd5-812b-89b2df67bfdc\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") "
Jul 28 08:32:12.511236 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.511199    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-online-tls\") pod \"398ff389-11f1-4dd5-812b-89b2df67bfdc\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") "
Jul 28 08:32:12.511236 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.511216    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-registry-tls\") pod \"398ff389-11f1-4dd5-812b-89b2df67bfdc\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") "
Jul 28 08:32:12.511236 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.511237    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-ui-tls\") pod \"398ff389-11f1-4dd5-812b-89b2df67bfdc\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") "
Jul 28 08:32:12.511632 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.511262    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/398ff389-11f1-4dd5-812b-89b2df67bfdc-feast-data\") pod \"398ff389-11f1-4dd5-812b-89b2df67bfdc\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") "
Jul 28 08:32:12.511632 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.511390    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtb6d\" (UniqueName: \"kubernetes.io/projected/398ff389-11f1-4dd5-812b-89b2df67bfdc-kube-api-access-gtb6d\") pod \"398ff389-11f1-4dd5-812b-89b2df67bfdc\" (UID: \"398ff389-11f1-4dd5-812b-89b2df67bfdc\") "
Jul 28 08:32:12.511857 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.511830    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/398ff389-11f1-4dd5-812b-89b2df67bfdc-feast-data" (OuterVolumeSpecName: "feast-data") pod "398ff389-11f1-4dd5-812b-89b2df67bfdc" (UID: "398ff389-11f1-4dd5-812b-89b2df67bfdc"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 08:32:12.513741 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.513713    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "398ff389-11f1-4dd5-812b-89b2df67bfdc" (UID: "398ff389-11f1-4dd5-812b-89b2df67bfdc"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:32:12.513850 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.513795    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/398ff389-11f1-4dd5-812b-89b2df67bfdc-kube-api-access-gtb6d" (OuterVolumeSpecName: "kube-api-access-gtb6d") pod "398ff389-11f1-4dd5-812b-89b2df67bfdc" (UID: "398ff389-11f1-4dd5-812b-89b2df67bfdc"). InnerVolumeSpecName "kube-api-access-gtb6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:32:12.513850 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.513834    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "398ff389-11f1-4dd5-812b-89b2df67bfdc" (UID: "398ff389-11f1-4dd5-812b-89b2df67bfdc"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:32:12.513957 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.513941    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "398ff389-11f1-4dd5-812b-89b2df67bfdc" (UID: "398ff389-11f1-4dd5-812b-89b2df67bfdc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:32:12.513995 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.513955    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-online-tls" (OuterVolumeSpecName: "online-tls") pod "398ff389-11f1-4dd5-812b-89b2df67bfdc" (UID: "398ff389-11f1-4dd5-812b-89b2df67bfdc"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:32:12.612407 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.612368    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtb6d\" (UniqueName: \"kubernetes.io/projected/398ff389-11f1-4dd5-812b-89b2df67bfdc-kube-api-access-gtb6d\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:32:12.612407 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.612401    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-offline-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:32:12.612407 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.612410    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-online-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:32:12.612407 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.612418    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-registry-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:32:12.612671 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.612426    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/398ff389-11f1-4dd5-812b-89b2df67bfdc-ui-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:32:12.612671 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.612433    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/398ff389-11f1-4dd5-812b-89b2df67bfdc-feast-data\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:32:12.843185 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.843106    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"
Jul 28 08:32:12.843612 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.843111    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56" event={"ID":"398ff389-11f1-4dd5-812b-89b2df67bfdc","Type":"ContainerDied","Data":"f907ece6a562d5e85306a9d0eb8ea753a807a77e63d25e132aee00a0faca2acb"}
Jul 28 08:32:12.843612 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.843243    2583 scope.go:117] "RemoveContainer" containerID="c69a6a196e03c42795e7d2bdd0e6d2005f5fe885ef90571f9759ab67a9224804"
Jul 28 08:32:12.853004 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.852983    2583 scope.go:117] "RemoveContainer" containerID="00dc0b2abedc7e85d6bc85d7880eec77ef55263f4b959f98de7048ed9fad0bf9"
Jul 28 08:32:12.861689 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.861670    2583 scope.go:117] "RemoveContainer" containerID="3988710100d8e33325f0142602d15ee9478f25173119f00860353fdcaed21275"
Jul 28 08:32:12.864626 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.864603    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"]
Jul 28 08:32:12.873069 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.873043    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-xrk56"]
Jul 28 08:32:12.873343 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.873325    2583 scope.go:117] "RemoveContainer" containerID="cdb53732ccc62ce9eebad6be8df2f20cc2ba375c963c59225874ee542ca5849c"
Jul 28 08:32:12.881633 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.881617    2583 scope.go:117] "RemoveContainer" containerID="ab531146a1b866014893e70c43e7648591797beee4ed627b62c6b3e9c0cbe9e8"
Jul 28 08:32:12.889198 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:12.889177    2583 scope.go:117] "RemoveContainer" containerID="aa7816c000942b18b400f7eb19fd8dd49dc1e8272de63ecf0a864be24a03bec9"
Jul 28 08:32:13.333588 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:13.333559    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" path="/var/lib/kubelet/pods/398ff389-11f1-4dd5-812b-89b2df67bfdc/volumes"
Jul 28 08:32:13.334165 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:13.334151    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" path="/var/lib/kubelet/pods/ff2ccf98-9e07-43b5-88ae-a06ce2e91364/volumes"
Jul 28 08:32:48.636760 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:48.636734    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vgzf4_dcf82623-a4f7-4511-aed0-7248950f1ca1/console-operator/1.log"
Jul 28 08:32:48.640464 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:48.640424    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vgzf4_dcf82623-a4f7-4511-aed0-7248950f1ca1/console-operator/1.log"
Jul 28 08:32:48.644648 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:48.644625    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-acl-logging/0.log"
Jul 28 08:32:48.647960 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:48.647945    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-acl-logging/0.log"
Jul 28 08:32:54.817241 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817201    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"]
Jul 28 08:32:54.817644 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817593    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="online"
Jul 28 08:32:54.817644 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817611    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="online"
Jul 28 08:32:54.817644 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817621    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="offline"
Jul 28 08:32:54.817644 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817626    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="offline"
Jul 28 08:32:54.817644 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817644    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="registry"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817649    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="registry"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817659    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="feast-init"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817664    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="feast-init"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817670    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="ui"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817675    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="ui"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817681    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="feast-apply"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817686    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="feast-apply"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817692    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="online"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817696    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="online"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817702    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="offline"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817706    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="offline"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817712    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="feast-apply"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817718    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="feast-apply"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817722    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="ui"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817727    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="ui"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817732    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="feast-init"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817737    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="feast-init"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817786    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="offline"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817792    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="ui"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817797    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="online"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817805    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="online"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817811    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="registry"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817818    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="398ff389-11f1-4dd5-812b-89b2df67bfdc" containerName="ui"
Jul 28 08:32:54.817827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.817824    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff2ccf98-9e07-43b5-88ae-a06ce2e91364" containerName="offline"
Jul 28 08:32:54.821145 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.821129    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:54.823594 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.823569    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jul 28 08:32:54.823734 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.823591    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jul 28 08:32:54.823820 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.823788    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jul 28 08:32:54.823879 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.823842    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jul 28 08:32:54.823879 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.823862    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-bgmch\""
Jul 28 08:32:54.823977 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.823844    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 28 08:32:54.824210 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.824193    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 28 08:32:54.833248 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.833227    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"]
Jul 28 08:32:54.948523 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.948490    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-v48s7\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:54.948698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.948553    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-v48s7\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:54.948698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.948628    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-v48s7\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:54.948698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.948667    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-v48s7\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:54.948698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.948692    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npzxg\" (UniqueName: \"kubernetes.io/projected/80e031cb-b537-4557-bc44-f9d0229b908e-kube-api-access-npzxg\") pod \"feast-simple-feast-setup-777d6cc998-v48s7\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:54.948861 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:54.948740    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/80e031cb-b537-4557-bc44-f9d0229b908e-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-v48s7\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:55.049545 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:55.049506    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-v48s7\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:55.049545 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:55.049548    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-v48s7\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:55.049793 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:55.049568    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npzxg\" (UniqueName: \"kubernetes.io/projected/80e031cb-b537-4557-bc44-f9d0229b908e-kube-api-access-npzxg\") pod \"feast-simple-feast-setup-777d6cc998-v48s7\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:55.049793 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:55.049595    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/80e031cb-b537-4557-bc44-f9d0229b908e-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-v48s7\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:55.049793 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:55.049626    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-v48s7\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:55.049793 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:32:55.049658    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jul 28 08:32:55.049793 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:55.049697    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-v48s7\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:55.049793 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:32:55.049727    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-offline-tls podName:80e031cb-b537-4557-bc44-f9d0229b908e nodeName:}" failed. No retries permitted until 2026-07-28 08:32:55.54970588 +0000 UTC m=+1810.736893988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-offline-tls") pod "feast-simple-feast-setup-777d6cc998-v48s7" (UID: "80e031cb-b537-4557-bc44-f9d0229b908e") : secret "feast-simple-feast-setup-offline-tls" not found
Jul 28 08:32:55.050165 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:32:55.049824    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jul 28 08:32:55.050165 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:32:55.049920    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-online-tls podName:80e031cb-b537-4557-bc44-f9d0229b908e nodeName:}" failed. No retries permitted until 2026-07-28 08:32:55.549904064 +0000 UTC m=+1810.737092179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-online-tls") pod "feast-simple-feast-setup-777d6cc998-v48s7" (UID: "80e031cb-b537-4557-bc44-f9d0229b908e") : secret "feast-simple-feast-setup-online-tls" not found
Jul 28 08:32:55.050165 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:55.050102    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/80e031cb-b537-4557-bc44-f9d0229b908e-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-v48s7\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:55.052252 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:55.052214    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-v48s7\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:55.052378 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:55.052264    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-v48s7\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:55.059955 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:55.059930    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npzxg\" (UniqueName: \"kubernetes.io/projected/80e031cb-b537-4557-bc44-f9d0229b908e-kube-api-access-npzxg\") pod \"feast-simple-feast-setup-777d6cc998-v48s7\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:55.554599 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:55.554562    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-v48s7\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:55.554817 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:55.554611    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-v48s7\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:55.557143 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:55.557116    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-v48s7\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:55.557264 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:55.557225    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-v48s7\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:55.744467 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:55.744414    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:32:55.884728 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:55.884702    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"]
Jul 28 08:32:55.886196 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:32:55.886175    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80e031cb_b537_4557_bc44_f9d0229b908e.slice/crio-bbb860c4be09b9a4e1128ae96030d513324496c1473ad06b4c63c4a522f694f8 WatchSource:0}: Error finding container bbb860c4be09b9a4e1128ae96030d513324496c1473ad06b4c63c4a522f694f8: Status 404 returned error can't find the container with id bbb860c4be09b9a4e1128ae96030d513324496c1473ad06b4c63c4a522f694f8
Jul 28 08:32:56.025242 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:56.025205    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" event={"ID":"80e031cb-b537-4557-bc44-f9d0229b908e","Type":"ContainerStarted","Data":"7dc466eded3a4b71e91acd10e88c0d4505d19787cbd268561f0538e039947dda"}
Jul 28 08:32:56.025476 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:32:56.025252    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" event={"ID":"80e031cb-b537-4557-bc44-f9d0229b908e","Type":"ContainerStarted","Data":"bbb860c4be09b9a4e1128ae96030d513324496c1473ad06b4c63c4a522f694f8"}
Jul 28 08:33:01.053736 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:01.053644    2583 generic.go:356] "Generic (PLEG): container finished" podID="80e031cb-b537-4557-bc44-f9d0229b908e" containerID="7dc466eded3a4b71e91acd10e88c0d4505d19787cbd268561f0538e039947dda" exitCode=0
Jul 28 08:33:01.054201 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:01.053722    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" event={"ID":"80e031cb-b537-4557-bc44-f9d0229b908e","Type":"ContainerDied","Data":"7dc466eded3a4b71e91acd10e88c0d4505d19787cbd268561f0538e039947dda"}
Jul 28 08:33:02.059242 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:02.059204    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" event={"ID":"80e031cb-b537-4557-bc44-f9d0229b908e","Type":"ContainerStarted","Data":"61d9cf11a45fe2d7745c603b8f516b944dc0f861e78a1384dc0c5b6accfa41ea"}
Jul 28 08:33:07.083022 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:07.082934    2583 generic.go:356] "Generic (PLEG): container finished" podID="80e031cb-b537-4557-bc44-f9d0229b908e" containerID="61d9cf11a45fe2d7745c603b8f516b944dc0f861e78a1384dc0c5b6accfa41ea" exitCode=0
Jul 28 08:33:07.083022 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:07.082982    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" event={"ID":"80e031cb-b537-4557-bc44-f9d0229b908e","Type":"ContainerDied","Data":"61d9cf11a45fe2d7745c603b8f516b944dc0f861e78a1384dc0c5b6accfa41ea"}
Jul 28 08:33:08.094511 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:08.094468    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" event={"ID":"80e031cb-b537-4557-bc44-f9d0229b908e","Type":"ContainerStarted","Data":"f97cbad51c0737fdcd03e2633e853d021219b5145fe72dafdc526321f95ed610"}
Jul 28 08:33:08.095026 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:08.094539    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" event={"ID":"80e031cb-b537-4557-bc44-f9d0229b908e","Type":"ContainerStarted","Data":"d65c9eb2ca0e8e024f3b87f42add0fb8bba9f435100a94f84530cfa912045312"}
Jul 28 08:33:08.095026 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:08.094561    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" event={"ID":"80e031cb-b537-4557-bc44-f9d0229b908e","Type":"ContainerStarted","Data":"8bc6035f85f68bae95943edd96a3a7db35c218bfc535654271fcaaf8b1641b64"}
Jul 28 08:33:08.095026 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:08.094578    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" event={"ID":"80e031cb-b537-4557-bc44-f9d0229b908e","Type":"ContainerStarted","Data":"072cbc2ad35aa1e85c0c238d37542153dad35d5874d9d855153eaafb4344a92d"}
Jul 28 08:33:08.117815 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:08.117727    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" podStartSLOduration=14.117705185 podStartE2EDuration="14.117705185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:32:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:33:08.116761589 +0000 UTC m=+1823.303949719" watchObservedRunningTime="2026-07-28 08:33:08.117705185 +0000 UTC m=+1823.304893317"
Jul 28 08:33:10.745035 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:10.744999    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:33:10.745659 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:10.745631    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:33:10.745659 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:10.745667    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:33:10.745883 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:10.745686    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:33:10.747144 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:10.747113    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.39:8816: connect: connection refused"
Jul 28 08:33:10.747359 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:10.747154    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.39:6571: connect: connection refused"
Jul 28 08:33:10.747496 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:10.747157    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.39:6567/health\": dial tcp 10.132.0.39:6567: connect: connection refused"
Jul 28 08:33:10.747496 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:10.747195    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.39:8443: connect: connection refused"
Jul 28 08:33:13.746590 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:13.746561    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:33:13.747018 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:13.746678    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:33:13.747018 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:13.746896    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:33:13.747184 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:13.747156    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:33:13.747256 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:13.747196    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:33:13.747256 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:13.747218    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:33:13.747571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:13.747550    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:33:13.747643 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:13.747622    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:33:13.747815 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:13.747798    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:33:13.751542 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:13.751521    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:33:14.127066 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:14.127033    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:33:14.130402 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:33:14.130379    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:34:16.888124 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:16.888023    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"]
Jul 28 08:34:16.888773 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:16.888299    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="registry" containerID="cri-o://072cbc2ad35aa1e85c0c238d37542153dad35d5874d9d855153eaafb4344a92d" gracePeriod=30
Jul 28 08:34:16.888773 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:16.888354    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="offline" containerID="cri-o://d65c9eb2ca0e8e024f3b87f42add0fb8bba9f435100a94f84530cfa912045312" gracePeriod=30
Jul 28 08:34:16.888773 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:16.888435    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="ui" containerID="cri-o://f97cbad51c0737fdcd03e2633e853d021219b5145fe72dafdc526321f95ed610" gracePeriod=30
Jul 28 08:34:16.888773 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:16.888476    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="online" containerID="cri-o://8bc6035f85f68bae95943edd96a3a7db35c218bfc535654271fcaaf8b1641b64" gracePeriod=30
Jul 28 08:34:17.186415 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.186330    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"]
Jul 28 08:34:17.190296 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.190278    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:17.192760 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.192733    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-zp79m\""
Jul 28 08:34:17.202051 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.202016    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"]
Jul 28 08:34:17.264988 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.264938    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:17.265180 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.265015    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:17.265180 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.265093    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/11596dd6-119a-44f7-9e0d-10adb516a8df-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:17.265180 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.265130    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:17.265180 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.265168    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:17.265347 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.265245    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-747fd\" (UniqueName: \"kubernetes.io/projected/11596dd6-119a-44f7-9e0d-10adb516a8df-kube-api-access-747fd\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:17.366501 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.366466    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/11596dd6-119a-44f7-9e0d-10adb516a8df-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:17.366501 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.366509    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:17.366759 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.366533    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:17.366759 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.366570    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-747fd\" (UniqueName: \"kubernetes.io/projected/11596dd6-119a-44f7-9e0d-10adb516a8df-kube-api-access-747fd\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:17.366759 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.366619    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:17.366759 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.366659    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:17.366759 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:34:17.366665    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jul 28 08:34:17.366759 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:34:17.366667    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jul 28 08:34:17.366759 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:34:17.366731    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-offline-tls podName:11596dd6-119a-44f7-9e0d-10adb516a8df nodeName:}" failed. No retries permitted until 2026-07-28 08:34:17.866709076 +0000 UTC m=+1893.053897208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-offline-tls") pod "feast-simple-feast-setup-777d6cc998-2ffhp" (UID: "11596dd6-119a-44f7-9e0d-10adb516a8df") : secret "feast-simple-feast-setup-offline-tls" not found
Jul 28 08:34:17.366759 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:34:17.366737    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jul 28 08:34:17.366759 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:34:17.366750    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-ui-tls podName:11596dd6-119a-44f7-9e0d-10adb516a8df nodeName:}" failed. No retries permitted until 2026-07-28 08:34:17.866740638 +0000 UTC m=+1893.053928746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-ui-tls") pod "feast-simple-feast-setup-777d6cc998-2ffhp" (UID: "11596dd6-119a-44f7-9e0d-10adb516a8df") : secret "feast-simple-feast-setup-ui-tls" not found
Jul 28 08:34:17.367141 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:34:17.366791    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-online-tls podName:11596dd6-119a-44f7-9e0d-10adb516a8df nodeName:}" failed. No retries permitted until 2026-07-28 08:34:17.866772483 +0000 UTC m=+1893.053960606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-online-tls") pod "feast-simple-feast-setup-777d6cc998-2ffhp" (UID: "11596dd6-119a-44f7-9e0d-10adb516a8df") : secret "feast-simple-feast-setup-online-tls" not found
Jul 28 08:34:17.367141 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.367095    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/11596dd6-119a-44f7-9e0d-10adb516a8df-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:17.369487 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.369441    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:17.376729 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.376703    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-747fd\" (UniqueName: \"kubernetes.io/projected/11596dd6-119a-44f7-9e0d-10adb516a8df-kube-api-access-747fd\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:17.870937 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.870908    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:17.871122 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.870978    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:17.871122 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.871000    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:17.871122 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:34:17.871096    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jul 28 08:34:17.871302 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:34:17.871149    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-offline-tls podName:11596dd6-119a-44f7-9e0d-10adb516a8df nodeName:}" failed. No retries permitted until 2026-07-28 08:34:18.871136997 +0000 UTC m=+1894.058325106 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-offline-tls") pod "feast-simple-feast-setup-777d6cc998-2ffhp" (UID: "11596dd6-119a-44f7-9e0d-10adb516a8df") : secret "feast-simple-feast-setup-offline-tls" not found
Jul 28 08:34:17.873715 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.873687    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:17.873851 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:17.873687    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:18.391637 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:18.391600    2583 generic.go:356] "Generic (PLEG): container finished" podID="80e031cb-b537-4557-bc44-f9d0229b908e" containerID="f97cbad51c0737fdcd03e2633e853d021219b5145fe72dafdc526321f95ed610" exitCode=0
Jul 28 08:34:18.391637 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:18.391623    2583 generic.go:356] "Generic (PLEG): container finished" podID="80e031cb-b537-4557-bc44-f9d0229b908e" containerID="8bc6035f85f68bae95943edd96a3a7db35c218bfc535654271fcaaf8b1641b64" exitCode=0
Jul 28 08:34:18.392051 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:18.391668    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" event={"ID":"80e031cb-b537-4557-bc44-f9d0229b908e","Type":"ContainerDied","Data":"f97cbad51c0737fdcd03e2633e853d021219b5145fe72dafdc526321f95ed610"}
Jul 28 08:34:18.392051 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:18.391708    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" event={"ID":"80e031cb-b537-4557-bc44-f9d0229b908e","Type":"ContainerDied","Data":"8bc6035f85f68bae95943edd96a3a7db35c218bfc535654271fcaaf8b1641b64"}
Jul 28 08:34:18.878765 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:18.878731    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:18.881397 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:18.881360    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-2ffhp\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:19.000676 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:19.000634    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:19.139561 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:19.139534    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"]
Jul 28 08:34:19.140933 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:34:19.140905    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11596dd6_119a_44f7_9e0d_10adb516a8df.slice/crio-d8b37b1e82b8662d2089c9a86229de4c3a66dd498c410be3dc5e665058fd1942 WatchSource:0}: Error finding container d8b37b1e82b8662d2089c9a86229de4c3a66dd498c410be3dc5e665058fd1942: Status 404 returned error can't find the container with id d8b37b1e82b8662d2089c9a86229de4c3a66dd498c410be3dc5e665058fd1942
Jul 28 08:34:19.402362 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:19.401565    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" event={"ID":"11596dd6-119a-44f7-9e0d-10adb516a8df","Type":"ContainerStarted","Data":"900e464760adf42e74f36da6faf150d77707310900c0b05023df07cdfaeffb4d"}
Jul 28 08:34:19.402362 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:19.401621    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" event={"ID":"11596dd6-119a-44f7-9e0d-10adb516a8df","Type":"ContainerStarted","Data":"d8b37b1e82b8662d2089c9a86229de4c3a66dd498c410be3dc5e665058fd1942"}
Jul 28 08:34:23.747726 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:23.747674    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.39:8443: connect: connection refused"
Jul 28 08:34:24.127592 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:24.127546    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.39:6567/health\": dial tcp 10.132.0.39:6567: connect: connection refused"
Jul 28 08:34:24.423628 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:24.423595    2583 generic.go:356] "Generic (PLEG): container finished" podID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerID="900e464760adf42e74f36da6faf150d77707310900c0b05023df07cdfaeffb4d" exitCode=0
Jul 28 08:34:24.423840 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:24.423653    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" event={"ID":"11596dd6-119a-44f7-9e0d-10adb516a8df","Type":"ContainerDied","Data":"900e464760adf42e74f36da6faf150d77707310900c0b05023df07cdfaeffb4d"}
Jul 28 08:34:25.436941 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:25.436898    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" event={"ID":"11596dd6-119a-44f7-9e0d-10adb516a8df","Type":"ContainerStarted","Data":"9afc66bcc8553607837e4af8eac1c3fae1a3ec95fdbc903977a1226b9797eabc"}
Jul 28 08:34:30.462109 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:30.462013    2583 generic.go:356] "Generic (PLEG): container finished" podID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerID="9afc66bcc8553607837e4af8eac1c3fae1a3ec95fdbc903977a1226b9797eabc" exitCode=0
Jul 28 08:34:30.462109 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:30.462093    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" event={"ID":"11596dd6-119a-44f7-9e0d-10adb516a8df","Type":"ContainerDied","Data":"9afc66bcc8553607837e4af8eac1c3fae1a3ec95fdbc903977a1226b9797eabc"}
Jul 28 08:34:31.472991 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:31.472938    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" event={"ID":"11596dd6-119a-44f7-9e0d-10adb516a8df","Type":"ContainerStarted","Data":"76b0ed918ad483d5ead76cc683a072e0722aeddbca5668bb8f6ed6bd84c16f91"}
Jul 28 08:34:31.473523 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:31.473011    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" event={"ID":"11596dd6-119a-44f7-9e0d-10adb516a8df","Type":"ContainerStarted","Data":"007c56c606fc514be4e11e414486f9ead752791f7d5be6c521b80fe144c794aa"}
Jul 28 08:34:31.473523 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:31.473034    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" event={"ID":"11596dd6-119a-44f7-9e0d-10adb516a8df","Type":"ContainerStarted","Data":"df5ec3cf3a37e0e652296dad296a33dc8d5077467123322c3488319e0f134bc4"}
Jul 28 08:34:31.473523 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:31.473052    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" event={"ID":"11596dd6-119a-44f7-9e0d-10adb516a8df","Type":"ContainerStarted","Data":"ad494f437bd3ce83e121a8b649e22222f396dfebf3f617ad2f85a43c72905ead"}
Jul 28 08:34:31.504617 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:31.504280    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" podStartSLOduration=14.504257402 podStartE2EDuration="14.504257402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:34:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:34:31.502825281 +0000 UTC m=+1906.690013415" watchObservedRunningTime="2026-07-28 08:34:31.504257402 +0000 UTC m=+1906.691445533"
Jul 28 08:34:33.747721 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:33.747672    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.39:8443: connect: connection refused"
Jul 28 08:34:34.001619 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:34.001510    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:34.001619 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:34.001592    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:34.002092 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:34.002058    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:34.002231 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:34.002105    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:34.003877 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:34.003757    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.40:6571: connect: connection refused"
Jul 28 08:34:34.003877 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:34.003825    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.40:8443: connect: connection refused"
Jul 28 08:34:34.004078 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:34.003826    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.40:8816: connect: connection refused"
Jul 28 08:34:34.004078 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:34.003941    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="online" probeResult="failure" output="Get \"https://10.132.0.40:6567/health\": dial tcp 10.132.0.40:6567: connect: connection refused"
Jul 28 08:34:34.127834 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:34.127783    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.39:6567/health\": dial tcp 10.132.0.39:6567: connect: connection refused"
Jul 28 08:34:37.002516 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:37.002361    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:37.002984 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:37.002698    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:37.003198 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:37.003177    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:37.003288 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:37.003209    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:37.003288 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:37.003259    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:37.007821 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:37.007799    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:37.508505 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:37.508463    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:37.508759 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:37.508708    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:37.508759 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:37.508754    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:37.509064 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:37.509045    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:37.509132 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:37.509095    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:37.511812 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:37.511782    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:34:43.747597 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:43.747549    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.39:8443: connect: connection refused"
Jul 28 08:34:43.748067 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:43.747711    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:34:44.127545 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:44.127504    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.39:6567/health\": dial tcp 10.132.0.39:6567: connect: connection refused"
Jul 28 08:34:44.127705 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:44.127618    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:34:47.544984 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.544958    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:34:47.561307 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.561277    2583 generic.go:356] "Generic (PLEG): container finished" podID="80e031cb-b537-4557-bc44-f9d0229b908e" containerID="d65c9eb2ca0e8e024f3b87f42add0fb8bba9f435100a94f84530cfa912045312" exitCode=137
Jul 28 08:34:47.561307 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.561302    2583 generic.go:356] "Generic (PLEG): container finished" podID="80e031cb-b537-4557-bc44-f9d0229b908e" containerID="072cbc2ad35aa1e85c0c238d37542153dad35d5874d9d855153eaafb4344a92d" exitCode=137
Jul 28 08:34:47.561540 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.561339    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" event={"ID":"80e031cb-b537-4557-bc44-f9d0229b908e","Type":"ContainerDied","Data":"d65c9eb2ca0e8e024f3b87f42add0fb8bba9f435100a94f84530cfa912045312"}
Jul 28 08:34:47.561540 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.561365    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"
Jul 28 08:34:47.561540 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.561401    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" event={"ID":"80e031cb-b537-4557-bc44-f9d0229b908e","Type":"ContainerDied","Data":"072cbc2ad35aa1e85c0c238d37542153dad35d5874d9d855153eaafb4344a92d"}
Jul 28 08:34:47.561540 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.561423    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7" event={"ID":"80e031cb-b537-4557-bc44-f9d0229b908e","Type":"ContainerDied","Data":"bbb860c4be09b9a4e1128ae96030d513324496c1473ad06b4c63c4a522f694f8"}
Jul 28 08:34:47.561540 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.561466    2583 scope.go:117] "RemoveContainer" containerID="f97cbad51c0737fdcd03e2633e853d021219b5145fe72dafdc526321f95ed610"
Jul 28 08:34:47.570642 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.570622    2583 scope.go:117] "RemoveContainer" containerID="d65c9eb2ca0e8e024f3b87f42add0fb8bba9f435100a94f84530cfa912045312"
Jul 28 08:34:47.580698 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.580667    2583 scope.go:117] "RemoveContainer" containerID="8bc6035f85f68bae95943edd96a3a7db35c218bfc535654271fcaaf8b1641b64"
Jul 28 08:34:47.590925 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.590902    2583 scope.go:117] "RemoveContainer" containerID="072cbc2ad35aa1e85c0c238d37542153dad35d5874d9d855153eaafb4344a92d"
Jul 28 08:34:47.599263 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.599240    2583 scope.go:117] "RemoveContainer" containerID="61d9cf11a45fe2d7745c603b8f516b944dc0f861e78a1384dc0c5b6accfa41ea"
Jul 28 08:34:47.607661 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.607639    2583 scope.go:117] "RemoveContainer" containerID="7dc466eded3a4b71e91acd10e88c0d4505d19787cbd268561f0538e039947dda"
Jul 28 08:34:47.615735 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.615710    2583 scope.go:117] "RemoveContainer" containerID="f97cbad51c0737fdcd03e2633e853d021219b5145fe72dafdc526321f95ed610"
Jul 28 08:34:47.616048 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:34:47.616025    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f97cbad51c0737fdcd03e2633e853d021219b5145fe72dafdc526321f95ed610\": container with ID starting with f97cbad51c0737fdcd03e2633e853d021219b5145fe72dafdc526321f95ed610 not found: ID does not exist" containerID="f97cbad51c0737fdcd03e2633e853d021219b5145fe72dafdc526321f95ed610"
Jul 28 08:34:47.616098 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.616058    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f97cbad51c0737fdcd03e2633e853d021219b5145fe72dafdc526321f95ed610"} err="failed to get container status \"f97cbad51c0737fdcd03e2633e853d021219b5145fe72dafdc526321f95ed610\": rpc error: code = NotFound desc = could not find container \"f97cbad51c0737fdcd03e2633e853d021219b5145fe72dafdc526321f95ed610\": container with ID starting with f97cbad51c0737fdcd03e2633e853d021219b5145fe72dafdc526321f95ed610 not found: ID does not exist"
Jul 28 08:34:47.616098 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.616079    2583 scope.go:117] "RemoveContainer" containerID="d65c9eb2ca0e8e024f3b87f42add0fb8bba9f435100a94f84530cfa912045312"
Jul 28 08:34:47.616294 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:34:47.616280    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d65c9eb2ca0e8e024f3b87f42add0fb8bba9f435100a94f84530cfa912045312\": container with ID starting with d65c9eb2ca0e8e024f3b87f42add0fb8bba9f435100a94f84530cfa912045312 not found: ID does not exist" containerID="d65c9eb2ca0e8e024f3b87f42add0fb8bba9f435100a94f84530cfa912045312"
Jul 28 08:34:47.616352 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.616297    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d65c9eb2ca0e8e024f3b87f42add0fb8bba9f435100a94f84530cfa912045312"} err="failed to get container status \"d65c9eb2ca0e8e024f3b87f42add0fb8bba9f435100a94f84530cfa912045312\": rpc error: code = NotFound desc = could not find container \"d65c9eb2ca0e8e024f3b87f42add0fb8bba9f435100a94f84530cfa912045312\": container with ID starting with d65c9eb2ca0e8e024f3b87f42add0fb8bba9f435100a94f84530cfa912045312 not found: ID does not exist"
Jul 28 08:34:47.616352 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.616309    2583 scope.go:117] "RemoveContainer" containerID="8bc6035f85f68bae95943edd96a3a7db35c218bfc535654271fcaaf8b1641b64"
Jul 28 08:34:47.616571 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:34:47.616542    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bc6035f85f68bae95943edd96a3a7db35c218bfc535654271fcaaf8b1641b64\": container with ID starting with 8bc6035f85f68bae95943edd96a3a7db35c218bfc535654271fcaaf8b1641b64 not found: ID does not exist" containerID="8bc6035f85f68bae95943edd96a3a7db35c218bfc535654271fcaaf8b1641b64"
Jul 28 08:34:47.616654 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.616581    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bc6035f85f68bae95943edd96a3a7db35c218bfc535654271fcaaf8b1641b64"} err="failed to get container status \"8bc6035f85f68bae95943edd96a3a7db35c218bfc535654271fcaaf8b1641b64\": rpc error: code = NotFound desc = could not find container \"8bc6035f85f68bae95943edd96a3a7db35c218bfc535654271fcaaf8b1641b64\": container with ID starting with 8bc6035f85f68bae95943edd96a3a7db35c218bfc535654271fcaaf8b1641b64 not found: ID does not exist"
Jul 28 08:34:47.616654 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.616606    2583 scope.go:117] "RemoveContainer" containerID="072cbc2ad35aa1e85c0c238d37542153dad35d5874d9d855153eaafb4344a92d"
Jul 28 08:34:47.616829 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:34:47.616812    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"072cbc2ad35aa1e85c0c238d37542153dad35d5874d9d855153eaafb4344a92d\": container with ID starting with 072cbc2ad35aa1e85c0c238d37542153dad35d5874d9d855153eaafb4344a92d not found: ID does not exist" containerID="072cbc2ad35aa1e85c0c238d37542153dad35d5874d9d855153eaafb4344a92d"
Jul 28 08:34:47.616866 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.616833    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"072cbc2ad35aa1e85c0c238d37542153dad35d5874d9d855153eaafb4344a92d"} err="failed to get container status \"072cbc2ad35aa1e85c0c238d37542153dad35d5874d9d855153eaafb4344a92d\": rpc error: code = NotFound desc = could not find container \"072cbc2ad35aa1e85c0c238d37542153dad35d5874d9d855153eaafb4344a92d\": container with ID starting with 072cbc2ad35aa1e85c0c238d37542153dad35d5874d9d855153eaafb4344a92d not found: ID does not exist"
Jul 28 08:34:47.616866 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.616848    2583 scope.go:117] "RemoveContainer" containerID="61d9cf11a45fe2d7745c603b8f516b944dc0f861e78a1384dc0c5b6accfa41ea"
Jul 28 08:34:47.617070 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:34:47.617051    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61d9cf11a45fe2d7745c603b8f516b944dc0f861e78a1384dc0c5b6accfa41ea\": container with ID starting with 61d9cf11a45fe2d7745c603b8f516b944dc0f861e78a1384dc0c5b6accfa41ea not found: ID does not exist" containerID="61d9cf11a45fe2d7745c603b8f516b944dc0f861e78a1384dc0c5b6accfa41ea"
Jul 28 08:34:47.617114 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.617077    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61d9cf11a45fe2d7745c603b8f516b944dc0f861e78a1384dc0c5b6accfa41ea"} err="failed to get container status \"61d9cf11a45fe2d7745c603b8f516b944dc0f861e78a1384dc0c5b6accfa41ea\": rpc error: code = NotFound desc = could not find container \"61d9cf11a45fe2d7745c603b8f516b944dc0f861e78a1384dc0c5b6accfa41ea\": container with ID starting with 61d9cf11a45fe2d7745c603b8f516b944dc0f861e78a1384dc0c5b6accfa41ea not found: ID does not exist"
Jul 28 08:34:47.617114 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.617092    2583 scope.go:117] "RemoveContainer" containerID="7dc466eded3a4b71e91acd10e88c0d4505d19787cbd268561f0538e039947dda"
Jul 28 08:34:47.617275 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:34:47.617260    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dc466eded3a4b71e91acd10e88c0d4505d19787cbd268561f0538e039947dda\": container with ID starting with 7dc466eded3a4b71e91acd10e88c0d4505d19787cbd268561f0538e039947dda not found: ID does not exist" containerID="7dc466eded3a4b71e91acd10e88c0d4505d19787cbd268561f0538e039947dda"
Jul 28 08:34:47.617333 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.617280    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dc466eded3a4b71e91acd10e88c0d4505d19787cbd268561f0538e039947dda"} err="failed to get container status \"7dc466eded3a4b71e91acd10e88c0d4505d19787cbd268561f0538e039947dda\": rpc error: code = NotFound desc = could not find container \"7dc466eded3a4b71e91acd10e88c0d4505d19787cbd268561f0538e039947dda\": container with ID starting with 7dc466eded3a4b71e91acd10e88c0d4505d19787cbd268561f0538e039947dda not found: ID does not exist"
Jul 28 08:34:47.617333 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.617296    2583 scope.go:117] "RemoveContainer" containerID="f97cbad51c0737fdcd03e2633e853d021219b5145fe72dafdc526321f95ed610"
Jul 28 08:34:47.617509 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.617491    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f97cbad51c0737fdcd03e2633e853d021219b5145fe72dafdc526321f95ed610"} err="failed to get container status \"f97cbad51c0737fdcd03e2633e853d021219b5145fe72dafdc526321f95ed610\": rpc error: code = NotFound desc = could not find container \"f97cbad51c0737fdcd03e2633e853d021219b5145fe72dafdc526321f95ed610\": container with ID starting with f97cbad51c0737fdcd03e2633e853d021219b5145fe72dafdc526321f95ed610 not found: ID does not exist"
Jul 28 08:34:47.617560 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.617511    2583 scope.go:117] "RemoveContainer" containerID="d65c9eb2ca0e8e024f3b87f42add0fb8bba9f435100a94f84530cfa912045312"
Jul 28 08:34:47.617760 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.617740    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d65c9eb2ca0e8e024f3b87f42add0fb8bba9f435100a94f84530cfa912045312"} err="failed to get container status \"d65c9eb2ca0e8e024f3b87f42add0fb8bba9f435100a94f84530cfa912045312\": rpc error: code = NotFound desc = could not find container \"d65c9eb2ca0e8e024f3b87f42add0fb8bba9f435100a94f84530cfa912045312\": container with ID starting with d65c9eb2ca0e8e024f3b87f42add0fb8bba9f435100a94f84530cfa912045312 not found: ID does not exist"
Jul 28 08:34:47.617831 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.617760    2583 scope.go:117] "RemoveContainer" containerID="8bc6035f85f68bae95943edd96a3a7db35c218bfc535654271fcaaf8b1641b64"
Jul 28 08:34:47.618036 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.618017    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bc6035f85f68bae95943edd96a3a7db35c218bfc535654271fcaaf8b1641b64"} err="failed to get container status \"8bc6035f85f68bae95943edd96a3a7db35c218bfc535654271fcaaf8b1641b64\": rpc error: code = NotFound desc = could not find container \"8bc6035f85f68bae95943edd96a3a7db35c218bfc535654271fcaaf8b1641b64\": container with ID starting with 8bc6035f85f68bae95943edd96a3a7db35c218bfc535654271fcaaf8b1641b64 not found: ID does not exist"
Jul 28 08:34:47.618081 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.618037    2583 scope.go:117] "RemoveContainer" containerID="072cbc2ad35aa1e85c0c238d37542153dad35d5874d9d855153eaafb4344a92d"
Jul 28 08:34:47.618274 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.618251    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"072cbc2ad35aa1e85c0c238d37542153dad35d5874d9d855153eaafb4344a92d"} err="failed to get container status \"072cbc2ad35aa1e85c0c238d37542153dad35d5874d9d855153eaafb4344a92d\": rpc error: code = NotFound desc = could not find container \"072cbc2ad35aa1e85c0c238d37542153dad35d5874d9d855153eaafb4344a92d\": container with ID starting with 072cbc2ad35aa1e85c0c238d37542153dad35d5874d9d855153eaafb4344a92d not found: ID does not exist"
Jul 28 08:34:47.618356 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.618284    2583 scope.go:117] "RemoveContainer" containerID="61d9cf11a45fe2d7745c603b8f516b944dc0f861e78a1384dc0c5b6accfa41ea"
Jul 28 08:34:47.618557 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.618538    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61d9cf11a45fe2d7745c603b8f516b944dc0f861e78a1384dc0c5b6accfa41ea"} err="failed to get container status \"61d9cf11a45fe2d7745c603b8f516b944dc0f861e78a1384dc0c5b6accfa41ea\": rpc error: code = NotFound desc = could not find container \"61d9cf11a45fe2d7745c603b8f516b944dc0f861e78a1384dc0c5b6accfa41ea\": container with ID starting with 61d9cf11a45fe2d7745c603b8f516b944dc0f861e78a1384dc0c5b6accfa41ea not found: ID does not exist"
Jul 28 08:34:47.618617 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.618558    2583 scope.go:117] "RemoveContainer" containerID="7dc466eded3a4b71e91acd10e88c0d4505d19787cbd268561f0538e039947dda"
Jul 28 08:34:47.618748 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.618724    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dc466eded3a4b71e91acd10e88c0d4505d19787cbd268561f0538e039947dda"} err="failed to get container status \"7dc466eded3a4b71e91acd10e88c0d4505d19787cbd268561f0538e039947dda\": rpc error: code = NotFound desc = could not find container \"7dc466eded3a4b71e91acd10e88c0d4505d19787cbd268561f0538e039947dda\": container with ID starting with 7dc466eded3a4b71e91acd10e88c0d4505d19787cbd268561f0538e039947dda not found: ID does not exist"
Jul 28 08:34:47.637611 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.637585    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/80e031cb-b537-4557-bc44-f9d0229b908e-feast-data\") pod \"80e031cb-b537-4557-bc44-f9d0229b908e\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") "
Jul 28 08:34:47.637740 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.637621    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-ui-tls\") pod \"80e031cb-b537-4557-bc44-f9d0229b908e\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") "
Jul 28 08:34:47.637740 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.637644    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npzxg\" (UniqueName: \"kubernetes.io/projected/80e031cb-b537-4557-bc44-f9d0229b908e-kube-api-access-npzxg\") pod \"80e031cb-b537-4557-bc44-f9d0229b908e\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") "
Jul 28 08:34:47.637740 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.637673    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-registry-tls\") pod \"80e031cb-b537-4557-bc44-f9d0229b908e\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") "
Jul 28 08:34:47.637943 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.637910    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-online-tls\") pod \"80e031cb-b537-4557-bc44-f9d0229b908e\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") "
Jul 28 08:34:47.638083 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.637973    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-offline-tls\") pod \"80e031cb-b537-4557-bc44-f9d0229b908e\" (UID: \"80e031cb-b537-4557-bc44-f9d0229b908e\") "
Jul 28 08:34:47.638228 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.638203    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80e031cb-b537-4557-bc44-f9d0229b908e-feast-data" (OuterVolumeSpecName: "feast-data") pod "80e031cb-b537-4557-bc44-f9d0229b908e" (UID: "80e031cb-b537-4557-bc44-f9d0229b908e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 08:34:47.640196 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.640168    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "80e031cb-b537-4557-bc44-f9d0229b908e" (UID: "80e031cb-b537-4557-bc44-f9d0229b908e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:34:47.640196 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.640189    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "80e031cb-b537-4557-bc44-f9d0229b908e" (UID: "80e031cb-b537-4557-bc44-f9d0229b908e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:34:47.640368 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.640233    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-online-tls" (OuterVolumeSpecName: "online-tls") pod "80e031cb-b537-4557-bc44-f9d0229b908e" (UID: "80e031cb-b537-4557-bc44-f9d0229b908e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:34:47.640475 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.640435    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80e031cb-b537-4557-bc44-f9d0229b908e-kube-api-access-npzxg" (OuterVolumeSpecName: "kube-api-access-npzxg") pod "80e031cb-b537-4557-bc44-f9d0229b908e" (UID: "80e031cb-b537-4557-bc44-f9d0229b908e"). InnerVolumeSpecName "kube-api-access-npzxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:34:47.640699 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.640680    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "80e031cb-b537-4557-bc44-f9d0229b908e" (UID: "80e031cb-b537-4557-bc44-f9d0229b908e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:34:47.739186 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.739098    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/80e031cb-b537-4557-bc44-f9d0229b908e-feast-data\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:34:47.739186 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.739131    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-ui-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:34:47.739186 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.739141    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npzxg\" (UniqueName: \"kubernetes.io/projected/80e031cb-b537-4557-bc44-f9d0229b908e-kube-api-access-npzxg\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:34:47.739186 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.739151    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-registry-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:34:47.739186 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.739159    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-online-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:34:47.739186 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.739166    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/80e031cb-b537-4557-bc44-f9d0229b908e-offline-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:34:47.884598 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.884565    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"]
Jul 28 08:34:47.889279 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:47.889247    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-v48s7"]
Jul 28 08:34:49.333590 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:34:49.333560    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" path="/var/lib/kubelet/pods/80e031cb-b537-4557-bc44-f9d0229b908e/volumes"
Jul 28 08:35:38.537226 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.537184    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"]
Jul 28 08:35:38.537708 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.537589    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="ui"
Jul 28 08:35:38.537708 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.537602    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="ui"
Jul 28 08:35:38.537708 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.537614    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="feast-apply"
Jul 28 08:35:38.537708 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.537620    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="feast-apply"
Jul 28 08:35:38.537708 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.537635    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="registry"
Jul 28 08:35:38.537708 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.537641    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="registry"
Jul 28 08:35:38.537708 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.537647    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="offline"
Jul 28 08:35:38.537708 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.537653    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="offline"
Jul 28 08:35:38.537708 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.537663    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="online"
Jul 28 08:35:38.537708 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.537668    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="online"
Jul 28 08:35:38.537708 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.537681    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="feast-init"
Jul 28 08:35:38.537708 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.537686    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="feast-init"
Jul 28 08:35:38.538137 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.537735    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="ui"
Jul 28 08:35:38.538137 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.537745    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="registry"
Jul 28 08:35:38.538137 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.537752    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="online"
Jul 28 08:35:38.538137 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.537761    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="80e031cb-b537-4557-bc44-f9d0229b908e" containerName="offline"
Jul 28 08:35:38.541197 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.541179    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:38.543732 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.543707    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jul 28 08:35:38.543853 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.543795    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jul 28 08:35:38.543905 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.543851    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-x6hqg\""
Jul 28 08:35:38.544305 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.544281    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jul 28 08:35:38.544464 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.544289    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jul 28 08:35:38.544464 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.544329    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jul 28 08:35:38.544464 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.544385    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jul 28 08:35:38.554218 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.554154    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"]
Jul 28 08:35:38.603645 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.603612    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvr25\" (UniqueName: \"kubernetes.io/projected/2061af47-8b28-456c-b48b-013646fc13b8-kube-api-access-rvr25\") pod \"feast-simple-feast-remote-setup-db6955c6c-prcrp\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:38.603847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.603695    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2061af47-8b28-456c-b48b-013646fc13b8-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-prcrp\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:38.603847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.603715    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-prcrp\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:38.603847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.603738    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-prcrp\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:38.603847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.603760    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2061af47-8b28-456c-b48b-013646fc13b8-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-prcrp\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:38.603847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.603807    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-prcrp\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:38.704417 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.704377    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2061af47-8b28-456c-b48b-013646fc13b8-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-prcrp\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:38.704417 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.704420    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-prcrp\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:38.704724 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.704486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-prcrp\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:38.704724 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.704511    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2061af47-8b28-456c-b48b-013646fc13b8-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-prcrp\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:38.704724 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.704538    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-prcrp\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:38.704724 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.704585    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvr25\" (UniqueName: \"kubernetes.io/projected/2061af47-8b28-456c-b48b-013646fc13b8-kube-api-access-rvr25\") pod \"feast-simple-feast-remote-setup-db6955c6c-prcrp\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:38.704724 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:35:38.704637    2583 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Jul 28 08:35:38.704724 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:35:38.704654    2583 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
Jul 28 08:35:38.704724 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:35:38.704643    2583 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
Jul 28 08:35:38.705078 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:35:38.704731    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-ui-tls podName:2061af47-8b28-456c-b48b-013646fc13b8 nodeName:}" failed. No retries permitted until 2026-07-28 08:35:39.204708433 +0000 UTC m=+1974.391896542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-ui-tls") pod "feast-simple-feast-remote-setup-db6955c6c-prcrp" (UID: "2061af47-8b28-456c-b48b-013646fc13b8") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Jul 28 08:35:38.705078 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:35:38.704752    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-offline-tls podName:2061af47-8b28-456c-b48b-013646fc13b8 nodeName:}" failed. No retries permitted until 2026-07-28 08:35:39.204741905 +0000 UTC m=+1974.391930014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-offline-tls") pod "feast-simple-feast-remote-setup-db6955c6c-prcrp" (UID: "2061af47-8b28-456c-b48b-013646fc13b8") : secret "feast-simple-feast-remote-setup-offline-tls" not found
Jul 28 08:35:38.705078 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:35:38.704773    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-online-tls podName:2061af47-8b28-456c-b48b-013646fc13b8 nodeName:}" failed. No retries permitted until 2026-07-28 08:35:39.204760149 +0000 UTC m=+1974.391948258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-online-tls") pod "feast-simple-feast-remote-setup-db6955c6c-prcrp" (UID: "2061af47-8b28-456c-b48b-013646fc13b8") : secret "feast-simple-feast-remote-setup-online-tls" not found
Jul 28 08:35:38.705078 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.704911    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2061af47-8b28-456c-b48b-013646fc13b8-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-prcrp\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:38.705226 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.705174    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2061af47-8b28-456c-b48b-013646fc13b8-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-prcrp\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:38.715406 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:38.715376    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvr25\" (UniqueName: \"kubernetes.io/projected/2061af47-8b28-456c-b48b-013646fc13b8-kube-api-access-rvr25\") pod \"feast-simple-feast-remote-setup-db6955c6c-prcrp\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:39.210711 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:39.210670    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-prcrp\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:39.210920 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:39.210723    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-prcrp\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:39.210920 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:39.210900    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-prcrp\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:39.213354 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:39.213327    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-prcrp\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:39.213515 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:39.213381    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-prcrp\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:39.213515 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:39.213430    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-prcrp\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:39.457142 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:39.457108    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:39.595304 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:39.595277    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"]
Jul 28 08:35:39.597816 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:35:39.597784    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2061af47_8b28_456c_b48b_013646fc13b8.slice/crio-da1de8779b992c685af2635f55878d9488960aa8357c29138316fc776e6a4da2 WatchSource:0}: Error finding container da1de8779b992c685af2635f55878d9488960aa8357c29138316fc776e6a4da2: Status 404 returned error can't find the container with id da1de8779b992c685af2635f55878d9488960aa8357c29138316fc776e6a4da2
Jul 28 08:35:39.783310 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:39.783210    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" event={"ID":"2061af47-8b28-456c-b48b-013646fc13b8","Type":"ContainerStarted","Data":"fd9fb9cb49b9cff50e40e265f47404e961a7212935656fed81de3a86fcb02701"}
Jul 28 08:35:39.783310 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:39.783259    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" event={"ID":"2061af47-8b28-456c-b48b-013646fc13b8","Type":"ContainerStarted","Data":"da1de8779b992c685af2635f55878d9488960aa8357c29138316fc776e6a4da2"}
Jul 28 08:35:44.808228 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:44.808134    2583 generic.go:356] "Generic (PLEG): container finished" podID="2061af47-8b28-456c-b48b-013646fc13b8" containerID="fd9fb9cb49b9cff50e40e265f47404e961a7212935656fed81de3a86fcb02701" exitCode=0
Jul 28 08:35:44.808228 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:44.808207    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" event={"ID":"2061af47-8b28-456c-b48b-013646fc13b8","Type":"ContainerDied","Data":"fd9fb9cb49b9cff50e40e265f47404e961a7212935656fed81de3a86fcb02701"}
Jul 28 08:35:45.814322 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:45.814232    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" event={"ID":"2061af47-8b28-456c-b48b-013646fc13b8","Type":"ContainerStarted","Data":"985bdc6024c087665b377f3570dcac1545de4b04eb7e3d2153892a768c66e095"}
Jul 28 08:35:50.839222 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:50.839184    2583 generic.go:356] "Generic (PLEG): container finished" podID="2061af47-8b28-456c-b48b-013646fc13b8" containerID="985bdc6024c087665b377f3570dcac1545de4b04eb7e3d2153892a768c66e095" exitCode=0
Jul 28 08:35:50.839662 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:50.839256    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" event={"ID":"2061af47-8b28-456c-b48b-013646fc13b8","Type":"ContainerDied","Data":"985bdc6024c087665b377f3570dcac1545de4b04eb7e3d2153892a768c66e095"}
Jul 28 08:35:51.849072 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:51.849026    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" event={"ID":"2061af47-8b28-456c-b48b-013646fc13b8","Type":"ContainerStarted","Data":"a41d326c0157fa738c8489701559da0a50a1597f92012f3afe01e83b03a8ff61"}
Jul 28 08:35:51.849441 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:51.849096    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" event={"ID":"2061af47-8b28-456c-b48b-013646fc13b8","Type":"ContainerStarted","Data":"5274f6a1564e58ecc6c24b6e8cc42d2b69908d4ea46f8d7b55d3315abe572059"}
Jul 28 08:35:51.849441 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:51.849117    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" event={"ID":"2061af47-8b28-456c-b48b-013646fc13b8","Type":"ContainerStarted","Data":"858a3cc80b12b23f3655dca7f70c666f920634d3adc069973d9937d2d0365eb7"}
Jul 28 08:35:51.875182 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:51.875114    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" podStartSLOduration=13.875095437 podStartE2EDuration="13.875095437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:35:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:35:51.874607455 +0000 UTC m=+1987.061795587" watchObservedRunningTime="2026-07-28 08:35:51.875095437 +0000 UTC m=+1987.062283568"
Jul 28 08:35:54.457650 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:54.457613    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:54.458159 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:54.457671    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:54.458159 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:54.457687    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:54.459535 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:54.459489    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.41:8816: connect: connection refused"
Jul 28 08:35:54.459535 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:54.459505    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.41:8443: connect: connection refused"
Jul 28 08:35:54.459730 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:54.459603    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.41:6567/health\": dial tcp 10.132.0.41:6567: connect: connection refused"
Jul 28 08:35:57.458759 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:57.458728    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:57.459160 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:57.458823    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:57.459266 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:57.459237    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:57.459421 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:57.459279    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:57.459621 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:57.459601    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:57.459701 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:57.459689    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:57.465436 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:57.465412    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:57.879848 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:57.879819    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:35:57.884565 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:35:57.884540    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:36:59.578604 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:36:59.578544    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"]
Jul 28 08:36:59.579078 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:36:59.578865    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="online" containerID="cri-o://858a3cc80b12b23f3655dca7f70c666f920634d3adc069973d9937d2d0365eb7" gracePeriod=30
Jul 28 08:36:59.579157 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:36:59.579109    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="ui" containerID="cri-o://a41d326c0157fa738c8489701559da0a50a1597f92012f3afe01e83b03a8ff61" gracePeriod=30
Jul 28 08:36:59.579242 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:36:59.579218    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="offline" containerID="cri-o://5274f6a1564e58ecc6c24b6e8cc42d2b69908d4ea46f8d7b55d3315abe572059" gracePeriod=30
Jul 28 08:36:59.719761 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:36:59.719726    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"]
Jul 28 08:36:59.720076 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:36:59.720038    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="registry" containerID="cri-o://ad494f437bd3ce83e121a8b649e22222f396dfebf3f617ad2f85a43c72905ead" gracePeriod=30
Jul 28 08:36:59.720191 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:36:59.720087    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="offline" containerID="cri-o://007c56c606fc514be4e11e414486f9ead752791f7d5be6c521b80fe144c794aa" gracePeriod=30
Jul 28 08:36:59.720281 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:36:59.720104    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="online" containerID="cri-o://df5ec3cf3a37e0e652296dad296a33dc8d5077467123322c3488319e0f134bc4" gracePeriod=30
Jul 28 08:36:59.720497 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:36:59.720466    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="ui" containerID="cri-o://76b0ed918ad483d5ead76cc683a072e0722aeddbca5668bb8f6ed6bd84c16f91" gracePeriod=30
Jul 28 08:37:01.150740 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:01.150705    2583 generic.go:356] "Generic (PLEG): container finished" podID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerID="76b0ed918ad483d5ead76cc683a072e0722aeddbca5668bb8f6ed6bd84c16f91" exitCode=0
Jul 28 08:37:01.150740 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:01.150731    2583 generic.go:356] "Generic (PLEG): container finished" podID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerID="df5ec3cf3a37e0e652296dad296a33dc8d5077467123322c3488319e0f134bc4" exitCode=0
Jul 28 08:37:01.151243 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:01.150777    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" event={"ID":"11596dd6-119a-44f7-9e0d-10adb516a8df","Type":"ContainerDied","Data":"76b0ed918ad483d5ead76cc683a072e0722aeddbca5668bb8f6ed6bd84c16f91"}
Jul 28 08:37:01.151243 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:01.150820    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" event={"ID":"11596dd6-119a-44f7-9e0d-10adb516a8df","Type":"ContainerDied","Data":"df5ec3cf3a37e0e652296dad296a33dc8d5077467123322c3488319e0f134bc4"}
Jul 28 08:37:01.153564 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:01.153540    2583 generic.go:356] "Generic (PLEG): container finished" podID="2061af47-8b28-456c-b48b-013646fc13b8" containerID="a41d326c0157fa738c8489701559da0a50a1597f92012f3afe01e83b03a8ff61" exitCode=0
Jul 28 08:37:01.153564 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:01.153560    2583 generic.go:356] "Generic (PLEG): container finished" podID="2061af47-8b28-456c-b48b-013646fc13b8" containerID="858a3cc80b12b23f3655dca7f70c666f920634d3adc069973d9937d2d0365eb7" exitCode=0
Jul 28 08:37:01.153734 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:01.153578    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" event={"ID":"2061af47-8b28-456c-b48b-013646fc13b8","Type":"ContainerDied","Data":"a41d326c0157fa738c8489701559da0a50a1597f92012f3afe01e83b03a8ff61"}
Jul 28 08:37:01.153734 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:01.153603    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" event={"ID":"2061af47-8b28-456c-b48b-013646fc13b8","Type":"ContainerDied","Data":"858a3cc80b12b23f3655dca7f70c666f920634d3adc069973d9937d2d0365eb7"}
Jul 28 08:37:07.459594 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:07.459495    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.41:8443: connect: connection refused"
Jul 28 08:37:07.509536 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:07.509491    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.40:8443: connect: connection refused"
Jul 28 08:37:07.509710 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:07.509506    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="online" probeResult="failure" output="Get \"https://10.132.0.40:6567/health\": dial tcp 10.132.0.40:6567: connect: connection refused"
Jul 28 08:37:07.880723 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:07.880681    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.41:6567/health\": dial tcp 10.132.0.41:6567: connect: connection refused"
Jul 28 08:37:17.460208 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:17.460166    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.41:8443: connect: connection refused"
Jul 28 08:37:17.508629 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:17.508592    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.40:8443: connect: connection refused"
Jul 28 08:37:17.508785 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:17.508616    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="online" probeResult="failure" output="Get \"https://10.132.0.40:6567/health\": dial tcp 10.132.0.40:6567: connect: connection refused"
Jul 28 08:37:17.881027 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:17.880990    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.41:6567/health\": dial tcp 10.132.0.41:6567: connect: connection refused"
Jul 28 08:37:27.459757 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:27.459703    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.41:8443: connect: connection refused"
Jul 28 08:37:27.460278 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:27.459867    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:37:27.508664 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:27.508618    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.40:8443: connect: connection refused"
Jul 28 08:37:27.508664 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:27.508640    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="online" probeResult="failure" output="Get \"https://10.132.0.40:6567/health\": dial tcp 10.132.0.40:6567: connect: connection refused"
Jul 28 08:37:27.508931 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:27.508759    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:37:27.508931 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:27.508840    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:37:27.880979 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:27.880939    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.41:6567/health\": dial tcp 10.132.0.41:6567: connect: connection refused"
Jul 28 08:37:27.881178 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:27.881080    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:37:30.241009 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.240981    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:37:30.257261 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.257231    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-offline-tls\") pod \"2061af47-8b28-456c-b48b-013646fc13b8\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") "
Jul 28 08:37:30.257435 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.257278    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2061af47-8b28-456c-b48b-013646fc13b8-feast-data\") pod \"2061af47-8b28-456c-b48b-013646fc13b8\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") "
Jul 28 08:37:30.257435 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.257323    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvr25\" (UniqueName: \"kubernetes.io/projected/2061af47-8b28-456c-b48b-013646fc13b8-kube-api-access-rvr25\") pod \"2061af47-8b28-456c-b48b-013646fc13b8\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") "
Jul 28 08:37:30.257435 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.257386    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-ui-tls\") pod \"2061af47-8b28-456c-b48b-013646fc13b8\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") "
Jul 28 08:37:30.257435 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.257407    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2061af47-8b28-456c-b48b-013646fc13b8-registry-tls\") pod \"2061af47-8b28-456c-b48b-013646fc13b8\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") "
Jul 28 08:37:30.257435 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.257424    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-online-tls\") pod \"2061af47-8b28-456c-b48b-013646fc13b8\" (UID: \"2061af47-8b28-456c-b48b-013646fc13b8\") "
Jul 28 08:37:30.257888 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.257823    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2061af47-8b28-456c-b48b-013646fc13b8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2061af47-8b28-456c-b48b-013646fc13b8" (UID: "2061af47-8b28-456c-b48b-013646fc13b8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 08:37:30.258024 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.257931    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2061af47-8b28-456c-b48b-013646fc13b8-feast-data" (OuterVolumeSpecName: "feast-data") pod "2061af47-8b28-456c-b48b-013646fc13b8" (UID: "2061af47-8b28-456c-b48b-013646fc13b8"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 08:37:30.258256 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.258234    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2061af47-8b28-456c-b48b-013646fc13b8-registry-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:37:30.258256 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.258254    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2061af47-8b28-456c-b48b-013646fc13b8-feast-data\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:37:30.259978 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.259945    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "2061af47-8b28-456c-b48b-013646fc13b8" (UID: "2061af47-8b28-456c-b48b-013646fc13b8"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:37:30.259978 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.259968    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2061af47-8b28-456c-b48b-013646fc13b8-kube-api-access-rvr25" (OuterVolumeSpecName: "kube-api-access-rvr25") pod "2061af47-8b28-456c-b48b-013646fc13b8" (UID: "2061af47-8b28-456c-b48b-013646fc13b8"). InnerVolumeSpecName "kube-api-access-rvr25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:37:30.260119 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.260080    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "2061af47-8b28-456c-b48b-013646fc13b8" (UID: "2061af47-8b28-456c-b48b-013646fc13b8"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:37:30.260243 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.260223    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-online-tls" (OuterVolumeSpecName: "online-tls") pod "2061af47-8b28-456c-b48b-013646fc13b8" (UID: "2061af47-8b28-456c-b48b-013646fc13b8"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:37:30.286263 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.286223    2583 generic.go:356] "Generic (PLEG): container finished" podID="2061af47-8b28-456c-b48b-013646fc13b8" containerID="5274f6a1564e58ecc6c24b6e8cc42d2b69908d4ea46f8d7b55d3315abe572059" exitCode=137
Jul 28 08:37:30.286421 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.286284    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"
Jul 28 08:37:30.286421 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.286348    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" event={"ID":"2061af47-8b28-456c-b48b-013646fc13b8","Type":"ContainerDied","Data":"5274f6a1564e58ecc6c24b6e8cc42d2b69908d4ea46f8d7b55d3315abe572059"}
Jul 28 08:37:30.286421 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.286400    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp" event={"ID":"2061af47-8b28-456c-b48b-013646fc13b8","Type":"ContainerDied","Data":"da1de8779b992c685af2635f55878d9488960aa8357c29138316fc776e6a4da2"}
Jul 28 08:37:30.286647 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.286427    2583 scope.go:117] "RemoveContainer" containerID="a41d326c0157fa738c8489701559da0a50a1597f92012f3afe01e83b03a8ff61"
Jul 28 08:37:30.295560 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.295503    2583 generic.go:356] "Generic (PLEG): container finished" podID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerID="007c56c606fc514be4e11e414486f9ead752791f7d5be6c521b80fe144c794aa" exitCode=137
Jul 28 08:37:30.295560 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.295527    2583 generic.go:356] "Generic (PLEG): container finished" podID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerID="ad494f437bd3ce83e121a8b649e22222f396dfebf3f617ad2f85a43c72905ead" exitCode=137
Jul 28 08:37:30.295750 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.295568    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" event={"ID":"11596dd6-119a-44f7-9e0d-10adb516a8df","Type":"ContainerDied","Data":"007c56c606fc514be4e11e414486f9ead752791f7d5be6c521b80fe144c794aa"}
Jul 28 08:37:30.295750 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.295605    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" event={"ID":"11596dd6-119a-44f7-9e0d-10adb516a8df","Type":"ContainerDied","Data":"ad494f437bd3ce83e121a8b649e22222f396dfebf3f617ad2f85a43c72905ead"}
Jul 28 08:37:30.299546 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.299515    2583 scope.go:117] "RemoveContainer" containerID="5274f6a1564e58ecc6c24b6e8cc42d2b69908d4ea46f8d7b55d3315abe572059"
Jul 28 08:37:30.309766 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.309738    2583 scope.go:117] "RemoveContainer" containerID="858a3cc80b12b23f3655dca7f70c666f920634d3adc069973d9937d2d0365eb7"
Jul 28 08:37:30.312522 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.312493    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"]
Jul 28 08:37:30.320220 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.320193    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-prcrp"]
Jul 28 08:37:30.321615 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.321593    2583 scope.go:117] "RemoveContainer" containerID="985bdc6024c087665b377f3570dcac1545de4b04eb7e3d2153892a768c66e095"
Jul 28 08:37:30.330834 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.330811    2583 scope.go:117] "RemoveContainer" containerID="fd9fb9cb49b9cff50e40e265f47404e961a7212935656fed81de3a86fcb02701"
Jul 28 08:37:30.338911 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.338888    2583 scope.go:117] "RemoveContainer" containerID="a41d326c0157fa738c8489701559da0a50a1597f92012f3afe01e83b03a8ff61"
Jul 28 08:37:30.339224 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:37:30.339202    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a41d326c0157fa738c8489701559da0a50a1597f92012f3afe01e83b03a8ff61\": container with ID starting with a41d326c0157fa738c8489701559da0a50a1597f92012f3afe01e83b03a8ff61 not found: ID does not exist" containerID="a41d326c0157fa738c8489701559da0a50a1597f92012f3afe01e83b03a8ff61"
Jul 28 08:37:30.339288 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.339235    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a41d326c0157fa738c8489701559da0a50a1597f92012f3afe01e83b03a8ff61"} err="failed to get container status \"a41d326c0157fa738c8489701559da0a50a1597f92012f3afe01e83b03a8ff61\": rpc error: code = NotFound desc = could not find container \"a41d326c0157fa738c8489701559da0a50a1597f92012f3afe01e83b03a8ff61\": container with ID starting with a41d326c0157fa738c8489701559da0a50a1597f92012f3afe01e83b03a8ff61 not found: ID does not exist"
Jul 28 08:37:30.339288 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.339255    2583 scope.go:117] "RemoveContainer" containerID="5274f6a1564e58ecc6c24b6e8cc42d2b69908d4ea46f8d7b55d3315abe572059"
Jul 28 08:37:30.339590 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:37:30.339573    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5274f6a1564e58ecc6c24b6e8cc42d2b69908d4ea46f8d7b55d3315abe572059\": container with ID starting with 5274f6a1564e58ecc6c24b6e8cc42d2b69908d4ea46f8d7b55d3315abe572059 not found: ID does not exist" containerID="5274f6a1564e58ecc6c24b6e8cc42d2b69908d4ea46f8d7b55d3315abe572059"
Jul 28 08:37:30.339660 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.339594    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5274f6a1564e58ecc6c24b6e8cc42d2b69908d4ea46f8d7b55d3315abe572059"} err="failed to get container status \"5274f6a1564e58ecc6c24b6e8cc42d2b69908d4ea46f8d7b55d3315abe572059\": rpc error: code = NotFound desc = could not find container \"5274f6a1564e58ecc6c24b6e8cc42d2b69908d4ea46f8d7b55d3315abe572059\": container with ID starting with 5274f6a1564e58ecc6c24b6e8cc42d2b69908d4ea46f8d7b55d3315abe572059 not found: ID does not exist"
Jul 28 08:37:30.339660 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.339608    2583 scope.go:117] "RemoveContainer" containerID="858a3cc80b12b23f3655dca7f70c666f920634d3adc069973d9937d2d0365eb7"
Jul 28 08:37:30.339867 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:37:30.339851    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"858a3cc80b12b23f3655dca7f70c666f920634d3adc069973d9937d2d0365eb7\": container with ID starting with 858a3cc80b12b23f3655dca7f70c666f920634d3adc069973d9937d2d0365eb7 not found: ID does not exist" containerID="858a3cc80b12b23f3655dca7f70c666f920634d3adc069973d9937d2d0365eb7"
Jul 28 08:37:30.339918 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.339869    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"858a3cc80b12b23f3655dca7f70c666f920634d3adc069973d9937d2d0365eb7"} err="failed to get container status \"858a3cc80b12b23f3655dca7f70c666f920634d3adc069973d9937d2d0365eb7\": rpc error: code = NotFound desc = could not find container \"858a3cc80b12b23f3655dca7f70c666f920634d3adc069973d9937d2d0365eb7\": container with ID starting with 858a3cc80b12b23f3655dca7f70c666f920634d3adc069973d9937d2d0365eb7 not found: ID does not exist"
Jul 28 08:37:30.339918 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.339882    2583 scope.go:117] "RemoveContainer" containerID="985bdc6024c087665b377f3570dcac1545de4b04eb7e3d2153892a768c66e095"
Jul 28 08:37:30.340105 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:37:30.340088    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"985bdc6024c087665b377f3570dcac1545de4b04eb7e3d2153892a768c66e095\": container with ID starting with 985bdc6024c087665b377f3570dcac1545de4b04eb7e3d2153892a768c66e095 not found: ID does not exist" containerID="985bdc6024c087665b377f3570dcac1545de4b04eb7e3d2153892a768c66e095"
Jul 28 08:37:30.340147 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.340112    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"985bdc6024c087665b377f3570dcac1545de4b04eb7e3d2153892a768c66e095"} err="failed to get container status \"985bdc6024c087665b377f3570dcac1545de4b04eb7e3d2153892a768c66e095\": rpc error: code = NotFound desc = could not find container \"985bdc6024c087665b377f3570dcac1545de4b04eb7e3d2153892a768c66e095\": container with ID starting with 985bdc6024c087665b377f3570dcac1545de4b04eb7e3d2153892a768c66e095 not found: ID does not exist"
Jul 28 08:37:30.340147 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.340127    2583 scope.go:117] "RemoveContainer" containerID="fd9fb9cb49b9cff50e40e265f47404e961a7212935656fed81de3a86fcb02701"
Jul 28 08:37:30.340363 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:37:30.340349    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd9fb9cb49b9cff50e40e265f47404e961a7212935656fed81de3a86fcb02701\": container with ID starting with fd9fb9cb49b9cff50e40e265f47404e961a7212935656fed81de3a86fcb02701 not found: ID does not exist" containerID="fd9fb9cb49b9cff50e40e265f47404e961a7212935656fed81de3a86fcb02701"
Jul 28 08:37:30.340417 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.340365    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd9fb9cb49b9cff50e40e265f47404e961a7212935656fed81de3a86fcb02701"} err="failed to get container status \"fd9fb9cb49b9cff50e40e265f47404e961a7212935656fed81de3a86fcb02701\": rpc error: code = NotFound desc = could not find container \"fd9fb9cb49b9cff50e40e265f47404e961a7212935656fed81de3a86fcb02701\": container with ID starting with fd9fb9cb49b9cff50e40e265f47404e961a7212935656fed81de3a86fcb02701 not found: ID does not exist"
Jul 28 08:37:30.358986 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.358913    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-ui-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:37:30.358986 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.358962    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-online-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:37:30.358986 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.358972    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2061af47-8b28-456c-b48b-013646fc13b8-offline-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:37:30.358986 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.358980    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvr25\" (UniqueName: \"kubernetes.io/projected/2061af47-8b28-456c-b48b-013646fc13b8-kube-api-access-rvr25\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:37:30.377592 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.377570    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:37:30.460024 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.459989    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-ui-tls\") pod \"11596dd6-119a-44f7-9e0d-10adb516a8df\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") "
Jul 28 08:37:30.460233 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.460061    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-online-tls\") pod \"11596dd6-119a-44f7-9e0d-10adb516a8df\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") "
Jul 28 08:37:30.460233 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.460086    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-747fd\" (UniqueName: \"kubernetes.io/projected/11596dd6-119a-44f7-9e0d-10adb516a8df-kube-api-access-747fd\") pod \"11596dd6-119a-44f7-9e0d-10adb516a8df\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") "
Jul 28 08:37:30.460233 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.460103    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-registry-tls\") pod \"11596dd6-119a-44f7-9e0d-10adb516a8df\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") "
Jul 28 08:37:30.460233 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.460128    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/11596dd6-119a-44f7-9e0d-10adb516a8df-feast-data\") pod \"11596dd6-119a-44f7-9e0d-10adb516a8df\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") "
Jul 28 08:37:30.460233 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.460150    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-offline-tls\") pod \"11596dd6-119a-44f7-9e0d-10adb516a8df\" (UID: \"11596dd6-119a-44f7-9e0d-10adb516a8df\") "
Jul 28 08:37:30.461023 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.460782    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11596dd6-119a-44f7-9e0d-10adb516a8df-feast-data" (OuterVolumeSpecName: "feast-data") pod "11596dd6-119a-44f7-9e0d-10adb516a8df" (UID: "11596dd6-119a-44f7-9e0d-10adb516a8df"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 08:37:30.462571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.462541    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-online-tls" (OuterVolumeSpecName: "online-tls") pod "11596dd6-119a-44f7-9e0d-10adb516a8df" (UID: "11596dd6-119a-44f7-9e0d-10adb516a8df"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:37:30.462571 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.462559    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "11596dd6-119a-44f7-9e0d-10adb516a8df" (UID: "11596dd6-119a-44f7-9e0d-10adb516a8df"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:37:30.462739 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.462571    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "11596dd6-119a-44f7-9e0d-10adb516a8df" (UID: "11596dd6-119a-44f7-9e0d-10adb516a8df"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:37:30.462792 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.462760    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "11596dd6-119a-44f7-9e0d-10adb516a8df" (UID: "11596dd6-119a-44f7-9e0d-10adb516a8df"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 08:37:30.462884 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.462867    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11596dd6-119a-44f7-9e0d-10adb516a8df-kube-api-access-747fd" (OuterVolumeSpecName: "kube-api-access-747fd") pod "11596dd6-119a-44f7-9e0d-10adb516a8df" (UID: "11596dd6-119a-44f7-9e0d-10adb516a8df"). InnerVolumeSpecName "kube-api-access-747fd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:37:30.561185 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.561146    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-ui-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:37:30.561185 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.561177    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-online-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:37:30.561185 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.561189    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-747fd\" (UniqueName: \"kubernetes.io/projected/11596dd6-119a-44f7-9e0d-10adb516a8df-kube-api-access-747fd\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:37:30.561435 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.561198    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-registry-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:37:30.561435 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.561207    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/11596dd6-119a-44f7-9e0d-10adb516a8df-feast-data\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:37:30.561435 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:30.561215    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/11596dd6-119a-44f7-9e0d-10adb516a8df-offline-tls\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:37:31.303054 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:31.303020    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp" event={"ID":"11596dd6-119a-44f7-9e0d-10adb516a8df","Type":"ContainerDied","Data":"d8b37b1e82b8662d2089c9a86229de4c3a66dd498c410be3dc5e665058fd1942"}
Jul 28 08:37:31.303492 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:31.303065    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"
Jul 28 08:37:31.303492 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:31.303078    2583 scope.go:117] "RemoveContainer" containerID="76b0ed918ad483d5ead76cc683a072e0722aeddbca5668bb8f6ed6bd84c16f91"
Jul 28 08:37:31.312685 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:31.312661    2583 scope.go:117] "RemoveContainer" containerID="007c56c606fc514be4e11e414486f9ead752791f7d5be6c521b80fe144c794aa"
Jul 28 08:37:31.320544 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:31.320432    2583 scope.go:117] "RemoveContainer" containerID="df5ec3cf3a37e0e652296dad296a33dc8d5077467123322c3488319e0f134bc4"
Jul 28 08:37:31.326343 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:31.326317    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"]
Jul 28 08:37:31.328865 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:31.328850    2583 scope.go:117] "RemoveContainer" containerID="ad494f437bd3ce83e121a8b649e22222f396dfebf3f617ad2f85a43c72905ead"
Jul 28 08:37:31.335134 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:31.335107    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2061af47-8b28-456c-b48b-013646fc13b8" path="/var/lib/kubelet/pods/2061af47-8b28-456c-b48b-013646fc13b8/volumes"
Jul 28 08:37:31.335572 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:31.335556    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-2ffhp"]
Jul 28 08:37:31.337907 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:31.337889    2583 scope.go:117] "RemoveContainer" containerID="9afc66bcc8553607837e4af8eac1c3fae1a3ec95fdbc903977a1226b9797eabc"
Jul 28 08:37:31.345474 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:31.345430    2583 scope.go:117] "RemoveContainer" containerID="900e464760adf42e74f36da6faf150d77707310900c0b05023df07cdfaeffb4d"
Jul 28 08:37:33.333890 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:33.333852    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" path="/var/lib/kubelet/pods/11596dd6-119a-44f7-9e0d-10adb516a8df/volumes"
Jul 28 08:37:39.960668 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.960625    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-655q5/must-gather-flglw"]
Jul 28 08:37:39.961294 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961097    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="online"
Jul 28 08:37:39.961294 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961116    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="online"
Jul 28 08:37:39.961294 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961135    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="online"
Jul 28 08:37:39.961294 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961144    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="online"
Jul 28 08:37:39.961294 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961156    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="registry"
Jul 28 08:37:39.961294 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961166    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="registry"
Jul 28 08:37:39.961294 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961175    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="ui"
Jul 28 08:37:39.961294 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961183    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="ui"
Jul 28 08:37:39.961294 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961200    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="ui"
Jul 28 08:37:39.961294 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961210    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="ui"
Jul 28 08:37:39.961294 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961224    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="feast-apply"
Jul 28 08:37:39.961294 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961232    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="feast-apply"
Jul 28 08:37:39.961294 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961249    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="offline"
Jul 28 08:37:39.961294 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961257    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="offline"
Jul 28 08:37:39.961294 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961266    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="feast-init"
Jul 28 08:37:39.961294 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961275    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="feast-init"
Jul 28 08:37:39.961294 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961286    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="feast-init"
Jul 28 08:37:39.961294 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961294    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="feast-init"
Jul 28 08:37:39.962222 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961309    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="offline"
Jul 28 08:37:39.962222 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961317    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="offline"
Jul 28 08:37:39.962222 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961325    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="feast-apply"
Jul 28 08:37:39.962222 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961333    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="feast-apply"
Jul 28 08:37:39.962222 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961412    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="ui"
Jul 28 08:37:39.962222 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961422    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="offline"
Jul 28 08:37:39.962222 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961431    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="ui"
Jul 28 08:37:39.962222 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961442    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="online"
Jul 28 08:37:39.962222 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961473    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="registry"
Jul 28 08:37:39.962222 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961482    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2061af47-8b28-456c-b48b-013646fc13b8" containerName="offline"
Jul 28 08:37:39.962222 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.961489    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="11596dd6-119a-44f7-9e0d-10adb516a8df" containerName="online"
Jul 28 08:37:39.966533 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.966508    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-655q5/must-gather-flglw"
Jul 28 08:37:39.968786 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.968764    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-655q5\"/\"openshift-service-ca.crt\""
Jul 28 08:37:39.969667 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.969635    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-655q5\"/\"default-dockercfg-f5t5c\""
Jul 28 08:37:39.969865 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.969670    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-655q5\"/\"kube-root-ca.crt\""
Jul 28 08:37:39.971794 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:39.971774    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-655q5/must-gather-flglw"]
Jul 28 08:37:40.039864 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:40.039820    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvb5z\" (UniqueName: \"kubernetes.io/projected/fbafc8a8-79e2-4da6-af36-56d1fb1dd607-kube-api-access-xvb5z\") pod \"must-gather-flglw\" (UID: \"fbafc8a8-79e2-4da6-af36-56d1fb1dd607\") " pod="openshift-must-gather-655q5/must-gather-flglw"
Jul 28 08:37:40.040028 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:40.039969    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fbafc8a8-79e2-4da6-af36-56d1fb1dd607-must-gather-output\") pod \"must-gather-flglw\" (UID: \"fbafc8a8-79e2-4da6-af36-56d1fb1dd607\") " pod="openshift-must-gather-655q5/must-gather-flglw"
Jul 28 08:37:40.141217 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:40.141169    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fbafc8a8-79e2-4da6-af36-56d1fb1dd607-must-gather-output\") pod \"must-gather-flglw\" (UID: \"fbafc8a8-79e2-4da6-af36-56d1fb1dd607\") " pod="openshift-must-gather-655q5/must-gather-flglw"
Jul 28 08:37:40.141395 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:40.141242    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvb5z\" (UniqueName: \"kubernetes.io/projected/fbafc8a8-79e2-4da6-af36-56d1fb1dd607-kube-api-access-xvb5z\") pod \"must-gather-flglw\" (UID: \"fbafc8a8-79e2-4da6-af36-56d1fb1dd607\") " pod="openshift-must-gather-655q5/must-gather-flglw"
Jul 28 08:37:40.141543 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:40.141521    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fbafc8a8-79e2-4da6-af36-56d1fb1dd607-must-gather-output\") pod \"must-gather-flglw\" (UID: \"fbafc8a8-79e2-4da6-af36-56d1fb1dd607\") " pod="openshift-must-gather-655q5/must-gather-flglw"
Jul 28 08:37:40.149266 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:40.149242    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvb5z\" (UniqueName: \"kubernetes.io/projected/fbafc8a8-79e2-4da6-af36-56d1fb1dd607-kube-api-access-xvb5z\") pod \"must-gather-flglw\" (UID: \"fbafc8a8-79e2-4da6-af36-56d1fb1dd607\") " pod="openshift-must-gather-655q5/must-gather-flglw"
Jul 28 08:37:40.295320 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:40.295228    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-655q5/must-gather-flglw"
Jul 28 08:37:40.431676 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:40.431634    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-655q5/must-gather-flglw"]
Jul 28 08:37:40.435569 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:37:40.435531    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfbafc8a8_79e2_4da6_af36_56d1fb1dd607.slice/crio-30576ebf9a252007800c2ec6e4e5d54294ea005b0f74d743190c352b2297cc97 WatchSource:0}: Error finding container 30576ebf9a252007800c2ec6e4e5d54294ea005b0f74d743190c352b2297cc97: Status 404 returned error can't find the container with id 30576ebf9a252007800c2ec6e4e5d54294ea005b0f74d743190c352b2297cc97
Jul 28 08:37:40.437377 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:40.437358    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 08:37:41.353735 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:41.353691    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-655q5/must-gather-flglw" event={"ID":"fbafc8a8-79e2-4da6-af36-56d1fb1dd607","Type":"ContainerStarted","Data":"30576ebf9a252007800c2ec6e4e5d54294ea005b0f74d743190c352b2297cc97"}
Jul 28 08:37:47.387686 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:47.387626    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-655q5/must-gather-flglw" event={"ID":"fbafc8a8-79e2-4da6-af36-56d1fb1dd607","Type":"ContainerStarted","Data":"edb68a56296ed5c4468fc4b0ce13d6a0a9e1c1e23e0e322ef83a077a4f783558"}
Jul 28 08:37:47.388156 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:47.387695    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-655q5/must-gather-flglw" event={"ID":"fbafc8a8-79e2-4da6-af36-56d1fb1dd607","Type":"ContainerStarted","Data":"e135843f933c54e9d71cafdbfccde06196fddf70ae782d7fce90dc377e190303"}
Jul 28 08:37:47.407381 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:47.407332    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-655q5/must-gather-flglw" podStartSLOduration=2.307686139 podStartE2EDuration="8.40731602s" totalImagesPullingTime="6.099629881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 08:37:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:37:47.406496817 +0000 UTC m=+2102.593684948" watchObservedRunningTime="2026-07-28 08:37:47.40731602 +0000 UTC m=+2102.594504149"
Jul 28 08:37:48.669093 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:48.668978    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vgzf4_dcf82623-a4f7-4511-aed0-7248950f1ca1/console-operator/1.log"
Jul 28 08:37:48.687847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:48.670343    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vgzf4_dcf82623-a4f7-4511-aed0-7248950f1ca1/console-operator/1.log"
Jul 28 08:37:48.687847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:48.677083    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-acl-logging/0.log"
Jul 28 08:37:48.687847 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:48.678422    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-acl-logging/0.log"
Jul 28 08:37:57.433333 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:57.433303    2583 generic.go:356] "Generic (PLEG): container finished" podID="fbafc8a8-79e2-4da6-af36-56d1fb1dd607" containerID="e135843f933c54e9d71cafdbfccde06196fddf70ae782d7fce90dc377e190303" exitCode=0
Jul 28 08:37:57.433837 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:57.433387    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-655q5/must-gather-flglw" event={"ID":"fbafc8a8-79e2-4da6-af36-56d1fb1dd607","Type":"ContainerDied","Data":"e135843f933c54e9d71cafdbfccde06196fddf70ae782d7fce90dc377e190303"}
Jul 28 08:37:57.433837 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:57.433751    2583 scope.go:117] "RemoveContainer" containerID="e135843f933c54e9d71cafdbfccde06196fddf70ae782d7fce90dc377e190303"
Jul 28 08:37:57.470081 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:37:57.470049    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-655q5_must-gather-flglw_fbafc8a8-79e2-4da6-af36-56d1fb1dd607/gather/0.log"
Jul 28 08:38:00.662975 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:00.662946    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-84jc8_4ddcaf19-3fc1-4058-a75d-1f584909d4e4/global-pull-secret-syncer/0.log"
Jul 28 08:38:00.862950 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:00.862918    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rcmfm_157f719d-c569-403c-94e0-f34ee3f68ac8/konnectivity-agent/0.log"
Jul 28 08:38:00.910874 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:00.910840    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-46.ec2.internal_a65f886f3c4206dc5fdaf20b8d13828e/haproxy/0.log"
Jul 28 08:38:02.776593 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:02.776552    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-655q5/must-gather-flglw"]
Jul 28 08:38:02.777003 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:02.776765    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-655q5/must-gather-flglw" podUID="fbafc8a8-79e2-4da6-af36-56d1fb1dd607" containerName="copy" containerID="cri-o://edb68a56296ed5c4468fc4b0ce13d6a0a9e1c1e23e0e322ef83a077a4f783558" gracePeriod=2
Jul 28 08:38:02.781420 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:02.781382    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-655q5/must-gather-flglw"]
Jul 28 08:38:03.009945 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:03.009920    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-655q5_must-gather-flglw_fbafc8a8-79e2-4da6-af36-56d1fb1dd607/copy/0.log"
Jul 28 08:38:03.011582 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:03.011563    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-655q5/must-gather-flglw"
Jul 28 08:38:03.013503 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:38:03.013479    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-flglw\" is forbidden: User \"system:node:ip-10-0-130-46.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-655q5\": no relationship found between node 'ip-10-0-130-46.ec2.internal' and this object" podUID="fbafc8a8-79e2-4da6-af36-56d1fb1dd607" pod="openshift-must-gather-655q5/must-gather-flglw"
Jul 28 08:38:03.145797 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:03.145749    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvb5z\" (UniqueName: \"kubernetes.io/projected/fbafc8a8-79e2-4da6-af36-56d1fb1dd607-kube-api-access-xvb5z\") pod \"fbafc8a8-79e2-4da6-af36-56d1fb1dd607\" (UID: \"fbafc8a8-79e2-4da6-af36-56d1fb1dd607\") "
Jul 28 08:38:03.145797 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:03.145808    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fbafc8a8-79e2-4da6-af36-56d1fb1dd607-must-gather-output\") pod \"fbafc8a8-79e2-4da6-af36-56d1fb1dd607\" (UID: \"fbafc8a8-79e2-4da6-af36-56d1fb1dd607\") "
Jul 28 08:38:03.146232 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:03.146202    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbafc8a8-79e2-4da6-af36-56d1fb1dd607-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "fbafc8a8-79e2-4da6-af36-56d1fb1dd607" (UID: "fbafc8a8-79e2-4da6-af36-56d1fb1dd607"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 08:38:03.148196 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:03.148174    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbafc8a8-79e2-4da6-af36-56d1fb1dd607-kube-api-access-xvb5z" (OuterVolumeSpecName: "kube-api-access-xvb5z") pod "fbafc8a8-79e2-4da6-af36-56d1fb1dd607" (UID: "fbafc8a8-79e2-4da6-af36-56d1fb1dd607"). InnerVolumeSpecName "kube-api-access-xvb5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 08:38:03.246598 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:03.246562    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvb5z\" (UniqueName: \"kubernetes.io/projected/fbafc8a8-79e2-4da6-af36-56d1fb1dd607-kube-api-access-xvb5z\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:38:03.246598 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:03.246590    2583 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fbafc8a8-79e2-4da6-af36-56d1fb1dd607-must-gather-output\") on node \"ip-10-0-130-46.ec2.internal\" DevicePath \"\""
Jul 28 08:38:03.334696 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:03.334662    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbafc8a8-79e2-4da6-af36-56d1fb1dd607" path="/var/lib/kubelet/pods/fbafc8a8-79e2-4da6-af36-56d1fb1dd607/volumes"
Jul 28 08:38:03.459474 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:03.459381    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-655q5_must-gather-flglw_fbafc8a8-79e2-4da6-af36-56d1fb1dd607/copy/0.log"
Jul 28 08:38:03.459809 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:03.459782    2583 generic.go:356] "Generic (PLEG): container finished" podID="fbafc8a8-79e2-4da6-af36-56d1fb1dd607" containerID="edb68a56296ed5c4468fc4b0ce13d6a0a9e1c1e23e0e322ef83a077a4f783558" exitCode=143
Jul 28 08:38:03.459898 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:03.459839    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-655q5/must-gather-flglw"
Jul 28 08:38:03.459898 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:03.459852    2583 scope.go:117] "RemoveContainer" containerID="edb68a56296ed5c4468fc4b0ce13d6a0a9e1c1e23e0e322ef83a077a4f783558"
Jul 28 08:38:03.467867 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:03.467847    2583 scope.go:117] "RemoveContainer" containerID="e135843f933c54e9d71cafdbfccde06196fddf70ae782d7fce90dc377e190303"
Jul 28 08:38:03.480121 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:03.480102    2583 scope.go:117] "RemoveContainer" containerID="edb68a56296ed5c4468fc4b0ce13d6a0a9e1c1e23e0e322ef83a077a4f783558"
Jul 28 08:38:03.480377 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:38:03.480356    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edb68a56296ed5c4468fc4b0ce13d6a0a9e1c1e23e0e322ef83a077a4f783558\": container with ID starting with edb68a56296ed5c4468fc4b0ce13d6a0a9e1c1e23e0e322ef83a077a4f783558 not found: ID does not exist" containerID="edb68a56296ed5c4468fc4b0ce13d6a0a9e1c1e23e0e322ef83a077a4f783558"
Jul 28 08:38:03.480433 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:03.480393    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edb68a56296ed5c4468fc4b0ce13d6a0a9e1c1e23e0e322ef83a077a4f783558"} err="failed to get container status \"edb68a56296ed5c4468fc4b0ce13d6a0a9e1c1e23e0e322ef83a077a4f783558\": rpc error: code = NotFound desc = could not find container \"edb68a56296ed5c4468fc4b0ce13d6a0a9e1c1e23e0e322ef83a077a4f783558\": container with ID starting with edb68a56296ed5c4468fc4b0ce13d6a0a9e1c1e23e0e322ef83a077a4f783558 not found: ID does not exist"
Jul 28 08:38:03.480433 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:03.480411    2583 scope.go:117] "RemoveContainer" containerID="e135843f933c54e9d71cafdbfccde06196fddf70ae782d7fce90dc377e190303"
Jul 28 08:38:03.480687 ip-10-0-130-46 kubenswrapper[2583]: E0728 08:38:03.480669    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e135843f933c54e9d71cafdbfccde06196fddf70ae782d7fce90dc377e190303\": container with ID starting with e135843f933c54e9d71cafdbfccde06196fddf70ae782d7fce90dc377e190303 not found: ID does not exist" containerID="e135843f933c54e9d71cafdbfccde06196fddf70ae782d7fce90dc377e190303"
Jul 28 08:38:03.480744 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:03.480693    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e135843f933c54e9d71cafdbfccde06196fddf70ae782d7fce90dc377e190303"} err="failed to get container status \"e135843f933c54e9d71cafdbfccde06196fddf70ae782d7fce90dc377e190303\": rpc error: code = NotFound desc = could not find container \"e135843f933c54e9d71cafdbfccde06196fddf70ae782d7fce90dc377e190303\": container with ID starting with e135843f933c54e9d71cafdbfccde06196fddf70ae782d7fce90dc377e190303 not found: ID does not exist"
Jul 28 08:38:04.817918 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:04.817888    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80/alertmanager/0.log"
Jul 28 08:38:04.852479 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:04.852395    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80/config-reloader/0.log"
Jul 28 08:38:04.886330 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:04.886294    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80/kube-rbac-proxy-web/0.log"
Jul 28 08:38:04.914166 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:04.914137    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80/kube-rbac-proxy/0.log"
Jul 28 08:38:04.940753 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:04.940723    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80/kube-rbac-proxy-metric/0.log"
Jul 28 08:38:04.964937 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:04.964909    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80/prom-label-proxy/0.log"
Jul 28 08:38:04.988426 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:04.988399    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a26cd9a8-ab79-4c92-9dd1-5c8ae9b52d80/init-config-reloader/0.log"
Jul 28 08:38:05.191022 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:05.190991    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f9fh8_a979677e-ccd2-4a6a-8f73-33de147b511c/node-exporter/0.log"
Jul 28 08:38:05.216176 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:05.216150    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f9fh8_a979677e-ccd2-4a6a-8f73-33de147b511c/kube-rbac-proxy/0.log"
Jul 28 08:38:05.240101 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:05.240082    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f9fh8_a979677e-ccd2-4a6a-8f73-33de147b511c/init-textfile/0.log"
Jul 28 08:38:05.422982 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:05.422953    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-wjmzj_6aacc162-bab5-4d4f-92e8-22812cef76ea/kube-rbac-proxy-main/0.log"
Jul 28 08:38:05.448507 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:05.448420    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-wjmzj_6aacc162-bab5-4d4f-92e8-22812cef76ea/kube-rbac-proxy-self/0.log"
Jul 28 08:38:05.469111 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:05.469084    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-wjmzj_6aacc162-bab5-4d4f-92e8-22812cef76ea/openshift-state-metrics/0.log"
Jul 28 08:38:05.735709 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:05.735628    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-558jm_46c32b4c-c005-4fb0-a091-91c6c33890fd/prometheus-operator-admission-webhook/0.log"
Jul 28 08:38:05.768661 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:05.768636    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5954485cc9-pkqg4_65913f8d-87a4-44ef-8736-34ff2880adff/telemeter-client/0.log"
Jul 28 08:38:05.797234 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:05.797212    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5954485cc9-pkqg4_65913f8d-87a4-44ef-8736-34ff2880adff/reload/0.log"
Jul 28 08:38:05.823574 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:05.823536    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5954485cc9-pkqg4_65913f8d-87a4-44ef-8736-34ff2880adff/kube-rbac-proxy/0.log"
Jul 28 08:38:05.859713 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:05.859682    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-fbd8798f5-qcd29_0495e4fd-9ea1-4182-b9e2-77594860160c/thanos-query/0.log"
Jul 28 08:38:05.888620 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:05.888592    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-fbd8798f5-qcd29_0495e4fd-9ea1-4182-b9e2-77594860160c/kube-rbac-proxy-web/0.log"
Jul 28 08:38:05.924744 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:05.924711    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-fbd8798f5-qcd29_0495e4fd-9ea1-4182-b9e2-77594860160c/kube-rbac-proxy/0.log"
Jul 28 08:38:05.962319 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:05.962297    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-fbd8798f5-qcd29_0495e4fd-9ea1-4182-b9e2-77594860160c/prom-label-proxy/0.log"
Jul 28 08:38:05.997634 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:05.997566    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-fbd8798f5-qcd29_0495e4fd-9ea1-4182-b9e2-77594860160c/kube-rbac-proxy-rules/0.log"
Jul 28 08:38:06.030000 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:06.029972    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-fbd8798f5-qcd29_0495e4fd-9ea1-4182-b9e2-77594860160c/kube-rbac-proxy-metrics/0.log"
Jul 28 08:38:07.295581 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:07.295550    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-5wjpt_539630ec-45ae-4b70-bbce-d390e08afecd/networking-console-plugin/0.log"
Jul 28 08:38:07.744602 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:07.744571    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vgzf4_dcf82623-a4f7-4511-aed0-7248950f1ca1/console-operator/1.log"
Jul 28 08:38:07.749488 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:07.749442    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vgzf4_dcf82623-a4f7-4511-aed0-7248950f1ca1/console-operator/2.log"
Jul 28 08:38:08.170031 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.170003    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-g9x5p_39fd1727-9f68-4b65-b66a-0576025b6564/download-server/0.log"
Jul 28 08:38:08.512503 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.512419    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"]
Jul 28 08:38:08.512863 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.512782    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbafc8a8-79e2-4da6-af36-56d1fb1dd607" containerName="gather"
Jul 28 08:38:08.512863 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.512794    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbafc8a8-79e2-4da6-af36-56d1fb1dd607" containerName="gather"
Jul 28 08:38:08.512863 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.512809    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbafc8a8-79e2-4da6-af36-56d1fb1dd607" containerName="copy"
Jul 28 08:38:08.512863 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.512815    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbafc8a8-79e2-4da6-af36-56d1fb1dd607" containerName="copy"
Jul 28 08:38:08.513007 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.512886    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbafc8a8-79e2-4da6-af36-56d1fb1dd607" containerName="copy"
Jul 28 08:38:08.513007 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.512897    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbafc8a8-79e2-4da6-af36-56d1fb1dd607" containerName="gather"
Jul 28 08:38:08.516289 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.516271    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"
Jul 28 08:38:08.519287 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.519259    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jsmg8\"/\"kube-root-ca.crt\""
Jul 28 08:38:08.519395 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.519312    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jsmg8\"/\"openshift-service-ca.crt\""
Jul 28 08:38:08.520545 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.520531    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jsmg8\"/\"default-dockercfg-wjpgz\""
Jul 28 08:38:08.526707 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.526682    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"]
Jul 28 08:38:08.695522 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.695488    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqkxf\" (UniqueName: \"kubernetes.io/projected/e03e837e-d5c5-45e0-86b8-724e4346831e-kube-api-access-dqkxf\") pod \"perf-node-gather-daemonset-vp5cf\" (UID: \"e03e837e-d5c5-45e0-86b8-724e4346831e\") " pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"
Jul 28 08:38:08.695699 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.695544    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e03e837e-d5c5-45e0-86b8-724e4346831e-podres\") pod \"perf-node-gather-daemonset-vp5cf\" (UID: \"e03e837e-d5c5-45e0-86b8-724e4346831e\") " pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"
Jul 28 08:38:08.695699 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.695603    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e03e837e-d5c5-45e0-86b8-724e4346831e-proc\") pod \"perf-node-gather-daemonset-vp5cf\" (UID: \"e03e837e-d5c5-45e0-86b8-724e4346831e\") " pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"
Jul 28 08:38:08.695699 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.695683    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e03e837e-d5c5-45e0-86b8-724e4346831e-lib-modules\") pod \"perf-node-gather-daemonset-vp5cf\" (UID: \"e03e837e-d5c5-45e0-86b8-724e4346831e\") " pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"
Jul 28 08:38:08.695828 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.695713    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e03e837e-d5c5-45e0-86b8-724e4346831e-sys\") pod \"perf-node-gather-daemonset-vp5cf\" (UID: \"e03e837e-d5c5-45e0-86b8-724e4346831e\") " pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"
Jul 28 08:38:08.698225 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.698204    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-hlrq7_2c3b6449-e276-4abf-ac2f-fb97f667dd4e/volume-data-source-validator/0.log"
Jul 28 08:38:08.796576 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.796488    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e03e837e-d5c5-45e0-86b8-724e4346831e-sys\") pod \"perf-node-gather-daemonset-vp5cf\" (UID: \"e03e837e-d5c5-45e0-86b8-724e4346831e\") " pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"
Jul 28 08:38:08.796576 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.796539    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqkxf\" (UniqueName: \"kubernetes.io/projected/e03e837e-d5c5-45e0-86b8-724e4346831e-kube-api-access-dqkxf\") pod \"perf-node-gather-daemonset-vp5cf\" (UID: \"e03e837e-d5c5-45e0-86b8-724e4346831e\") " pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"
Jul 28 08:38:08.796576 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.796579    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e03e837e-d5c5-45e0-86b8-724e4346831e-podres\") pod \"perf-node-gather-daemonset-vp5cf\" (UID: \"e03e837e-d5c5-45e0-86b8-724e4346831e\") " pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"
Jul 28 08:38:08.796827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.796600    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e03e837e-d5c5-45e0-86b8-724e4346831e-proc\") pod \"perf-node-gather-daemonset-vp5cf\" (UID: \"e03e837e-d5c5-45e0-86b8-724e4346831e\") " pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"
Jul 28 08:38:08.796827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.796617    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e03e837e-d5c5-45e0-86b8-724e4346831e-sys\") pod \"perf-node-gather-daemonset-vp5cf\" (UID: \"e03e837e-d5c5-45e0-86b8-724e4346831e\") " pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"
Jul 28 08:38:08.796827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.796723    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e03e837e-d5c5-45e0-86b8-724e4346831e-podres\") pod \"perf-node-gather-daemonset-vp5cf\" (UID: \"e03e837e-d5c5-45e0-86b8-724e4346831e\") " pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"
Jul 28 08:38:08.796827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.796727    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e03e837e-d5c5-45e0-86b8-724e4346831e-lib-modules\") pod \"perf-node-gather-daemonset-vp5cf\" (UID: \"e03e837e-d5c5-45e0-86b8-724e4346831e\") " pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"
Jul 28 08:38:08.796827 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.796765    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e03e837e-d5c5-45e0-86b8-724e4346831e-proc\") pod \"perf-node-gather-daemonset-vp5cf\" (UID: \"e03e837e-d5c5-45e0-86b8-724e4346831e\") " pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"
Jul 28 08:38:08.797021 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.796869    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e03e837e-d5c5-45e0-86b8-724e4346831e-lib-modules\") pod \"perf-node-gather-daemonset-vp5cf\" (UID: \"e03e837e-d5c5-45e0-86b8-724e4346831e\") " pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"
Jul 28 08:38:08.805466 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.805422    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqkxf\" (UniqueName: \"kubernetes.io/projected/e03e837e-d5c5-45e0-86b8-724e4346831e-kube-api-access-dqkxf\") pod \"perf-node-gather-daemonset-vp5cf\" (UID: \"e03e837e-d5c5-45e0-86b8-724e4346831e\") " pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"
Jul 28 08:38:08.827309 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.827269    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"
Jul 28 08:38:08.961350 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:08.961315    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"]
Jul 28 08:38:08.965252 ip-10-0-130-46 kubenswrapper[2583]: W0728 08:38:08.965219    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode03e837e_d5c5_45e0_86b8_724e4346831e.slice/crio-893f24fbe6e54a846e967d61b9c359a1b58ce0b153679cda737fa28b02a4e665 WatchSource:0}: Error finding container 893f24fbe6e54a846e967d61b9c359a1b58ce0b153679cda737fa28b02a4e665: Status 404 returned error can't find the container with id 893f24fbe6e54a846e967d61b9c359a1b58ce0b153679cda737fa28b02a4e665
Jul 28 08:38:09.486525 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:09.486495    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bffhp_f9498a46-5dad-42a4-908a-eadc84f02430/dns/0.log"
Jul 28 08:38:09.487058 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:09.487034    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf" event={"ID":"e03e837e-d5c5-45e0-86b8-724e4346831e","Type":"ContainerStarted","Data":"5845842f655c68a123b2ebec959d536aeecdc73dfed9ea383bef63dd56c15a98"}
Jul 28 08:38:09.487122 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:09.487086    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf" event={"ID":"e03e837e-d5c5-45e0-86b8-724e4346831e","Type":"ContainerStarted","Data":"893f24fbe6e54a846e967d61b9c359a1b58ce0b153679cda737fa28b02a4e665"}
Jul 28 08:38:09.487173 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:09.487148    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"
Jul 28 08:38:09.502558 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:09.502513    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf" podStartSLOduration=1.502499717 podStartE2EDuration="1.502499717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 08:38:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 08:38:09.501142903 +0000 UTC m=+2124.688331035" watchObservedRunningTime="2026-07-28 08:38:09.502499717 +0000 UTC m=+2124.689687874"
Jul 28 08:38:09.507719 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:09.507702    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bffhp_f9498a46-5dad-42a4-908a-eadc84f02430/kube-rbac-proxy/0.log"
Jul 28 08:38:09.620304 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:09.620274    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-22gll_42846769-0c19-40cb-936c-0c8f3d7db4c5/dns-node-resolver/0.log"
Jul 28 08:38:10.156313 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:10.156282    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z7hg4_2fdc640c-ac36-407b-8fe0-d497c4cc05c2/node-ca/0.log"
Jul 28 08:38:10.828540 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:10.828510    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-667869f59f-tbzsl_4108bb49-e103-4124-8453-90f648061d8f/router/0.log"
Jul 28 08:38:11.167942 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:11.167914    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jvr4z_b88d5c13-e028-44d4-9844-fdc5359b9852/serve-healthcheck-canary/0.log"
Jul 28 08:38:11.534627 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:11.534547    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-747k4_2e3105ee-0942-48f2-b7bf-751b948a1189/kube-rbac-proxy/0.log"
Jul 28 08:38:11.554834 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:11.554805    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-747k4_2e3105ee-0942-48f2-b7bf-751b948a1189/exporter/0.log"
Jul 28 08:38:11.574014 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:11.573985    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-747k4_2e3105ee-0942-48f2-b7bf-751b948a1189/extractor/0.log"
Jul 28 08:38:15.502034 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:15.502006    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jsmg8/perf-node-gather-daemonset-vp5cf"
Jul 28 08:38:15.837953 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:15.837871    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-d5sw9_14f21adb-dc0c-449f-adf2-cb73d60156ac/migrator/0.log"
Jul 28 08:38:15.858366 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:15.858334    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-d5sw9_14f21adb-dc0c-449f-adf2-cb73d60156ac/graceful-termination/0.log"
Jul 28 08:38:17.012275 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:17.012233    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7r5vh_b8b607d7-a050-4231-a779-045d369abaf1/kube-multus/0.log"
Jul 28 08:38:17.209324 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:17.209292    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bncs5_a5585cee-7829-4764-8f3e-387217b86dbe/kube-multus-additional-cni-plugins/0.log"
Jul 28 08:38:17.250150 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:17.250123    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bncs5_a5585cee-7829-4764-8f3e-387217b86dbe/egress-router-binary-copy/0.log"
Jul 28 08:38:17.299157 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:17.299133    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bncs5_a5585cee-7829-4764-8f3e-387217b86dbe/cni-plugins/0.log"
Jul 28 08:38:17.321307 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:17.321280    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bncs5_a5585cee-7829-4764-8f3e-387217b86dbe/bond-cni-plugin/0.log"
Jul 28 08:38:17.342463 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:17.342424    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bncs5_a5585cee-7829-4764-8f3e-387217b86dbe/routeoverride-cni/0.log"
Jul 28 08:38:17.363307 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:17.363271    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bncs5_a5585cee-7829-4764-8f3e-387217b86dbe/whereabouts-cni-bincopy/0.log"
Jul 28 08:38:17.384247 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:17.384217    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bncs5_a5585cee-7829-4764-8f3e-387217b86dbe/whereabouts-cni/0.log"
Jul 28 08:38:17.711650 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:17.711624    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xphvp_eb7a2f95-8714-4283-8dcf-66f1fb75b4e4/network-metrics-daemon/0.log"
Jul 28 08:38:17.732748 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:17.732721    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xphvp_eb7a2f95-8714-4283-8dcf-66f1fb75b4e4/kube-rbac-proxy/0.log"
Jul 28 08:38:18.604429 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:18.604396    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-controller/0.log"
Jul 28 08:38:18.622719 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:18.622694    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-acl-logging/1.log"
Jul 28 08:38:18.622719 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:18.622717    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovn-acl-logging/0.log"
Jul 28 08:38:18.643936 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:18.643909    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/kube-rbac-proxy-node/0.log"
Jul 28 08:38:18.664216 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:18.664191    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/kube-rbac-proxy-ovn-metrics/0.log"
Jul 28 08:38:18.682522 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:18.682493    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/northd/0.log"
Jul 28 08:38:18.703029 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:18.702999    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/nbdb/0.log"
Jul 28 08:38:18.722789 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:18.722764    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/sbdb/0.log"
Jul 28 08:38:18.762746 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:18.762710    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6jpqb_e7b9b888-e51a-48c1-9ae4-f31a703c4521/ovnkube-controller/0.log"
Jul 28 08:38:20.229174 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:20.229095    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-jd9ts_6ffd4d79-2e8e-42e6-86a3-8bfba1c35d63/network-check-target-container/0.log"
Jul 28 08:38:21.173605 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:21.173579    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-wvtsz_2bbdbee2-0b11-417e-8a75-f52affa81a4a/iptables-alerter/0.log"
Jul 28 08:38:21.813177 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:21.813143    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-lhcb7_e1bc071b-1927-435b-bea2-1b1d5265c8ae/tuned/0.log"
Jul 28 08:38:23.497869 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:23.497833    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-9llkf_82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9/cluster-samples-operator/0.log"
Jul 28 08:38:23.514082 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:23.514059    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-9llkf_82a717f0-b5fe-40f3-8ecb-92d1c8b7c2e9/cluster-samples-operator-watch/0.log"
Jul 28 08:38:24.492628 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:24.492600    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5d6c75f84f-k9tqt_a460ccbd-d2f1-4f6f-ab12-5306cec5d28d/service-ca-operator/1.log"
Jul 28 08:38:24.493608 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:24.493586    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5d6c75f84f-k9tqt_a460ccbd-d2f1-4f6f-ab12-5306cec5d28d/service-ca-operator/0.log"
Jul 28 08:38:25.231699 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:25.231672    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-sv86v_01ab6444-91e8-4b3b-b942-b81755e6574b/csi-driver/0.log"
Jul 28 08:38:25.253946 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:25.253924    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-sv86v_01ab6444-91e8-4b3b-b942-b81755e6574b/csi-node-driver-registrar/0.log"
Jul 28 08:38:25.274222 ip-10-0-130-46 kubenswrapper[2583]: I0728 08:38:25.274198    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-sv86v_01ab6444-91e8-4b3b-b942-b81755e6574b/csi-liveness-probe/0.log"