Sep 07 13:55:55.063956 ip-10-0-139-134 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 07 13:55:55.063974 ip-10-0-139-134 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 07 13:55:55.063983 ip-10-0-139-134 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 07 13:55:55.064319 ip-10-0-139-134 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 07 13:56:05.099177 ip-10-0-139-134 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 07 13:56:05.099191 ip-10-0-139-134 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 9018a170420448369cccbd98f1d05f98 --
Sep 07 13:57:37.335301 ip-10-0-139-134 systemd[1]: Starting Kubernetes Kubelet...
Sep 07 13:57:37.756295 ip-10-0-139-134 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 13:57:37.756295 ip-10-0-139-134 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 07 13:57:37.756295 ip-10-0-139-134 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 13:57:37.756295 ip-10-0-139-134 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 07 13:57:37.756295 ip-10-0-139-134 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 13:57:37.756927 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.756300    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 07 13:57:37.760595 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760579    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 13:57:37.760595 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760594    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 13:57:37.760667 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760598    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 13:57:37.760667 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760601    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 13:57:37.760667 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760604    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 13:57:37.760667 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760607    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 13:57:37.760667 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760610    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 13:57:37.760667 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760612    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 13:57:37.760667 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760615    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 13:57:37.760667 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760618    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 13:57:37.760667 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760623    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 13:57:37.760667 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760627    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 13:57:37.760667 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760630    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 13:57:37.760667 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760633    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 13:57:37.760667 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760636    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 13:57:37.760667 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760639    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 13:57:37.760667 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760642    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 13:57:37.760667 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760645    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 13:57:37.760667 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760648    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 13:57:37.760667 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760650    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 13:57:37.760667 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760653    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 13:57:37.761141 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760656    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 13:57:37.761141 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760660    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 13:57:37.761141 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760664    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 13:57:37.761141 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760666    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 13:57:37.761141 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760669    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 13:57:37.761141 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760679    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 13:57:37.761141 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760682    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 13:57:37.761141 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760687    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 13:57:37.761141 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760690    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 13:57:37.761141 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760693    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 13:57:37.761141 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760695    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 13:57:37.761141 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760698    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 13:57:37.761141 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760700    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 13:57:37.761141 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760703    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 13:57:37.761141 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760705    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 13:57:37.761141 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760708    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 13:57:37.761141 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760711    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 13:57:37.761141 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760713    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 13:57:37.761141 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760716    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 13:57:37.761141 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760719    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 13:57:37.761663 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760721    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 13:57:37.761663 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760724    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 13:57:37.761663 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760726    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 13:57:37.761663 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760729    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 13:57:37.761663 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760731    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 13:57:37.761663 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760734    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 13:57:37.761663 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760736    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 13:57:37.761663 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760739    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 13:57:37.761663 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760741    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 13:57:37.761663 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760744    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 13:57:37.761663 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760746    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 13:57:37.761663 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760749    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 13:57:37.761663 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760751    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 13:57:37.761663 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760755    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 13:57:37.761663 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760758    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 13:57:37.761663 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760760    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 13:57:37.761663 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760763    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 13:57:37.761663 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760766    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 13:57:37.761663 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760768    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 13:57:37.761663 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760771    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 13:57:37.762162 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760773    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 13:57:37.762162 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760776    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 13:57:37.762162 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760778    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 13:57:37.762162 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760781    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 13:57:37.762162 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760783    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 13:57:37.762162 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760786    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 13:57:37.762162 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760788    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 13:57:37.762162 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760791    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 13:57:37.762162 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760793    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 13:57:37.762162 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760796    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 13:57:37.762162 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760798    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 13:57:37.762162 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760800    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 13:57:37.762162 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760803    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 13:57:37.762162 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760805    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 13:57:37.762162 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760809    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 13:57:37.762162 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760813    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 13:57:37.762162 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760817    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 13:57:37.762162 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760819    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 13:57:37.762162 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760822    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 13:57:37.762618 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760824    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 13:57:37.762618 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760827    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 13:57:37.762618 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760829    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 13:57:37.762618 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760832    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 13:57:37.762618 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760834    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 13:57:37.762618 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760837    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 13:57:37.762618 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760841    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 13:57:37.762618 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760844    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 13:57:37.762618 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760847    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 13:57:37.762618 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760850    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 13:57:37.762618 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760852    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 13:57:37.762618 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760855    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 13:57:37.762618 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760858    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 13:57:37.762618 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760860    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 13:57:37.762618 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760863    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 13:57:37.762618 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760865    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 13:57:37.762618 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760869    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 13:57:37.762618 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760871    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 13:57:37.762618 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.760874    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 13:57:37.764152 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764138    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 13:57:37.764152 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764150    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 13:57:37.764210 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764154    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 13:57:37.764210 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764158    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 13:57:37.764210 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764161    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 13:57:37.764210 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764163    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 13:57:37.764210 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764166    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 13:57:37.764210 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764169    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 13:57:37.764210 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764171    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 13:57:37.764210 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764178    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 13:57:37.764210 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764181    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 13:57:37.764210 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764184    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 13:57:37.764210 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764186    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 13:57:37.764210 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764189    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 13:57:37.764210 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764191    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 13:57:37.764210 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764196    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 13:57:37.764210 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764199    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 13:57:37.764210 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764202    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 13:57:37.764210 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764205    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 13:57:37.764210 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764208    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 13:57:37.764210 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764211    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 13:57:37.764687 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764214    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 13:57:37.764687 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764217    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 13:57:37.764687 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764220    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 13:57:37.764687 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764223    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 13:57:37.764687 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764225    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 13:57:37.764687 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764228    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 13:57:37.764687 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764231    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 13:57:37.764687 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764233    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 13:57:37.764687 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764236    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 13:57:37.764687 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764238    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 13:57:37.764687 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764241    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 13:57:37.764687 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764243    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 13:57:37.764687 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764246    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 13:57:37.764687 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764248    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 13:57:37.764687 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764251    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 13:57:37.764687 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764253    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 13:57:37.764687 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764256    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 13:57:37.764687 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764258    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 13:57:37.764687 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764261    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 13:57:37.764687 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764263    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 13:57:37.765197 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764266    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 13:57:37.765197 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764269    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 13:57:37.765197 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764272    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 13:57:37.765197 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764275    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 13:57:37.765197 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764277    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 13:57:37.765197 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764279    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 13:57:37.765197 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764282    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 13:57:37.765197 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764284    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 13:57:37.765197 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764287    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 13:57:37.765197 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764289    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 13:57:37.765197 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764292    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 13:57:37.765197 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764294    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 13:57:37.765197 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764297    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 13:57:37.765197 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764300    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 13:57:37.765197 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764303    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 13:57:37.765197 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764307    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 13:57:37.765197 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764311    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 13:57:37.765197 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764313    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 13:57:37.765197 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764316    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 13:57:37.765197 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764319    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 13:57:37.765696 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764321    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 13:57:37.765696 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764324    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 13:57:37.765696 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764327    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 13:57:37.765696 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764329    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 13:57:37.765696 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764332    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 13:57:37.765696 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764334    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 13:57:37.765696 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764338    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 13:57:37.765696 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764341    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 13:57:37.765696 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764344    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 13:57:37.765696 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764347    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 13:57:37.765696 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764350    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 13:57:37.765696 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764352    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 13:57:37.765696 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764355    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 13:57:37.765696 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764357    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 13:57:37.765696 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764361    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 13:57:37.765696 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764363    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 13:57:37.765696 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764367    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 13:57:37.765696 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764369    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 13:57:37.765696 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764372    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 13:57:37.765696 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764374    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 13:57:37.766198 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764377    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 13:57:37.766198 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764379    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 13:57:37.766198 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764382    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 13:57:37.766198 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764384    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 13:57:37.766198 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764387    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 13:57:37.766198 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764390    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 13:57:37.766198 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764393    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 13:57:37.766198 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764396    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 13:57:37.766198 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764398    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 13:57:37.766198 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764401    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 13:57:37.766198 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764404    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 13:57:37.766198 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764406    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 13:57:37.766198 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764409    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 13:57:37.766198 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764411    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 13:57:37.766198 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764413    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 13:57:37.766198 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764416    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 13:57:37.766198 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764418    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 13:57:37.766198 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764421    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 13:57:37.766198 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764800    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 13:57:37.766198 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764804    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 13:57:37.766707 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764807    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 13:57:37.766707 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764810    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 13:57:37.766707 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764813    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 13:57:37.766707 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764816    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 13:57:37.766707 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764818    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 13:57:37.766707 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764821    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 13:57:37.766707 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764825    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 13:57:37.766707 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764828    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 13:57:37.766707 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764831    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 13:57:37.766707 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764834    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 13:57:37.766707 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764836    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 13:57:37.766707 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764839    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 13:57:37.766707 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764842    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 13:57:37.766707 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764845    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 13:57:37.766707 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764847    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 13:57:37.766707 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764849    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 13:57:37.766707 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764864    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 13:57:37.766707 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764869    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 13:57:37.766707 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764873    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 13:57:37.766707 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764878    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 13:57:37.767217 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764881    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 13:57:37.767217 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764885    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 13:57:37.767217 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764888    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 13:57:37.767217 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764891    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 13:57:37.767217 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764893    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 13:57:37.767217 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764896    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 13:57:37.767217 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764900    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 13:57:37.767217 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764902    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 13:57:37.767217 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764905    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 13:57:37.767217 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764907    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 13:57:37.767217 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764910    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 13:57:37.767217 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764912    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 13:57:37.767217 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764915    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 13:57:37.767217 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764918    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 13:57:37.767217 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764920    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 13:57:37.767217 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764923    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 13:57:37.767217 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764925    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 13:57:37.767217 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764928    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 13:57:37.767217 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764930    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 13:57:37.767217 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764934    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 13:57:37.767701 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764937    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 13:57:37.767701 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764939    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 13:57:37.767701 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764942    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 13:57:37.767701 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764946    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 13:57:37.767701 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764950    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 13:57:37.767701 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764954    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 13:57:37.767701 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764959    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 13:57:37.767701 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764963    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 13:57:37.767701 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764966    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 13:57:37.767701 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764980    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 13:57:37.767701 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764983    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 13:57:37.767701 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764986    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 13:57:37.767701 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764990    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 13:57:37.767701 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764994    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 13:57:37.767701 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.764997    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 13:57:37.767701 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765000    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 13:57:37.767701 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765002    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 13:57:37.767701 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765006    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 13:57:37.767701 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765008    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 13:57:37.768228 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765011    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 13:57:37.768228 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765014    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 13:57:37.768228 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765017    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 13:57:37.768228 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765020    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 13:57:37.768228 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765022    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 13:57:37.768228 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765025    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 13:57:37.768228 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765030    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 13:57:37.768228 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765034    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 13:57:37.768228 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765067    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 13:57:37.768228 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765090    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 13:57:37.768228 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765095    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 13:57:37.768228 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765099    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 13:57:37.768228 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765102    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 13:57:37.768228 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765105    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 13:57:37.768228 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765108    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 13:57:37.768228 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765110    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 13:57:37.768228 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765113    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 13:57:37.768228 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765117    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 13:57:37.768228 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765119    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 13:57:37.768228 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765123    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 13:57:37.768717 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765128    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 13:57:37.768717 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765131    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 13:57:37.768717 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765134    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 13:57:37.768717 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765136    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 13:57:37.768717 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765139    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 13:57:37.768717 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765143    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 13:57:37.768717 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765146    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 13:57:37.768717 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765148    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 13:57:37.768717 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765151    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 13:57:37.768717 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765153    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 13:57:37.768717 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765156    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 13:57:37.768717 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765158    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 13:57:37.768717 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765161    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 13:57:37.768717 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765165    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 13:57:37.768717 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765170    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 13:57:37.768717 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765173    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 13:57:37.768717 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765176    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 13:57:37.768717 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765179    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 13:57:37.768717 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765255    2581 flags.go:64] FLAG: --address="0.0.0.0"
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765293    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765300    2581 flags.go:64] FLAG: --anonymous-auth="true"
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765307    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765311    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765315    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765319    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765323    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765327    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765330    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765333    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765337    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765340    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765343    2581 flags.go:64] FLAG: --cgroup-root=""
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765346    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765349    2581 flags.go:64] FLAG: --client-ca-file=""
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765351    2581 flags.go:64] FLAG: --cloud-provider="external"
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765354    2581 flags.go:64] FLAG: --cluster-dns="[]"
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765359    2581 flags.go:64] FLAG: --cluster-domain=""
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765362    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765365    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765368    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765371    2581 flags.go:64] FLAG: --container-log-max-files="5"
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765375    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 07 13:57:37.769226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765378    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765381    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765385    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765388    2581 flags.go:64] FLAG: --contention-profiling="false"
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765391    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765394    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765397    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765399    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765404    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765407    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765410    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765414    2581 flags.go:64] FLAG: --enable-load-reader="false"
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765418    2581 flags.go:64] FLAG: --enable-server="true"
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765421    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765427    2581 flags.go:64] FLAG: --event-burst="100"
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765430    2581 flags.go:64] FLAG: --event-qps="50"
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765433    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765436    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765439    2581 flags.go:64] FLAG: --eviction-hard=""
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765443    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765446    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765449    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765453    2581 flags.go:64] FLAG: --eviction-soft=""
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765455    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765458    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 07 13:57:37.769811 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765461    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765465    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765468    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765471    2581 flags.go:64] FLAG: --fail-swap-on="true"
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765474    2581 flags.go:64] FLAG: --feature-gates=""
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765478    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765481    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765484    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765487    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765490    2581 flags.go:64] FLAG: --healthz-port="10248"
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765493    2581 flags.go:64] FLAG: --help="false"
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765496    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-139-134.ec2.internal"
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765499    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765502    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765505    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765508    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765512    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765515    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765518    2581 flags.go:64] FLAG: --image-service-endpoint=""
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765521    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765525    2581 flags.go:64] FLAG: --kube-api-burst="100"
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765529    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765532    2581 flags.go:64] FLAG: --kube-api-qps="50"
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765535    2581 flags.go:64] FLAG: --kube-reserved=""
Sep 07 13:57:37.770433 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765537    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765541    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765544    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765547    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765549    2581 flags.go:64] FLAG: --lock-file=""
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765552    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765556    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765558    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765567    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765570    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765575    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765578    2581 flags.go:64] FLAG: --logging-format="text"
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765581    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765584    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765587    2581 flags.go:64] FLAG: --manifest-url=""
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765590    2581 flags.go:64] FLAG: --manifest-url-header=""
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765595    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765598    2581 flags.go:64] FLAG: --max-open-files="1000000"
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765602    2581 flags.go:64] FLAG: --max-pods="110"
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765605    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765608    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765611    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765614    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765617    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765620    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 07 13:57:37.771036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765623    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765631    2581 flags.go:64] FLAG: --node-status-max-images="50"
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765634    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765637    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765641    2581 flags.go:64] FLAG: --pod-cidr=""
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765644    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765649    2581 flags.go:64] FLAG: --pod-manifest-path=""
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765652    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765655    2581 flags.go:64] FLAG: --pods-per-core="0"
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765658    2581 flags.go:64] FLAG: --port="10250"
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765661    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765664    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04651e76565972d19"
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765667    2581 flags.go:64] FLAG: --qos-reserved=""
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765670    2581 flags.go:64] FLAG: --read-only-port="10255"
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765673    2581 flags.go:64] FLAG: --register-node="true"
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765676    2581 flags.go:64] FLAG: --register-with-taints=""
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765680    2581 flags.go:64] FLAG: --registry-burst="10"
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765684    2581 flags.go:64] FLAG: --registry-qps="5"
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765687    2581 flags.go:64] FLAG: --reserved-cpus=""
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765690    2581 flags.go:64] FLAG: --reserved-memory=""
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765693    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765697    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765700    2581 flags.go:64] FLAG: --rotate-certificates="false"
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765703    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765706    2581 flags.go:64] FLAG: --runonce="false"
Sep 07 13:57:37.771657 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765709    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765712    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765715    2581 flags.go:64] FLAG: --seccomp-default="false"
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765718    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765721    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765724    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765727    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765730    2581 flags.go:64] FLAG: --storage-driver-password="root"
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765733    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765738    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765741    2581 flags.go:64] FLAG: --storage-driver-user="root"
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765743    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765747    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765750    2581 flags.go:64] FLAG: --system-cgroups=""
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765753    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765759    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765762    2581 flags.go:64] FLAG: --tls-cert-file=""
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765765    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765769    2581 flags.go:64] FLAG: --tls-min-version=""
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765771    2581 flags.go:64] FLAG: --tls-private-key-file=""
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765774    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765777    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765780    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765783    2581 flags.go:64] FLAG: --v="2"
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765788    2581 flags.go:64] FLAG: --version="false"
Sep 07 13:57:37.772301 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765793    2581 flags.go:64] FLAG: --vmodule=""
Sep 07 13:57:37.772965 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765797    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 07 13:57:37.772965 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.765801    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 07 13:57:37.772965 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765928    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 13:57:37.772965 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765932    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 13:57:37.772965 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765935    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 13:57:37.772965 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765938    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 13:57:37.772965 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765941    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 13:57:37.772965 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765943    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 13:57:37.772965 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765946    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 13:57:37.772965 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765948    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 13:57:37.772965 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765951    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 13:57:37.772965 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765954    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 13:57:37.772965 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765958    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 13:57:37.772965 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765961    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 13:57:37.772965 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765964    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 13:57:37.772965 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765983    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 13:57:37.772965 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765987    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 13:57:37.772965 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765989    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 13:57:37.772965 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765993    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 13:57:37.773462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765996    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 13:57:37.773462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.765999    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 13:57:37.773462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766002    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 13:57:37.773462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766005    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 13:57:37.773462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766008    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 13:57:37.773462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766010    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 13:57:37.773462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766013    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 13:57:37.773462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766016    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 13:57:37.773462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766018    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 13:57:37.773462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766021    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 13:57:37.773462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766023    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 13:57:37.773462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766027    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 13:57:37.773462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766030    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 13:57:37.773462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766032    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 13:57:37.773462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766035    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 13:57:37.773462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766037    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 13:57:37.773462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766040    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 13:57:37.773462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766043    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 13:57:37.773462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766046    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 13:57:37.773462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766049    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 13:57:37.773949 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766051    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 13:57:37.773949 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766053    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 13:57:37.773949 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766056    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 13:57:37.773949 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766059    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 13:57:37.773949 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766061    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 13:57:37.773949 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766064    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 13:57:37.773949 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766067    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 13:57:37.773949 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766069    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 13:57:37.773949 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766073    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 13:57:37.773949 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766076    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 13:57:37.773949 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766078    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 13:57:37.773949 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766081    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 13:57:37.773949 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766084    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 13:57:37.773949 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766087    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 13:57:37.773949 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766089    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 13:57:37.773949 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766092    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 13:57:37.773949 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766094    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 13:57:37.773949 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766097    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 13:57:37.773949 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766099    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 13:57:37.773949 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766102    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 13:57:37.774457 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766104    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 13:57:37.774457 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766107    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 13:57:37.774457 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766110    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 13:57:37.774457 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766114    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 13:57:37.774457 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766117    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 13:57:37.774457 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766120    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 13:57:37.774457 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766122    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 13:57:37.774457 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766126    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 13:57:37.774457 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766130    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 13:57:37.774457 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766133    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 13:57:37.774457 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766136    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 13:57:37.774457 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766138    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 13:57:37.774457 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766141    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 13:57:37.774457 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766143    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 13:57:37.774457 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766146    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 13:57:37.774457 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766148    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 13:57:37.774457 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766151    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 13:57:37.774457 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766153    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 13:57:37.774457 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766156    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 13:57:37.774933 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766158    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 13:57:37.774933 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766162    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 13:57:37.774933 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766165    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 13:57:37.774933 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766167    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 13:57:37.774933 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766170    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 13:57:37.774933 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766172    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 13:57:37.774933 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766177    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 13:57:37.774933 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766181    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 13:57:37.774933 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766184    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 13:57:37.774933 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766187    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 13:57:37.774933 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766190    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 13:57:37.774933 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766192    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 13:57:37.774933 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766195    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 13:57:37.774933 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766197    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 13:57:37.774933 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766200    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 13:57:37.774933 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766203    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 13:57:37.774933 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766206    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 13:57:37.774933 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766209    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 13:57:37.774933 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766212    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 13:57:37.774933 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766214    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 13:57:37.775462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766217    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 13:57:37.775462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766219    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 13:57:37.775462 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.766222    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 13:57:37.775462 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.766227    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 13:57:37.775462 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.773967    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 07 13:57:37.775462 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.773999    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 07 13:57:37.775817 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.775804    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 07 13:57:37.775854 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.775817    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 07 13:57:37.775886 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775878    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 13:57:37.775886 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775884    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 13:57:37.775941 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775887    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 13:57:37.775941 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775891    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 13:57:37.775941 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775893    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 13:57:37.775941 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775898    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 13:57:37.775941 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775903    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 13:57:37.775941 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775907    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 13:57:37.775941 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775910    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 13:57:37.775941 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775914    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 13:57:37.775941 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775916    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 13:57:37.775941 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775919    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 13:57:37.775941 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775922    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 13:57:37.775941 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775925    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 13:57:37.775941 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775928    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 13:57:37.775941 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775931    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 13:57:37.775941 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775933    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 13:57:37.775941 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775936    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 13:57:37.775941 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775939    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 13:57:37.775941 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775941    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 13:57:37.775941 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775944    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 13:57:37.776464 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775947    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 13:57:37.776464 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775950    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 13:57:37.776464 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775953    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 13:57:37.776464 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775956    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 13:57:37.776464 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775959    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 13:57:37.776464 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775961    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 13:57:37.776464 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775964    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 13:57:37.776464 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775966    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 13:57:37.776464 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775985    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 13:57:37.776464 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775991    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 13:57:37.776464 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775995    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 13:57:37.776464 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.775997    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 13:57:37.776464 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776000    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 13:57:37.776464 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776003    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 13:57:37.776464 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776006    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 13:57:37.776464 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776009    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 13:57:37.776464 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776011    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 13:57:37.776464 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776014    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 13:57:37.776464 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776016    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 13:57:37.776916 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776019    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 13:57:37.776916 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776021    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 13:57:37.776916 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776024    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 13:57:37.776916 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776026    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 13:57:37.776916 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776029    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 13:57:37.776916 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776031    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 13:57:37.776916 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776034    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 13:57:37.776916 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776036    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 13:57:37.776916 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776038    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 13:57:37.776916 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776041    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 13:57:37.776916 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776043    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 13:57:37.776916 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776046    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 13:57:37.776916 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776049    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 13:57:37.776916 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776051    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 13:57:37.776916 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776054    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 13:57:37.776916 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776057    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 13:57:37.776916 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776060    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 13:57:37.776916 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776062    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 13:57:37.776916 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776065    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 13:57:37.776916 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776067    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 13:57:37.777496 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776070    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 13:57:37.777496 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776072    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 13:57:37.777496 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776076    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 13:57:37.777496 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776078    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 13:57:37.777496 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776081    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 13:57:37.777496 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776083    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 13:57:37.777496 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776086    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 13:57:37.777496 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776088    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 13:57:37.777496 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776091    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 13:57:37.777496 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776093    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 13:57:37.777496 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776095    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 13:57:37.777496 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776098    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 13:57:37.777496 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776100    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 13:57:37.777496 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776103    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 13:57:37.777496 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776105    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 13:57:37.777496 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776108    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 13:57:37.777496 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776110    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 13:57:37.777496 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776113    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 13:57:37.777496 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776115    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 13:57:37.777496 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776118    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 13:57:37.778000 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776120    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 13:57:37.778000 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776123    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 13:57:37.778000 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776125    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 13:57:37.778000 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776128    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 13:57:37.778000 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776131    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 13:57:37.778000 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776134    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 13:57:37.778000 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776136    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 13:57:37.778000 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776139    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 13:57:37.778000 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776142    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 13:57:37.778000 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776144    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 13:57:37.778000 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776147    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 13:57:37.778000 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776149    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 13:57:37.778000 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776151    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 13:57:37.778000 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776154    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 13:57:37.778000 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776156    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 13:57:37.778000 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776159    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 13:57:37.778000 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776162    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 13:57:37.778000 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776164    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 13:57:37.778000 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776168    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 13:57:37.778466 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.776173    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 13:57:37.778466 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776294    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 13:57:37.778466 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776298    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 13:57:37.778466 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776302    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 13:57:37.778466 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776305    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 13:57:37.778466 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776308    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 13:57:37.778466 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776311    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 13:57:37.778466 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776314    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 13:57:37.778466 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776317    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 13:57:37.778466 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776320    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 13:57:37.778466 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776322    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 13:57:37.778466 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776325    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 13:57:37.778466 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776327    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 13:57:37.778466 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776330    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 13:57:37.778466 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776333    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 13:57:37.778840 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776336    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 13:57:37.778840 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776338    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 13:57:37.778840 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776340    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 13:57:37.778840 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776343    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 13:57:37.778840 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776346    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 13:57:37.778840 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776349    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 13:57:37.778840 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776352    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 13:57:37.778840 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776355    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 13:57:37.778840 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776359    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 13:57:37.778840 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776362    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 13:57:37.778840 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776365    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 13:57:37.778840 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776367    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 13:57:37.778840 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776370    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 13:57:37.778840 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776372    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 13:57:37.778840 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776375    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 13:57:37.778840 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776378    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 13:57:37.778840 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776381    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 13:57:37.778840 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776383    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 13:57:37.778840 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776386    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 13:57:37.779329 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776388    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 13:57:37.779329 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776391    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 13:57:37.779329 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776393    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 13:57:37.779329 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776395    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 13:57:37.779329 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776398    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 13:57:37.779329 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776400    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 13:57:37.779329 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776403    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 13:57:37.779329 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776406    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 13:57:37.779329 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776408    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 13:57:37.779329 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776411    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 13:57:37.779329 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776413    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 13:57:37.779329 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776416    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 13:57:37.779329 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776418    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 13:57:37.779329 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776421    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 13:57:37.779329 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776425    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 13:57:37.779329 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776427    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 13:57:37.779329 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776430    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 13:57:37.779329 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776433    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 13:57:37.779329 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776437    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 13:57:37.779825 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776440    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 13:57:37.779825 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776443    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 13:57:37.779825 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776446    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 13:57:37.779825 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776449    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 13:57:37.779825 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776451    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 13:57:37.779825 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776454    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 13:57:37.779825 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776456    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 13:57:37.779825 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776459    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 13:57:37.779825 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776462    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 13:57:37.779825 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776465    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 13:57:37.779825 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776467    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 13:57:37.779825 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776470    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 13:57:37.779825 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776473    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 13:57:37.779825 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776475    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 13:57:37.779825 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776478    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 13:57:37.779825 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776481    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 13:57:37.779825 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776483    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 13:57:37.779825 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776486    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 13:57:37.779825 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776489    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 13:57:37.780309 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776493    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 13:57:37.780309 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776496    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 13:57:37.780309 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776498    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 13:57:37.780309 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776501    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 13:57:37.780309 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776504    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 13:57:37.780309 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776506    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 13:57:37.780309 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776509    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 13:57:37.780309 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776511    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 13:57:37.780309 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776513    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 13:57:37.780309 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776516    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 13:57:37.780309 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776519    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 13:57:37.780309 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776522    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 13:57:37.780309 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776524    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 13:57:37.780309 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776526    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 13:57:37.780309 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776529    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 13:57:37.780309 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776531    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 13:57:37.780309 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776534    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 13:57:37.780309 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776536    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 13:57:37.780309 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776539    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 13:57:37.780309 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776541    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 13:57:37.780788 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776544    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 13:57:37.780788 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776546    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 13:57:37.780788 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776548    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 13:57:37.780788 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776551    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 13:57:37.780788 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776554    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 13:57:37.780788 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776556    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 13:57:37.780788 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776559    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 13:57:37.780788 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:37.776561    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 13:57:37.780788 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.776566    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 13:57:37.780788 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.776687    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 07 13:57:37.780788 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.779139    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 07 13:57:37.780788 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.780307    2581 server.go:1019] "Starting client certificate rotation"
Sep 07 13:57:37.780788 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.780403    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 13:57:37.780788 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.780467    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 13:57:37.783259 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.783240    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 13:57:37.790751 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.790727    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 13:57:37.802629 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.802601    2581 log.go:25] "Validated CRI v1 runtime API"
Sep 07 13:57:37.806055 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.806033    2581 log.go:25] "Validated CRI v1 image API"
Sep 07 13:57:37.806920 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.806902    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 07 13:57:37.809754 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.809727    2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 99e5e079-6eb2-409c-a413-047412f5f105:/dev/nvme0n1p4 c969d08a-1011-452e-b182-32639e2e2513:/dev/nvme0n1p3]
Sep 07 13:57:37.809844 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.809752    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 07 13:57:37.815418 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.815286    2581 manager.go:216] Machine: {Timestamp:2026-09-07 13:57:37.813807143 +0000 UTC m=+0.375552987 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100504 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2195cb08992f9f1152dc7471de539b SystemUUID:ec2195cb-0899-2f9f-1152-dc7471de539b BootID:9018a170-4204-4836-9ccc-bd98f1d05f98 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:64:62:e6:35:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:64:62:e6:35:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:83:a3:a0:57:e6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 07 13:57:37.815418 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.815410    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 07 13:57:37.815562 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.815502    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 07 13:57:37.816313 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.816292    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 13:57:37.819214 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.819185    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 07 13:57:37.819387 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.819222    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-134.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 07 13:57:37.820116 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.820103    2581 topology_manager.go:138] "Creating topology manager with none policy"
Sep 07 13:57:37.820180 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.820122    2581 container_manager_linux.go:309] "Creating device plugin manager"
Sep 07 13:57:37.820180 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.820134    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 13:57:37.821857 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.821843    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 13:57:37.823822 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.823808    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 07 13:57:37.829547 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.829531    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 13:57:37.829698 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.829687    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 07 13:57:37.829762 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.829729    2581 kubelet.go:486] "Attempting to sync node with API server"
Sep 07 13:57:37.829762 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.829742    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 07 13:57:37.829848 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.829763    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 07 13:57:37.829848 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.829779    2581 kubelet.go:398] "Adding apiserver pod source"
Sep 07 13:57:37.829848 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.829793    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 07 13:57:37.830206 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.830192    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 13:57:37.830268 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.830216    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 13:57:37.832880 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.832860    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 07 13:57:37.835749 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.835734    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 07 13:57:37.835813 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.835765    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 07 13:57:37.835918 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.835907    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 07 13:57:37.835959 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.835921    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 07 13:57:37.835959 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.835926    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 07 13:57:37.835959 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.835932    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 07 13:57:37.835959 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.835939    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 07 13:57:37.835959 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.835944    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 07 13:57:37.836626 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.836617    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 07 13:57:37.836656 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.836627    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 07 13:57:37.836656 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.836634    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 07 13:57:37.836656 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.836640    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 07 13:57:37.836656 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.836648    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 07 13:57:37.836758 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.836678    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 07 13:57:37.838407 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.838397    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 07 13:57:37.838407 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.838407    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 07 13:57:37.840904 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.840884    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-134.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 07 13:57:37.841134 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:37.841108    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 07 13:57:37.841191 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:37.841113    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 07 13:57:37.842304 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.842290    2581 server.go:1268] "Started kubelet"
Sep 07 13:57:37.842371 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.842336    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 07 13:57:37.842457 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.842420    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 07 13:57:37.842504 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.842480    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 07 13:57:37.843113 ip-10-0-139-134 systemd[1]: Started Kubernetes Kubelet.
Sep 07 13:57:37.845944 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.845802    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 07 13:57:37.847477 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:37.847431    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 07 13:57:37.847477 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.847461    2581 server.go:310] "Adding debug handlers to kubelet server"
Sep 07 13:57:37.852728 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.852714    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 07 13:57:37.852798 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.852732    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 07 13:57:37.852851 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:37.852817    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Sep 07 13:57:37.853548 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.853527    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 07 13:57:37.853548 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.853540    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 07 13:57:37.853715 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.853559    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 07 13:57:37.853715 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.853655    2581 reconstruct.go:97] "Volume reconstruction finished"
Sep 07 13:57:37.853715 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.853665    2581 reconciler.go:29] "Reconciler: start to sync state"
Sep 07 13:57:37.853925 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.853903    2581 factory.go:55] Registering systemd factory
Sep 07 13:57:37.854025 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.853928    2581 factory.go:223] Registration of the systemd container factory successfully
Sep 07 13:57:37.854159 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.854147    2581 factory.go:153] Registering CRI-O factory
Sep 07 13:57:37.854207 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.854162    2581 factory.go:223] Registration of the crio container factory successfully
Sep 07 13:57:37.854207 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.854201    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 07 13:57:37.854279 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.854215    2581 factory.go:103] Registering Raw factory
Sep 07 13:57:37.854279 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.854227    2581 manager.go:1196] Started watching for new ooms in manager
Sep 07 13:57:37.854611 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.854594    2581 manager.go:349] Starting recovery of all containers
Sep 07 13:57:37.859148 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:37.859121    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 07 13:57:37.859305 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:37.859275    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 07 13:57:37.860298 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:37.859117    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-134.ec2.internal.18d30e88d4a6b1be  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-134.ec2.internal,UID:ip-10-0-139-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-134.ec2.internal,},FirstTimestamp:2026-09-07 13:57:37.84225427 +0000 UTC m=+0.404000114,LastTimestamp:2026-09-07 13:57:37.84225427 +0000 UTC m=+0.404000114,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-134.ec2.internal,}"
Sep 07 13:57:37.864687 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.864408    2581 manager.go:354] Recovery completed
Sep 07 13:57:37.869393 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.869378    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 13:57:37.869920 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.869900    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l5m22"
Sep 07 13:57:37.872555 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.872539    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 13:57:37.872641 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.872567    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 13:57:37.872641 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.872577    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientPID"
Sep 07 13:57:37.873205 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.873190    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 07 13:57:37.873260 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.873206    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 07 13:57:37.873260 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.873225    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 13:57:37.873376 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.873357    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 13:57:37.874208 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.874191    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 13:57:37.874300 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.874224    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 13:57:37.874300 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.874239    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientPID"
Sep 07 13:57:37.874593 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:37.874507    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-134.ec2.internal.18d30e88d67505c5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-134.ec2.internal,UID:ip-10-0-139-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-134.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-134.ec2.internal,},FirstTimestamp:2026-09-07 13:57:37.872553413 +0000 UTC m=+0.434299258,LastTimestamp:2026-09-07 13:57:37.872553413 +0000 UTC m=+0.434299258,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-134.ec2.internal,}"
Sep 07 13:57:37.875462 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.875449    2581 policy_none.go:49] "None policy: Start"
Sep 07 13:57:37.875576 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.875467    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 07 13:57:37.875576 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.875481    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 07 13:57:37.877574 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.877560    2581 policy_none.go:47] "Start"
Sep 07 13:57:37.878014 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.877997    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l5m22"
Sep 07 13:57:37.881489 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:37.881418    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-134.ec2.internal.18d30e88d6755019  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-134.ec2.internal,UID:ip-10-0-139-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-134.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-134.ec2.internal,},FirstTimestamp:2026-09-07 13:57:37.872572441 +0000 UTC m=+0.434318286,LastTimestamp:2026-09-07 13:57:37.872572441 +0000 UTC m=+0.434318286,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-134.ec2.internal,}"
Sep 07 13:57:37.951358 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.951312    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 07 13:57:37.953670 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.952495    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 07 13:57:37.953670 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.952556    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 07 13:57:37.953670 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.952589    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 07 13:57:37.953670 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:37.952685    2581 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Sep 07 13:57:37.953670 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:37.952921    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Sep 07 13:57:37.955085 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:37.955066    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 13:57:38.052823 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:38.052793    2581 kubelet.go:2472] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Sep 07 13:57:38.053515 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:38.053497    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Sep 07 13:57:38.053618 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.053606    2581 manager.go:337] "Starting Device Plugin manager"
Sep 07 13:57:38.053669 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:38.053645    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 07 13:57:38.053669 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.053655    2581 server.go:87] "Starting device plugin registration server"
Sep 07 13:57:38.054034 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.054022    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 07 13:57:38.054117 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.054036    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 07 13:57:38.054160 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.054130    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 07 13:57:38.054226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.054212    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 07 13:57:38.054226 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.054224    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 07 13:57:38.054851 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:38.054834    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 07 13:57:38.054920 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:38.054881    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-134.ec2.internal\" not found"
Sep 07 13:57:38.064946 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:38.064925    2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-134.ec2.internal\" not found" node="ip-10-0-139-134.ec2.internal"
Sep 07 13:57:38.154240 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.154196    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 13:57:38.157291 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.157273    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 13:57:38.157391 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.157309    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 13:57:38.157391 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.157324    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientPID"
Sep 07 13:57:38.157391 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.157355    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-134.ec2.internal"
Sep 07 13:57:38.171279 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.171259    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-134.ec2.internal"
Sep 07 13:57:38.171383 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:38.171284    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-134.ec2.internal\": node \"ip-10-0-139-134.ec2.internal\" not found"
Sep 07 13:57:38.223645 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:38.223616    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Sep 07 13:57:38.253829 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.253801    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal"]
Sep 07 13:57:38.253895 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.253877    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 13:57:38.255486 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.255468    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 13:57:38.255595 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.255497    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 13:57:38.255595 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.255507    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientPID"
Sep 07 13:57:38.257882 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.257867    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 13:57:38.258035 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.258020    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal"
Sep 07 13:57:38.258099 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.258057    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 13:57:38.258640 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.258623    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 13:57:38.258640 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.258634    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 13:57:38.258777 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.258647    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 13:57:38.258777 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.258657    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientPID"
Sep 07 13:57:38.258777 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.258659    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 13:57:38.258777 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.258672    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientPID"
Sep 07 13:57:38.260876 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.260860    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal"
Sep 07 13:57:38.260962 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.260894    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 13:57:38.261654 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.261641    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 13:57:38.261713 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.261669    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 13:57:38.261713 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.261683    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeHasSufficientPID"
Sep 07 13:57:38.277683 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:38.277619    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-134.ec2.internal\" not found" node="ip-10-0-139-134.ec2.internal"
Sep 07 13:57:38.282016 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:38.281999    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-134.ec2.internal\" not found" node="ip-10-0-139-134.ec2.internal"
Sep 07 13:57:38.324229 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:38.324193    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Sep 07 13:57:38.355128 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.355103    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52afddd129028853a2fcf4c4b95c33ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal\" (UID: \"52afddd129028853a2fcf4c4b95c33ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal"
Sep 07 13:57:38.355216 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.355131    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52afddd129028853a2fcf4c4b95c33ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal\" (UID: \"52afddd129028853a2fcf4c4b95c33ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal"
Sep 07 13:57:38.355216 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.355150    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/47cc00c1a8f55722dda32e7fd4a06975-config\") pod \"kube-apiserver-proxy-ip-10-0-139-134.ec2.internal\" (UID: \"47cc00c1a8f55722dda32e7fd4a06975\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal"
Sep 07 13:57:38.425309 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:38.425269    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Sep 07 13:57:38.455692 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.455666    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52afddd129028853a2fcf4c4b95c33ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal\" (UID: \"52afddd129028853a2fcf4c4b95c33ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal"
Sep 07 13:57:38.455749 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.455694    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/47cc00c1a8f55722dda32e7fd4a06975-config\") pod \"kube-apiserver-proxy-ip-10-0-139-134.ec2.internal\" (UID: \"47cc00c1a8f55722dda32e7fd4a06975\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal"
Sep 07 13:57:38.455749 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.455710    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52afddd129028853a2fcf4c4b95c33ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal\" (UID: \"52afddd129028853a2fcf4c4b95c33ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal"
Sep 07 13:57:38.455820 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.455758    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/47cc00c1a8f55722dda32e7fd4a06975-config\") pod \"kube-apiserver-proxy-ip-10-0-139-134.ec2.internal\" (UID: \"47cc00c1a8f55722dda32e7fd4a06975\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal"
Sep 07 13:57:38.455820 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.455768    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52afddd129028853a2fcf4c4b95c33ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal\" (UID: \"52afddd129028853a2fcf4c4b95c33ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal"
Sep 07 13:57:38.455820 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:38.455802    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52afddd129028853a2fcf4c4b95c33ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal\" (UID: \"52afddd129028853a2fcf4c4b95c33ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal"
Sep 07 13:57:40.087160 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:40.087119    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Sep 07 13:57:40.141694 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.141638    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal"
Sep 07 13:57:40.146651 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.146634    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal"
Sep 07 13:57:40.187759 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:40.187731    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-134.ec2.internal\" not found"
Sep 07 13:57:40.213383 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.213354    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 13:57:40.214696 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.214680    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal"
Sep 07 13:57:40.264933 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.264914    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 13:57:40.267611 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.267598    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal"
Sep 07 13:57:40.275579 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.275563    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 13:57:40.341141 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.341110    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 07 13:57:40.341614 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.341250    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 07 13:57:40.341614 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.341298    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 07 13:57:40.391906 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.391838    2581 apiserver.go:52] "Watching apiserver"
Sep 07 13:57:40.408525 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.408500    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 07 13:57:40.408862 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.408843    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal","openshift-multus/network-metrics-daemon-z7zzr","openshift-network-diagnostics/network-check-target-l6hnr","openshift-network-operator/iptables-alerter-wdc79","openshift-ovn-kubernetes/ovnkube-node-4qnph","kube-system/global-pull-secret-syncer-l6ks2","kube-system/konnectivity-agent-mfkdb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9","openshift-cluster-node-tuning-operator/tuned-mdmtf","openshift-dns/node-resolver-mwtrw","openshift-image-registry/node-ca-44mrd","openshift-multus/multus-additional-cni-plugins-6lwhm","openshift-multus/multus-kqfcv"]
Sep 07 13:57:40.411346 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.411329    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.413318 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.413285    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vg2qc\""
Sep 07 13:57:40.413482 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.413466    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mfkdb"
Sep 07 13:57:40.413570 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.413521    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 07 13:57:40.414003 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.413873    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 07 13:57:40.415703 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.414152    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 07 13:57:40.416191 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.416175    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 07 13:57:40.416254 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.416197    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 07 13:57:40.416341 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.416272    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nvc9v\""
Sep 07 13:57:40.416882 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.416868    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:57:40.416972 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:40.416950    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7zzr" podUID="f487c012-9aff-45d1-af45-3dd071a10e2e"
Sep 07 13:57:40.418045 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.418026    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-etc-modprobe-d\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.418128 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.418049    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-etc-sysconfig\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.418128 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.418064    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-etc-kubernetes\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.418128 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.418099    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-etc-sysctl-conf\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.418128 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.418124    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-run\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.418277 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.418140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-lib-modules\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.418277 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.418155    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dk99\" (UniqueName: \"kubernetes.io/projected/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-kube-api-access-7dk99\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.418277 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.418189    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-etc-sysctl-d\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.418277 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.418209    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-etc-systemd\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.418277 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.418253    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-tmp\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.418277 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.418274    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb770b10-368c-4e07-b98b-bb0dc4a12a27-agent-certs\") pod \"konnectivity-agent-mfkdb\" (UID: \"eb770b10-368c-4e07-b98b-bb0dc4a12a27\") " pod="kube-system/konnectivity-agent-mfkdb"
Sep 07 13:57:40.418518 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.418339    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb770b10-368c-4e07-b98b-bb0dc4a12a27-konnectivity-ca\") pod \"konnectivity-agent-mfkdb\" (UID: \"eb770b10-368c-4e07-b98b-bb0dc4a12a27\") " pod="kube-system/konnectivity-agent-mfkdb"
Sep 07 13:57:40.418518 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.418394    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-sys\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.418518 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.418430    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-var-lib-kubelet\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.418518 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.418449    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-host\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.418518 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.418465    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-etc-tuned\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.418518 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.418484    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs\") pod \"network-metrics-daemon-z7zzr\" (UID: \"f487c012-9aff-45d1-af45-3dd071a10e2e\") " pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:57:40.418518 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.418501    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d9jj\" (UniqueName: \"kubernetes.io/projected/f487c012-9aff-45d1-af45-3dd071a10e2e-kube-api-access-4d9jj\") pod \"network-metrics-daemon-z7zzr\" (UID: \"f487c012-9aff-45d1-af45-3dd071a10e2e\") " pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:57:40.419056 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.419042    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:57:40.419174 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:40.419155    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6hnr" podUID="4016228e-6351-475d-a718-c2ff55edbfee"
Sep 07 13:57:40.421259 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.421243    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.423538 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.423517    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.423627 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.423570    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2xxwd\""
Sep 07 13:57:40.423627 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.423572    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 07 13:57:40.423627 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.423578    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 07 13:57:40.423988 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.423970    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 07 13:57:40.423988 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.423978    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 07 13:57:40.425849 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.425836    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.426219 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.426201    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d29pc\""
Sep 07 13:57:40.426310 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.426202    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 07 13:57:40.426310 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.426303    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 07 13:57:40.426788 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.426773    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 07 13:57:40.426834 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.426773    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 07 13:57:40.427054 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.427041    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 07 13:57:40.427096 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.427053    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 07 13:57:40.427786 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.427774    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 07 13:57:40.427901 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.427888    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zr2v7\""
Sep 07 13:57:40.428161 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.428150    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.428281 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.428257    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 07 13:57:40.428348 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.428326    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 07 13:57:40.430055 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.430039    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 07 13:57:40.430281 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.430267    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9mnng\""
Sep 07 13:57:40.430388 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.430374    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wdc79"
Sep 07 13:57:40.430451 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.430437    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 07 13:57:40.432389 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.432372    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bxxdk\""
Sep 07 13:57:40.432578 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.432563    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 07 13:57:40.432619 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.432583    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 07 13:57:40.432659 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.432619    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 07 13:57:40.432734 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.432715    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mwtrw"
Sep 07 13:57:40.432887 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.432869    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 13:57:40.434963 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.434938    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 07 13:57:40.435021 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.434983    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lmhcv\""
Sep 07 13:57:40.435069 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.435053    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 07 13:57:40.435159 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.435147    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-44mrd"
Sep 07 13:57:40.437467 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.437446    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 07 13:57:40.437569 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.437489    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 07 13:57:40.437569 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.437502    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 07 13:57:40.437683 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.437661    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:40.437788 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:40.437763    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6ks2" podUID="73aad428-d904-4b67-aa24-363d9a75d104"
Sep 07 13:57:40.437847 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.437670    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b7nsx\""
Sep 07 13:57:40.441924 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.441861    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 13:52:39 +0000 UTC" deadline="2028-04-09 20:41:35.452214686 +0000 UTC"
Sep 07 13:57:40.441924 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.441919    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13926h43m55.010298611s"
Sep 07 13:57:40.458297 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.458267    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kjn2v"
Sep 07 13:57:40.465191 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.465170    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kjn2v"
Sep 07 13:57:40.516021 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.516001    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 07 13:57:40.518935 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.518915    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-system-cni-dir\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.519039 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.518939    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.519039 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.518957    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-env-overrides\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.519039 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.518979    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcplz\" (UniqueName: \"kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz\") pod \"network-check-target-l6hnr\" (UID: \"4016228e-6351-475d-a718-c2ff55edbfee\") " pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:57:40.519173 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519033    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-multus-cni-dir\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.519173 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519060    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7c1dfc5-6f69-4094-8899-8762438becac-cni-binary-copy\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.519173 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519077    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vhqr\" (UniqueName: \"kubernetes.io/projected/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-kube-api-access-6vhqr\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.519173 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519098    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2826663e-857c-488f-8102-0845b2f46709-system-cni-dir\") pod \"multus-additional-cni-plugins-6lwhm\" (UID: \"2826663e-857c-488f-8102-0845b2f46709\") " pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.519173 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519131    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2826663e-857c-488f-8102-0845b2f46709-cni-binary-copy\") pod \"multus-additional-cni-plugins-6lwhm\" (UID: \"2826663e-857c-488f-8102-0845b2f46709\") " pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.519173 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519167    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-etc-modprobe-d\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.519428 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/945c28a6-bcd8-4de3-bbb7-e29ee0eeab38-etc-selinux\") pod \"aws-ebs-csi-driver-node-qsqt9\" (UID: \"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.519428 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519201    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/945c28a6-bcd8-4de3-bbb7-e29ee0eeab38-sys-fs\") pod \"aws-ebs-csi-driver-node-qsqt9\" (UID: \"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.519428 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519218    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2826663e-857c-488f-8102-0845b2f46709-cnibin\") pod \"multus-additional-cni-plugins-6lwhm\" (UID: \"2826663e-857c-488f-8102-0845b2f46709\") " pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.519428 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519263    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2826663e-857c-488f-8102-0845b2f46709-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6lwhm\" (UID: \"2826663e-857c-488f-8102-0845b2f46709\") " pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.519428 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519300    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-etc-modprobe-d\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.519428 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519318    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/73aad428-d904-4b67-aa24-363d9a75d104-kubelet-config\") pod \"global-pull-secret-syncer-l6ks2\" (UID: \"73aad428-d904-4b67-aa24-363d9a75d104\") " pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:40.519428 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519347    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-etc-sysctl-d\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.519428 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519371    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb770b10-368c-4e07-b98b-bb0dc4a12a27-agent-certs\") pod \"konnectivity-agent-mfkdb\" (UID: \"eb770b10-368c-4e07-b98b-bb0dc4a12a27\") " pod="kube-system/konnectivity-agent-mfkdb"
Sep 07 13:57:40.519428 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519395    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-run-ovn\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.519428 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519417    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/945c28a6-bcd8-4de3-bbb7-e29ee0eeab38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qsqt9\" (UID: \"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.519834 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519438    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/238e154a-f3f9-49f4-a251-93d41a3b2bdc-iptables-alerter-script\") pod \"iptables-alerter-wdc79\" (UID: \"238e154a-f3f9-49f4-a251-93d41a3b2bdc\") " pod="openshift-network-operator/iptables-alerter-wdc79"
Sep 07 13:57:40.519834 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519458    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-etc-sysctl-d\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.519834 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519463    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-host\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.519834 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519502    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-systemd-units\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.519834 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519516    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-host\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.519834 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519526    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-host-run-netns\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.519834 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-etc-tuned\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.519834 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519573    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs\") pod \"network-metrics-daemon-z7zzr\" (UID: \"f487c012-9aff-45d1-af45-3dd071a10e2e\") " pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:57:40.519834 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519595    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-multus-socket-dir-parent\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.519834 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519617    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tmgv\" (UniqueName: \"kubernetes.io/projected/d7c1dfc5-6f69-4094-8899-8762438becac-kube-api-access-5tmgv\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.519834 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519635    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-log-socket\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.519834 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519650    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/945c28a6-bcd8-4de3-bbb7-e29ee0eeab38-device-dir\") pod \"aws-ebs-csi-driver-node-qsqt9\" (UID: \"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.519834 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519672    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5sn7\" (UniqueName: \"kubernetes.io/projected/2826663e-857c-488f-8102-0845b2f46709-kube-api-access-s5sn7\") pod \"multus-additional-cni-plugins-6lwhm\" (UID: \"2826663e-857c-488f-8102-0845b2f46709\") " pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.519834 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519706    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/238e154a-f3f9-49f4-a251-93d41a3b2bdc-host-slash\") pod \"iptables-alerter-wdc79\" (UID: \"238e154a-f3f9-49f4-a251-93d41a3b2bdc\") " pod="openshift-network-operator/iptables-alerter-wdc79"
Sep 07 13:57:40.519834 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:40.519713    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 13:57:40.519834 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519721    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-host-run-multus-certs\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.519834 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519735    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-etc-kubernetes\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.520628 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519748    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-host-kubelet\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.520628 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519774    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-ovn-node-metrics-cert\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.520628 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:40.519806    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs podName:f487c012-9aff-45d1-af45-3dd071a10e2e nodeName:}" failed. No retries permitted until 2026-09-07 13:57:41.019780416 +0000 UTC m=+2.020208807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs") pod "network-metrics-daemon-z7zzr" (UID: "f487c012-9aff-45d1-af45-3dd071a10e2e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 13:57:40.520628 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519863    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret\") pod \"global-pull-secret-syncer-l6ks2\" (UID: \"73aad428-d904-4b67-aa24-363d9a75d104\") " pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:40.520628 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519889    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb770b10-368c-4e07-b98b-bb0dc4a12a27-konnectivity-ca\") pod \"konnectivity-agent-mfkdb\" (UID: \"eb770b10-368c-4e07-b98b-bb0dc4a12a27\") " pod="kube-system/konnectivity-agent-mfkdb"
Sep 07 13:57:40.520628 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519910    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-hostroot\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.520628 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519916    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 07 13:57:40.520628 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519962    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-var-lib-kubelet\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.520628 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.519925    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-var-lib-kubelet\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.520628 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520055    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-host-run-k8s-cni-cncf-io\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.520628 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520089    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-host-var-lib-cni-bin\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.520628 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520112    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-host-var-lib-kubelet\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.520628 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520136    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-etc-openvswitch\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.520628 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520159    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80593104-b03b-4e55-9146-02b5f0f94c9b-host\") pod \"node-ca-44mrd\" (UID: \"80593104-b03b-4e55-9146-02b5f0f94c9b\") " pod="openshift-image-registry/node-ca-44mrd"
Sep 07 13:57:40.520628 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7c1dfc5-6f69-4094-8899-8762438becac-multus-daemon-config\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.520628 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520210    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e1fe657-72f7-49a7-ad98-1adb910682be-tmp-dir\") pod \"node-resolver-mwtrw\" (UID: \"6e1fe657-72f7-49a7-ad98-1adb910682be\") " pod="openshift-dns/node-resolver-mwtrw"
Sep 07 13:57:40.521470 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520234    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pghcq\" (UniqueName: \"kubernetes.io/projected/238e154a-f3f9-49f4-a251-93d41a3b2bdc-kube-api-access-pghcq\") pod \"iptables-alerter-wdc79\" (UID: \"238e154a-f3f9-49f4-a251-93d41a3b2bdc\") " pod="openshift-network-operator/iptables-alerter-wdc79"
Sep 07 13:57:40.521470 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520269    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-etc-kubernetes\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.521470 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-etc-sysctl-conf\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.521470 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520370    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-run\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.521470 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520393    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-lib-modules\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.521470 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520415    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-etc-kubernetes\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.521470 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520420    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-host-run-netns\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.521470 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520474    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-host-var-lib-cni-multus\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.521470 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520507    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-run\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.521470 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-var-lib-openvswitch\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.521470 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520544    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-etc-sysctl-conf\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.521470 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520558    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2826663e-857c-488f-8102-0845b2f46709-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6lwhm\" (UID: \"2826663e-857c-488f-8102-0845b2f46709\") " pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.521470 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520583    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-host-cni-netd\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.521470 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520595    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-lib-modules\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.521470 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520614    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-etc-systemd\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.521470 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520664    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-host-slash\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.521470 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520689    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-run-systemd\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.522239 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520715    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-node-log\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.522239 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520740    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-host-cni-bin\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.522239 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520763    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztt8f\" (UniqueName: \"kubernetes.io/projected/945c28a6-bcd8-4de3-bbb7-e29ee0eeab38-kube-api-access-ztt8f\") pod \"aws-ebs-csi-driver-node-qsqt9\" (UID: \"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.522239 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520769    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-etc-systemd\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.522239 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520784    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6e1fe657-72f7-49a7-ad98-1adb910682be-hosts-file\") pod \"node-resolver-mwtrw\" (UID: \"6e1fe657-72f7-49a7-ad98-1adb910682be\") " pod="openshift-dns/node-resolver-mwtrw"
Sep 07 13:57:40.522239 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520815    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-run-openvswitch\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.522239 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.520983    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/945c28a6-bcd8-4de3-bbb7-e29ee0eeab38-registration-dir\") pod \"aws-ebs-csi-driver-node-qsqt9\" (UID: \"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.522239 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.521010    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfn2p\" (UniqueName: \"kubernetes.io/projected/80593104-b03b-4e55-9146-02b5f0f94c9b-kube-api-access-lfn2p\") pod \"node-ca-44mrd\" (UID: \"80593104-b03b-4e55-9146-02b5f0f94c9b\") " pod="openshift-image-registry/node-ca-44mrd"
Sep 07 13:57:40.522239 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.521054    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d9jj\" (UniqueName: \"kubernetes.io/projected/f487c012-9aff-45d1-af45-3dd071a10e2e-kube-api-access-4d9jj\") pod \"network-metrics-daemon-z7zzr\" (UID: \"f487c012-9aff-45d1-af45-3dd071a10e2e\") " pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:57:40.522239 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.521078    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-cnibin\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.522239 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.521102    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2826663e-857c-488f-8102-0845b2f46709-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6lwhm\" (UID: \"2826663e-857c-488f-8102-0845b2f46709\") " pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.522239 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.521125    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80593104-b03b-4e55-9146-02b5f0f94c9b-serviceca\") pod \"node-ca-44mrd\" (UID: \"80593104-b03b-4e55-9146-02b5f0f94c9b\") " pod="openshift-image-registry/node-ca-44mrd"
Sep 07 13:57:40.522239 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.521168    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/73aad428-d904-4b67-aa24-363d9a75d104-dbus\") pod \"global-pull-secret-syncer-l6ks2\" (UID: \"73aad428-d904-4b67-aa24-363d9a75d104\") " pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:40.522239 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.521196    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-etc-sysconfig\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.522239 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.521223    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dk99\" (UniqueName: \"kubernetes.io/projected/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-kube-api-access-7dk99\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.522239 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.521248    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-ovnkube-script-lib\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.523001 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.521336    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/945c28a6-bcd8-4de3-bbb7-e29ee0eeab38-socket-dir\") pod \"aws-ebs-csi-driver-node-qsqt9\" (UID: \"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.523001 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.521421    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-etc-sysconfig\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.523001 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.521409    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb770b10-368c-4e07-b98b-bb0dc4a12a27-konnectivity-ca\") pod \"konnectivity-agent-mfkdb\" (UID: \"eb770b10-368c-4e07-b98b-bb0dc4a12a27\") " pod="kube-system/konnectivity-agent-mfkdb"
Sep 07 13:57:40.523001 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.521496    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fb6k\" (UniqueName: \"kubernetes.io/projected/6e1fe657-72f7-49a7-ad98-1adb910682be-kube-api-access-7fb6k\") pod \"node-resolver-mwtrw\" (UID: \"6e1fe657-72f7-49a7-ad98-1adb910682be\") " pod="openshift-dns/node-resolver-mwtrw"
Sep 07 13:57:40.523001 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.521558    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-tmp\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.523001 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.521720    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-multus-conf-dir\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.523001 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.521764    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-host-run-ovn-kubernetes\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.523001 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.521792    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-ovnkube-config\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.523001 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.521833    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-sys\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.523001 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.521939    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-sys\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.523796 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.523770    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-etc-tuned\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.523885 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.523870    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-tmp\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.523991 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.523975    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb770b10-368c-4e07-b98b-bb0dc4a12a27-agent-certs\") pod \"konnectivity-agent-mfkdb\" (UID: \"eb770b10-368c-4e07-b98b-bb0dc4a12a27\") " pod="kube-system/konnectivity-agent-mfkdb"
Sep 07 13:57:40.531530 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.531509    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d9jj\" (UniqueName: \"kubernetes.io/projected/f487c012-9aff-45d1-af45-3dd071a10e2e-kube-api-access-4d9jj\") pod \"network-metrics-daemon-z7zzr\" (UID: \"f487c012-9aff-45d1-af45-3dd071a10e2e\") " pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:57:40.531982 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.531967    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dk99\" (UniqueName: \"kubernetes.io/projected/a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d-kube-api-access-7dk99\") pod \"tuned-mdmtf\" (UID: \"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d\") " pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.622474 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7c1dfc5-6f69-4094-8899-8762438becac-multus-daemon-config\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.622474 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622472    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e1fe657-72f7-49a7-ad98-1adb910682be-tmp-dir\") pod \"node-resolver-mwtrw\" (UID: \"6e1fe657-72f7-49a7-ad98-1adb910682be\") " pod="openshift-dns/node-resolver-mwtrw"
Sep 07 13:57:40.622725 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622488    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pghcq\" (UniqueName: \"kubernetes.io/projected/238e154a-f3f9-49f4-a251-93d41a3b2bdc-kube-api-access-pghcq\") pod \"iptables-alerter-wdc79\" (UID: \"238e154a-f3f9-49f4-a251-93d41a3b2bdc\") " pod="openshift-network-operator/iptables-alerter-wdc79"
Sep 07 13:57:40.622725 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622505    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-host-run-netns\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.622725 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622519    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-host-var-lib-cni-multus\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.622725 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622534    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-var-lib-openvswitch\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.622725 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2826663e-857c-488f-8102-0845b2f46709-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6lwhm\" (UID: \"2826663e-857c-488f-8102-0845b2f46709\") " pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.622725 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622570    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-host-cni-netd\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.622725 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622573    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-host-run-netns\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.622725 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622592    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-host-slash\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.622725 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622597    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-host-var-lib-cni-multus\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.622725 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622615    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-var-lib-openvswitch\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.622725 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622619    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-run-systemd\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.622725 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622632    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-host-cni-netd\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.622725 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622661    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-node-log\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.622725 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622668    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-run-systemd\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.622725 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622697    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-host-slash\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.622725 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622707    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-node-log\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.622725 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622730    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-host-cni-bin\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.623567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622755    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztt8f\" (UniqueName: \"kubernetes.io/projected/945c28a6-bcd8-4de3-bbb7-e29ee0eeab38-kube-api-access-ztt8f\") pod \"aws-ebs-csi-driver-node-qsqt9\" (UID: \"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.623567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622761    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-host-cni-bin\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.623567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622775    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2826663e-857c-488f-8102-0845b2f46709-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6lwhm\" (UID: \"2826663e-857c-488f-8102-0845b2f46709\") " pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.623567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622779    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6e1fe657-72f7-49a7-ad98-1adb910682be-hosts-file\") pod \"node-resolver-mwtrw\" (UID: \"6e1fe657-72f7-49a7-ad98-1adb910682be\") " pod="openshift-dns/node-resolver-mwtrw"
Sep 07 13:57:40.623567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622819    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6e1fe657-72f7-49a7-ad98-1adb910682be-hosts-file\") pod \"node-resolver-mwtrw\" (UID: \"6e1fe657-72f7-49a7-ad98-1adb910682be\") " pod="openshift-dns/node-resolver-mwtrw"
Sep 07 13:57:40.623567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622819    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-run-openvswitch\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.623567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622835    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e1fe657-72f7-49a7-ad98-1adb910682be-tmp-dir\") pod \"node-resolver-mwtrw\" (UID: \"6e1fe657-72f7-49a7-ad98-1adb910682be\") " pod="openshift-dns/node-resolver-mwtrw"
Sep 07 13:57:40.623567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622850    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/945c28a6-bcd8-4de3-bbb7-e29ee0eeab38-registration-dir\") pod \"aws-ebs-csi-driver-node-qsqt9\" (UID: \"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.623567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622848    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-run-openvswitch\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.623567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622892    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/945c28a6-bcd8-4de3-bbb7-e29ee0eeab38-registration-dir\") pod \"aws-ebs-csi-driver-node-qsqt9\" (UID: \"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.623567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622909    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfn2p\" (UniqueName: \"kubernetes.io/projected/80593104-b03b-4e55-9146-02b5f0f94c9b-kube-api-access-lfn2p\") pod \"node-ca-44mrd\" (UID: \"80593104-b03b-4e55-9146-02b5f0f94c9b\") " pod="openshift-image-registry/node-ca-44mrd"
Sep 07 13:57:40.623567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622945    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-cnibin\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.623567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.622974    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2826663e-857c-488f-8102-0845b2f46709-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6lwhm\" (UID: \"2826663e-857c-488f-8102-0845b2f46709\") " pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.623567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623032    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-cnibin\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.623567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80593104-b03b-4e55-9146-02b5f0f94c9b-serviceca\") pod \"node-ca-44mrd\" (UID: \"80593104-b03b-4e55-9146-02b5f0f94c9b\") " pod="openshift-image-registry/node-ca-44mrd"
Sep 07 13:57:40.623567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/73aad428-d904-4b67-aa24-363d9a75d104-dbus\") pod \"global-pull-secret-syncer-l6ks2\" (UID: \"73aad428-d904-4b67-aa24-363d9a75d104\") " pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:40.623567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623108    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-ovnkube-script-lib\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.624377 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/945c28a6-bcd8-4de3-bbb7-e29ee0eeab38-socket-dir\") pod \"aws-ebs-csi-driver-node-qsqt9\" (UID: \"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.624377 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623186    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fb6k\" (UniqueName: \"kubernetes.io/projected/6e1fe657-72f7-49a7-ad98-1adb910682be-kube-api-access-7fb6k\") pod \"node-resolver-mwtrw\" (UID: \"6e1fe657-72f7-49a7-ad98-1adb910682be\") " pod="openshift-dns/node-resolver-mwtrw"
Sep 07 13:57:40.624377 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623203    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-multus-conf-dir\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.624377 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623163    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/73aad428-d904-4b67-aa24-363d9a75d104-dbus\") pod \"global-pull-secret-syncer-l6ks2\" (UID: \"73aad428-d904-4b67-aa24-363d9a75d104\") " pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:40.624377 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623225    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-host-run-ovn-kubernetes\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.624377 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623254    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/945c28a6-bcd8-4de3-bbb7-e29ee0eeab38-socket-dir\") pod \"aws-ebs-csi-driver-node-qsqt9\" (UID: \"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.624377 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623254    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7c1dfc5-6f69-4094-8899-8762438becac-multus-daemon-config\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.624377 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623281    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-host-run-ovn-kubernetes\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.624377 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623260    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-multus-conf-dir\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.624377 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623392    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-ovnkube-config\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.624377 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623417    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-system-cni-dir\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.624377 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623432    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.624377 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-env-overrides\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.624377 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623491    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-system-cni-dir\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.624377 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623493    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.624377 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623520    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2826663e-857c-488f-8102-0845b2f46709-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6lwhm\" (UID: \"2826663e-857c-488f-8102-0845b2f46709\") " pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.624377 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623547    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcplz\" (UniqueName: \"kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz\") pod \"network-check-target-l6hnr\" (UID: \"4016228e-6351-475d-a718-c2ff55edbfee\") " pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:57:40.625056 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623574    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-multus-cni-dir\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.625056 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623598    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7c1dfc5-6f69-4094-8899-8762438becac-cni-binary-copy\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.625056 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623644    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vhqr\" (UniqueName: \"kubernetes.io/projected/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-kube-api-access-6vhqr\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.625056 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623667    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-multus-cni-dir\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.625056 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623669    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2826663e-857c-488f-8102-0845b2f46709-system-cni-dir\") pod \"multus-additional-cni-plugins-6lwhm\" (UID: \"2826663e-857c-488f-8102-0845b2f46709\") " pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.625056 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623703    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2826663e-857c-488f-8102-0845b2f46709-system-cni-dir\") pod \"multus-additional-cni-plugins-6lwhm\" (UID: \"2826663e-857c-488f-8102-0845b2f46709\") " pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.625056 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623706    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2826663e-857c-488f-8102-0845b2f46709-cni-binary-copy\") pod \"multus-additional-cni-plugins-6lwhm\" (UID: \"2826663e-857c-488f-8102-0845b2f46709\") " pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.625056 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623744    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/945c28a6-bcd8-4de3-bbb7-e29ee0eeab38-etc-selinux\") pod \"aws-ebs-csi-driver-node-qsqt9\" (UID: \"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.625056 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623771    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/945c28a6-bcd8-4de3-bbb7-e29ee0eeab38-sys-fs\") pod \"aws-ebs-csi-driver-node-qsqt9\" (UID: \"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.625056 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2826663e-857c-488f-8102-0845b2f46709-cnibin\") pod \"multus-additional-cni-plugins-6lwhm\" (UID: \"2826663e-857c-488f-8102-0845b2f46709\") " pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.625056 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623819    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-env-overrides\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.625056 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623822    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2826663e-857c-488f-8102-0845b2f46709-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6lwhm\" (UID: \"2826663e-857c-488f-8102-0845b2f46709\") " pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.625056 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623848    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/73aad428-d904-4b67-aa24-363d9a75d104-kubelet-config\") pod \"global-pull-secret-syncer-l6ks2\" (UID: \"73aad428-d904-4b67-aa24-363d9a75d104\") " pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:40.625056 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623869    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/945c28a6-bcd8-4de3-bbb7-e29ee0eeab38-etc-selinux\") pod \"aws-ebs-csi-driver-node-qsqt9\" (UID: \"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.625056 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623873    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-run-ovn\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.625056 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623883    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-ovnkube-script-lib\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.625056 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623905    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/945c28a6-bcd8-4de3-bbb7-e29ee0eeab38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qsqt9\" (UID: \"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.625541 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623915    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/945c28a6-bcd8-4de3-bbb7-e29ee0eeab38-sys-fs\") pod \"aws-ebs-csi-driver-node-qsqt9\" (UID: \"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.625541 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623936    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2826663e-857c-488f-8102-0845b2f46709-cnibin\") pod \"multus-additional-cni-plugins-6lwhm\" (UID: \"2826663e-857c-488f-8102-0845b2f46709\") " pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.625541 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623935    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/238e154a-f3f9-49f4-a251-93d41a3b2bdc-iptables-alerter-script\") pod \"iptables-alerter-wdc79\" (UID: \"238e154a-f3f9-49f4-a251-93d41a3b2bdc\") " pod="openshift-network-operator/iptables-alerter-wdc79"
Sep 07 13:57:40.625541 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623959    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/73aad428-d904-4b67-aa24-363d9a75d104-kubelet-config\") pod \"global-pull-secret-syncer-l6ks2\" (UID: \"73aad428-d904-4b67-aa24-363d9a75d104\") " pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:40.625541 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623970    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-run-ovn\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.625541 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623986    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-systemd-units\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.625541 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624011    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-host-run-netns\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.625541 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624026    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-systemd-units\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.625541 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.623988    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/945c28a6-bcd8-4de3-bbb7-e29ee0eeab38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qsqt9\" (UID: \"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.625541 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624050    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-multus-socket-dir-parent\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.625541 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624074    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tmgv\" (UniqueName: \"kubernetes.io/projected/d7c1dfc5-6f69-4094-8899-8762438becac-kube-api-access-5tmgv\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.625541 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624077    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-host-run-netns\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.625541 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-log-socket\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.625541 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624120    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/945c28a6-bcd8-4de3-bbb7-e29ee0eeab38-device-dir\") pod \"aws-ebs-csi-driver-node-qsqt9\" (UID: \"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.625541 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624130    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-multus-socket-dir-parent\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.625541 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624144    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5sn7\" (UniqueName: \"kubernetes.io/projected/2826663e-857c-488f-8102-0845b2f46709-kube-api-access-s5sn7\") pod \"multus-additional-cni-plugins-6lwhm\" (UID: \"2826663e-857c-488f-8102-0845b2f46709\") " pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.625541 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/238e154a-f3f9-49f4-a251-93d41a3b2bdc-host-slash\") pod \"iptables-alerter-wdc79\" (UID: \"238e154a-f3f9-49f4-a251-93d41a3b2bdc\") " pod="openshift-network-operator/iptables-alerter-wdc79"
Sep 07 13:57:40.626029 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624172    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-log-socket\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.626029 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624193    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-host-run-multus-certs\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.626029 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624201    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2826663e-857c-488f-8102-0845b2f46709-cni-binary-copy\") pod \"multus-additional-cni-plugins-6lwhm\" (UID: \"2826663e-857c-488f-8102-0845b2f46709\") " pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.626029 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624222    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-etc-kubernetes\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.626029 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624237    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7c1dfc5-6f69-4094-8899-8762438becac-cni-binary-copy\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.626029 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624269    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-etc-kubernetes\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.626029 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624341    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-host-kubelet\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.626029 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624369    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-ovn-node-metrics-cert\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.626029 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624370    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-host-run-multus-certs\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.626029 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624343    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/945c28a6-bcd8-4de3-bbb7-e29ee0eeab38-device-dir\") pod \"aws-ebs-csi-driver-node-qsqt9\" (UID: \"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.626029 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624412    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-host-kubelet\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.626029 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624415    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret\") pod \"global-pull-secret-syncer-l6ks2\" (UID: \"73aad428-d904-4b67-aa24-363d9a75d104\") " pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:40.626029 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624420    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/238e154a-f3f9-49f4-a251-93d41a3b2bdc-host-slash\") pod \"iptables-alerter-wdc79\" (UID: \"238e154a-f3f9-49f4-a251-93d41a3b2bdc\") " pod="openshift-network-operator/iptables-alerter-wdc79"
Sep 07 13:57:40.626029 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624468    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2826663e-857c-488f-8102-0845b2f46709-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6lwhm\" (UID: \"2826663e-857c-488f-8102-0845b2f46709\") " pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.626029 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624513    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/238e154a-f3f9-49f4-a251-93d41a3b2bdc-iptables-alerter-script\") pod \"iptables-alerter-wdc79\" (UID: \"238e154a-f3f9-49f4-a251-93d41a3b2bdc\") " pod="openshift-network-operator/iptables-alerter-wdc79"
Sep 07 13:57:40.626029 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624525    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-ovnkube-config\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.626029 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:40.624519    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 13:57:40.626029 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624528    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-hostroot\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.626565 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624578    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80593104-b03b-4e55-9146-02b5f0f94c9b-serviceca\") pod \"node-ca-44mrd\" (UID: \"80593104-b03b-4e55-9146-02b5f0f94c9b\") " pod="openshift-image-registry/node-ca-44mrd"
Sep 07 13:57:40.626565 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624621    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-host-run-k8s-cni-cncf-io\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.626565 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624633    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-hostroot\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.626565 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624663    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-host-run-k8s-cni-cncf-io\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.626565 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624673    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-host-var-lib-cni-bin\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.626565 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:40.624721    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret podName:73aad428-d904-4b67-aa24-363d9a75d104 nodeName:}" failed. No retries permitted until 2026-09-07 13:57:41.124707149 +0000 UTC m=+2.125135520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret") pod "global-pull-secret-syncer-l6ks2" (UID: "73aad428-d904-4b67-aa24-363d9a75d104") : object "kube-system"/"original-pull-secret" not registered
Sep 07 13:57:40.626565 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624765    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-host-var-lib-kubelet\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.626565 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-etc-openvswitch\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.626565 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624791    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-host-var-lib-cni-bin\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.626565 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624801    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80593104-b03b-4e55-9146-02b5f0f94c9b-host\") pod \"node-ca-44mrd\" (UID: \"80593104-b03b-4e55-9146-02b5f0f94c9b\") " pod="openshift-image-registry/node-ca-44mrd"
Sep 07 13:57:40.626565 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624834    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80593104-b03b-4e55-9146-02b5f0f94c9b-host\") pod \"node-ca-44mrd\" (UID: \"80593104-b03b-4e55-9146-02b5f0f94c9b\") " pod="openshift-image-registry/node-ca-44mrd"
Sep 07 13:57:40.626565 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624857    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7c1dfc5-6f69-4094-8899-8762438becac-host-var-lib-kubelet\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.626565 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.624861    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-etc-openvswitch\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.626565 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.626560    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-ovn-node-metrics-cert\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.628934 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:40.628916    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 13:57:40.628934 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:40.628934    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 13:57:40.629042 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:40.628943    2581 projected.go:196] Error preparing data for projected volume kube-api-access-rcplz for pod openshift-network-diagnostics/network-check-target-l6hnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 13:57:40.629042 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:40.629001    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz podName:4016228e-6351-475d-a718-c2ff55edbfee nodeName:}" failed. No retries permitted until 2026-09-07 13:57:41.128988899 +0000 UTC m=+2.129417277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rcplz" (UniqueName: "kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz") pod "network-check-target-l6hnr" (UID: "4016228e-6351-475d-a718-c2ff55edbfee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 13:57:40.630801 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.630778    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pghcq\" (UniqueName: \"kubernetes.io/projected/238e154a-f3f9-49f4-a251-93d41a3b2bdc-kube-api-access-pghcq\") pod \"iptables-alerter-wdc79\" (UID: \"238e154a-f3f9-49f4-a251-93d41a3b2bdc\") " pod="openshift-network-operator/iptables-alerter-wdc79"
Sep 07 13:57:40.630926 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.630833    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fb6k\" (UniqueName: \"kubernetes.io/projected/6e1fe657-72f7-49a7-ad98-1adb910682be-kube-api-access-7fb6k\") pod \"node-resolver-mwtrw\" (UID: \"6e1fe657-72f7-49a7-ad98-1adb910682be\") " pod="openshift-dns/node-resolver-mwtrw"
Sep 07 13:57:40.631626 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.631602    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztt8f\" (UniqueName: \"kubernetes.io/projected/945c28a6-bcd8-4de3-bbb7-e29ee0eeab38-kube-api-access-ztt8f\") pod \"aws-ebs-csi-driver-node-qsqt9\" (UID: \"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.631795 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.631778    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfn2p\" (UniqueName: \"kubernetes.io/projected/80593104-b03b-4e55-9146-02b5f0f94c9b-kube-api-access-lfn2p\") pod \"node-ca-44mrd\" (UID: \"80593104-b03b-4e55-9146-02b5f0f94c9b\") " pod="openshift-image-registry/node-ca-44mrd"
Sep 07 13:57:40.632220 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.632199    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vhqr\" (UniqueName: \"kubernetes.io/projected/f4e085e4-1e00-4e03-ac87-cdf6155e0f83-kube-api-access-6vhqr\") pod \"ovnkube-node-4qnph\" (UID: \"f4e085e4-1e00-4e03-ac87-cdf6155e0f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.635496 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.635476    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5sn7\" (UniqueName: \"kubernetes.io/projected/2826663e-857c-488f-8102-0845b2f46709-kube-api-access-s5sn7\") pod \"multus-additional-cni-plugins-6lwhm\" (UID: \"2826663e-857c-488f-8102-0845b2f46709\") " pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.635994 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.635975    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tmgv\" (UniqueName: \"kubernetes.io/projected/d7c1dfc5-6f69-4094-8899-8762438becac-kube-api-access-5tmgv\") pod \"multus-kqfcv\" (UID: \"d7c1dfc5-6f69-4094-8899-8762438becac\") " pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.707527 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.707448    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 13:57:40.740017 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.739985    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mdmtf"
Sep 07 13:57:40.744970 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.744941    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mfkdb"
Sep 07 13:57:40.773790 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.773759    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kqfcv"
Sep 07 13:57:40.778595 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.778568    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:57:40.798112 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.798091    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9"
Sep 07 13:57:40.818930 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.818904    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6lwhm"
Sep 07 13:57:40.839699 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.839674    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wdc79"
Sep 07 13:57:40.853601 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.853575    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mwtrw"
Sep 07 13:57:40.858328 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.858267    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-44mrd"
Sep 07 13:57:40.883163 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:40.883135    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod238e154a_f3f9_49f4_a251_93d41a3b2bdc.slice/crio-27b975a2530574b8698b47f6c4d6eb37fc35a51865309c589aa6944fa0f65c9a WatchSource:0}: Error finding container 27b975a2530574b8698b47f6c4d6eb37fc35a51865309c589aa6944fa0f65c9a: Status 404 returned error can't find the container with id 27b975a2530574b8698b47f6c4d6eb37fc35a51865309c589aa6944fa0f65c9a
Sep 07 13:57:40.883531 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:40.883511    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52afddd129028853a2fcf4c4b95c33ca.slice/crio-764c815c4a472917cc458f9595242109690f3a458e0c3b35c34881c97fb8aeda WatchSource:0}: Error finding container 764c815c4a472917cc458f9595242109690f3a458e0c3b35c34881c97fb8aeda: Status 404 returned error can't find the container with id 764c815c4a472917cc458f9595242109690f3a458e0c3b35c34881c97fb8aeda
Sep 07 13:57:40.885744 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:40.885717    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e1fe657_72f7_49a7_ad98_1adb910682be.slice/crio-ab3595600a6b70c350315c2d445d0402a6c28961b4b64436d87d40cca9732d1e WatchSource:0}: Error finding container ab3595600a6b70c350315c2d445d0402a6c28961b4b64436d87d40cca9732d1e: Status 404 returned error can't find the container with id ab3595600a6b70c350315c2d445d0402a6c28961b4b64436d87d40cca9732d1e
Sep 07 13:57:40.890400 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:40.890208    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 13:57:41.020491 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:41.020413    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 13:57:41.028487 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:41.028463    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs\") pod \"network-metrics-daemon-z7zzr\" (UID: \"f487c012-9aff-45d1-af45-3dd071a10e2e\") " pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:57:41.028622 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:41.028584    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 13:57:41.028660 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:41.028633    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs podName:f487c012-9aff-45d1-af45-3dd071a10e2e nodeName:}" failed. No retries permitted until 2026-09-07 13:57:42.028620228 +0000 UTC m=+3.029048598 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs") pod "network-metrics-daemon-z7zzr" (UID: "f487c012-9aff-45d1-af45-3dd071a10e2e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 13:57:41.078102 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:41.078070    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb770b10_368c_4e07_b98b_bb0dc4a12a27.slice/crio-4d5899c1ae70c57eb817ab5f47816f3c68db9c4cd8533d36eb7a96ac87dd16b7 WatchSource:0}: Error finding container 4d5899c1ae70c57eb817ab5f47816f3c68db9c4cd8533d36eb7a96ac87dd16b7: Status 404 returned error can't find the container with id 4d5899c1ae70c57eb817ab5f47816f3c68db9c4cd8533d36eb7a96ac87dd16b7
Sep 07 13:57:41.113836 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:41.113806    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a37b6d_e2bf_4db5_829b_f2d41f9f4b7d.slice/crio-e4e839e45abca4364dd4e92b832692529fb336a6ff7b72c3d85eb54e3f12dd81 WatchSource:0}: Error finding container e4e839e45abca4364dd4e92b832692529fb336a6ff7b72c3d85eb54e3f12dd81: Status 404 returned error can't find the container with id e4e839e45abca4364dd4e92b832692529fb336a6ff7b72c3d85eb54e3f12dd81
Sep 07 13:57:41.129831 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:41.129809    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret\") pod \"global-pull-secret-syncer-l6ks2\" (UID: \"73aad428-d904-4b67-aa24-363d9a75d104\") " pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:41.129938 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:41.129859    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcplz\" (UniqueName: \"kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz\") pod \"network-check-target-l6hnr\" (UID: \"4016228e-6351-475d-a718-c2ff55edbfee\") " pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:57:41.129977 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:41.129958    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 13:57:41.130033 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:41.130023    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret podName:73aad428-d904-4b67-aa24-363d9a75d104 nodeName:}" failed. No retries permitted until 2026-09-07 13:57:42.13000128 +0000 UTC m=+3.130429651 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret") pod "global-pull-secret-syncer-l6ks2" (UID: "73aad428-d904-4b67-aa24-363d9a75d104") : object "kube-system"/"original-pull-secret" not registered
Sep 07 13:57:41.130140 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:41.129964    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 13:57:41.130140 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:41.130066    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 13:57:41.130140 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:41.130079    2581 projected.go:196] Error preparing data for projected volume kube-api-access-rcplz for pod openshift-network-diagnostics/network-check-target-l6hnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 13:57:41.130140 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:41.130132    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz podName:4016228e-6351-475d-a718-c2ff55edbfee nodeName:}" failed. No retries permitted until 2026-09-07 13:57:42.130117022 +0000 UTC m=+3.130545392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rcplz" (UniqueName: "kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz") pod "network-check-target-l6hnr" (UID: "4016228e-6351-475d-a718-c2ff55edbfee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 13:57:41.140213 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:41.140192    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4e085e4_1e00_4e03_ac87_cdf6155e0f83.slice/crio-34aaee4d8f95536c9a8a7eba265508dbe29d61f822122bd8ea17ca5d25cdd8bb WatchSource:0}: Error finding container 34aaee4d8f95536c9a8a7eba265508dbe29d61f822122bd8ea17ca5d25cdd8bb: Status 404 returned error can't find the container with id 34aaee4d8f95536c9a8a7eba265508dbe29d61f822122bd8ea17ca5d25cdd8bb
Sep 07 13:57:41.227497 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:41.227470    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod945c28a6_bcd8_4de3_bbb7_e29ee0eeab38.slice/crio-b083d77df4dad02743e71a19fdb76d9a044917403753f8ea8341bec269cdce63 WatchSource:0}: Error finding container b083d77df4dad02743e71a19fdb76d9a044917403753f8ea8341bec269cdce63: Status 404 returned error can't find the container with id b083d77df4dad02743e71a19fdb76d9a044917403753f8ea8341bec269cdce63
Sep 07 13:57:41.228065 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:57:41.228043    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7c1dfc5_6f69_4094_8899_8762438becac.slice/crio-a324e3a11fdc9507b225946d41a241e8ee0521dd44a669f97c851a4a02a45366 WatchSource:0}: Error finding container a324e3a11fdc9507b225946d41a241e8ee0521dd44a669f97c851a4a02a45366: Status 404 returned error can't find the container with id a324e3a11fdc9507b225946d41a241e8ee0521dd44a669f97c851a4a02a45366
Sep 07 13:57:41.468180 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:41.468061    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 13:52:40 +0000 UTC" deadline="2028-03-09 22:05:38.865531632 +0000 UTC"
Sep 07 13:57:41.468180 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:41.468125    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13184h7m57.397410518s"
Sep 07 13:57:41.515335 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:41.515304    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:57:41.515507 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:41.515434    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6hnr" podUID="4016228e-6351-475d-a718-c2ff55edbfee"
Sep 07 13:57:41.525904 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:41.525852    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4qnph" event={"ID":"f4e085e4-1e00-4e03-ac87-cdf6155e0f83","Type":"ContainerStarted","Data":"34aaee4d8f95536c9a8a7eba265508dbe29d61f822122bd8ea17ca5d25cdd8bb"}
Sep 07 13:57:41.531817 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:41.531739    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mdmtf" event={"ID":"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d","Type":"ContainerStarted","Data":"e4e839e45abca4364dd4e92b832692529fb336a6ff7b72c3d85eb54e3f12dd81"}
Sep 07 13:57:41.538429 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:41.538091    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mwtrw" event={"ID":"6e1fe657-72f7-49a7-ad98-1adb910682be","Type":"ContainerStarted","Data":"ab3595600a6b70c350315c2d445d0402a6c28961b4b64436d87d40cca9732d1e"}
Sep 07 13:57:41.541081 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:41.541000    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wdc79" event={"ID":"238e154a-f3f9-49f4-a251-93d41a3b2bdc","Type":"ContainerStarted","Data":"27b975a2530574b8698b47f6c4d6eb37fc35a51865309c589aa6944fa0f65c9a"}
Sep 07 13:57:41.543536 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:41.543505    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lwhm" event={"ID":"2826663e-857c-488f-8102-0845b2f46709","Type":"ContainerStarted","Data":"ee680edc558f44171ae7ef002c01455506bc4c4be74765dd9a52bf0303f487cf"}
Sep 07 13:57:41.545725 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:41.545702    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal" event={"ID":"47cc00c1a8f55722dda32e7fd4a06975","Type":"ContainerStarted","Data":"d29c29ddc7508a02294f849caed13a5c7a7718c18893a9ce4fd12b489098f231"}
Sep 07 13:57:41.547989 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:41.547963    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal" event={"ID":"52afddd129028853a2fcf4c4b95c33ca","Type":"ContainerStarted","Data":"764c815c4a472917cc458f9595242109690f3a458e0c3b35c34881c97fb8aeda"}
Sep 07 13:57:41.551210 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:41.551121    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9" event={"ID":"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38","Type":"ContainerStarted","Data":"b083d77df4dad02743e71a19fdb76d9a044917403753f8ea8341bec269cdce63"}
Sep 07 13:57:41.558362 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:41.558272    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mfkdb" event={"ID":"eb770b10-368c-4e07-b98b-bb0dc4a12a27","Type":"ContainerStarted","Data":"4d5899c1ae70c57eb817ab5f47816f3c68db9c4cd8533d36eb7a96ac87dd16b7"}
Sep 07 13:57:41.565756 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:41.565732    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 13:57:41.567853 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:41.567460    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-44mrd" event={"ID":"80593104-b03b-4e55-9146-02b5f0f94c9b","Type":"ContainerStarted","Data":"55ef45388f2c1fd0ab7bd342a4d08b696c4bc51eade51058f227c76c5f3d87b6"}
Sep 07 13:57:41.573954 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:41.573871    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kqfcv" event={"ID":"d7c1dfc5-6f69-4094-8899-8762438becac","Type":"ContainerStarted","Data":"a324e3a11fdc9507b225946d41a241e8ee0521dd44a669f97c851a4a02a45366"}
Sep 07 13:57:42.052129 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:42.052091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs\") pod \"network-metrics-daemon-z7zzr\" (UID: \"f487c012-9aff-45d1-af45-3dd071a10e2e\") " pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:57:42.052334 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:42.052305    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 13:57:42.052413 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:42.052375    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs podName:f487c012-9aff-45d1-af45-3dd071a10e2e nodeName:}" failed. No retries permitted until 2026-09-07 13:57:44.052355439 +0000 UTC m=+5.052783814 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs") pod "network-metrics-daemon-z7zzr" (UID: "f487c012-9aff-45d1-af45-3dd071a10e2e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 13:57:42.152478 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:42.152443    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret\") pod \"global-pull-secret-syncer-l6ks2\" (UID: \"73aad428-d904-4b67-aa24-363d9a75d104\") " pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:42.152668 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:42.152526    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcplz\" (UniqueName: \"kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz\") pod \"network-check-target-l6hnr\" (UID: \"4016228e-6351-475d-a718-c2ff55edbfee\") " pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:57:42.152740 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:42.152693    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 13:57:42.152740 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:42.152715    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 13:57:42.152740 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:42.152728    2581 projected.go:196] Error preparing data for projected volume kube-api-access-rcplz for pod openshift-network-diagnostics/network-check-target-l6hnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 13:57:42.152893 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:42.152783    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz podName:4016228e-6351-475d-a718-c2ff55edbfee nodeName:}" failed. No retries permitted until 2026-09-07 13:57:44.152764975 +0000 UTC m=+5.153193360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rcplz" (UniqueName: "kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz") pod "network-check-target-l6hnr" (UID: "4016228e-6351-475d-a718-c2ff55edbfee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 13:57:42.153179 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:42.153160    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 13:57:42.153275 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:42.153206    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret podName:73aad428-d904-4b67-aa24-363d9a75d104 nodeName:}" failed. No retries permitted until 2026-09-07 13:57:44.153195238 +0000 UTC m=+5.153623608 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret") pod "global-pull-secret-syncer-l6ks2" (UID: "73aad428-d904-4b67-aa24-363d9a75d104") : object "kube-system"/"original-pull-secret" not registered
Sep 07 13:57:42.468383 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:42.468256    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 13:52:40 +0000 UTC" deadline="2028-06-10 19:49:57.040385276 +0000 UTC"
Sep 07 13:57:42.468383 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:42.468320    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15413h52m14.572071605s"
Sep 07 13:57:42.515347 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:42.515027    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:57:42.515347 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:42.515192    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7zzr" podUID="f487c012-9aff-45d1-af45-3dd071a10e2e"
Sep 07 13:57:42.515347 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:42.515283    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:42.515637 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:42.515381    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6ks2" podUID="73aad428-d904-4b67-aa24-363d9a75d104"
Sep 07 13:57:43.361275 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:43.361057    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 13:57:43.517147 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:43.517103    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:57:43.517611 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:43.517229    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6hnr" podUID="4016228e-6351-475d-a718-c2ff55edbfee"
Sep 07 13:57:44.069480 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:44.068831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs\") pod \"network-metrics-daemon-z7zzr\" (UID: \"f487c012-9aff-45d1-af45-3dd071a10e2e\") " pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:57:44.069480 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:44.069063    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 13:57:44.069480 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:44.069128    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs podName:f487c012-9aff-45d1-af45-3dd071a10e2e nodeName:}" failed. No retries permitted until 2026-09-07 13:57:48.069109281 +0000 UTC m=+9.069537669 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs") pod "network-metrics-daemon-z7zzr" (UID: "f487c012-9aff-45d1-af45-3dd071a10e2e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 13:57:44.170129 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:44.170081    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret\") pod \"global-pull-secret-syncer-l6ks2\" (UID: \"73aad428-d904-4b67-aa24-363d9a75d104\") " pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:44.170312 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:44.170171    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcplz\" (UniqueName: \"kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz\") pod \"network-check-target-l6hnr\" (UID: \"4016228e-6351-475d-a718-c2ff55edbfee\") " pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:57:44.170386 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:44.170374    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 13:57:44.170441 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:44.170398    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 13:57:44.170441 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:44.170412    2581 projected.go:196] Error preparing data for projected volume kube-api-access-rcplz for pod openshift-network-diagnostics/network-check-target-l6hnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 13:57:44.170542 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:44.170474    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz podName:4016228e-6351-475d-a718-c2ff55edbfee nodeName:}" failed. No retries permitted until 2026-09-07 13:57:48.170455047 +0000 UTC m=+9.170883423 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rcplz" (UniqueName: "kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz") pod "network-check-target-l6hnr" (UID: "4016228e-6351-475d-a718-c2ff55edbfee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 13:57:44.170860 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:44.170726    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 13:57:44.170860 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:44.170806    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret podName:73aad428-d904-4b67-aa24-363d9a75d104 nodeName:}" failed. No retries permitted until 2026-09-07 13:57:48.170786685 +0000 UTC m=+9.171215060 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret") pod "global-pull-secret-syncer-l6ks2" (UID: "73aad428-d904-4b67-aa24-363d9a75d104") : object "kube-system"/"original-pull-secret" not registered
Sep 07 13:57:44.514661 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:44.514554    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:57:44.514822 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:44.514725    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7zzr" podUID="f487c012-9aff-45d1-af45-3dd071a10e2e"
Sep 07 13:57:44.514822 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:44.514766    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:44.514924 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:44.514847    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6ks2" podUID="73aad428-d904-4b67-aa24-363d9a75d104"
Sep 07 13:57:45.514467 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:45.514406    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:57:45.514965 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:45.514543    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6hnr" podUID="4016228e-6351-475d-a718-c2ff55edbfee"
Sep 07 13:57:46.515069 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:46.515031    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:46.515461 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:46.515031    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:57:46.515461 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:46.515151    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6ks2" podUID="73aad428-d904-4b67-aa24-363d9a75d104"
Sep 07 13:57:46.515461 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:46.515220    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7zzr" podUID="f487c012-9aff-45d1-af45-3dd071a10e2e"
Sep 07 13:57:47.515041 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:47.515006    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:57:47.515237 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:47.515144    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6hnr" podUID="4016228e-6351-475d-a718-c2ff55edbfee"
Sep 07 13:57:48.102043 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:48.102010    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs\") pod \"network-metrics-daemon-z7zzr\" (UID: \"f487c012-9aff-45d1-af45-3dd071a10e2e\") " pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:57:48.102238 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:48.102186    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 13:57:48.102322 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:48.102266    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs podName:f487c012-9aff-45d1-af45-3dd071a10e2e nodeName:}" failed. No retries permitted until 2026-09-07 13:57:56.102243972 +0000 UTC m=+17.102672366 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs") pod "network-metrics-daemon-z7zzr" (UID: "f487c012-9aff-45d1-af45-3dd071a10e2e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 13:57:48.203271 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:48.203228    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret\") pod \"global-pull-secret-syncer-l6ks2\" (UID: \"73aad428-d904-4b67-aa24-363d9a75d104\") " pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:48.203471 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:48.203329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcplz\" (UniqueName: \"kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz\") pod \"network-check-target-l6hnr\" (UID: \"4016228e-6351-475d-a718-c2ff55edbfee\") " pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:57:48.203471 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:48.203395    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 13:57:48.203471 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:48.203444    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 13:57:48.203471 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:48.203456    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret podName:73aad428-d904-4b67-aa24-363d9a75d104 nodeName:}" failed. No retries permitted until 2026-09-07 13:57:56.203438865 +0000 UTC m=+17.203867250 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret") pod "global-pull-secret-syncer-l6ks2" (UID: "73aad428-d904-4b67-aa24-363d9a75d104") : object "kube-system"/"original-pull-secret" not registered
Sep 07 13:57:48.203471 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:48.203461    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 13:57:48.203471 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:48.203473    2581 projected.go:196] Error preparing data for projected volume kube-api-access-rcplz for pod openshift-network-diagnostics/network-check-target-l6hnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 13:57:48.203759 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:48.203505    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz podName:4016228e-6351-475d-a718-c2ff55edbfee nodeName:}" failed. No retries permitted until 2026-09-07 13:57:56.203495419 +0000 UTC m=+17.203923795 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rcplz" (UniqueName: "kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz") pod "network-check-target-l6hnr" (UID: "4016228e-6351-475d-a718-c2ff55edbfee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 13:57:48.514671 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:48.514633    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:48.514846 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:48.514772    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6ks2" podUID="73aad428-d904-4b67-aa24-363d9a75d104"
Sep 07 13:57:48.514846 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:48.514821    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:57:48.514981 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:48.514953    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7zzr" podUID="f487c012-9aff-45d1-af45-3dd071a10e2e"
Sep 07 13:57:49.518369 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:49.517916    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:57:49.518369 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:49.518031    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6hnr" podUID="4016228e-6351-475d-a718-c2ff55edbfee"
Sep 07 13:57:50.514132 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:50.514102    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:57:50.514132 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:50.514122    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:50.514382 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:50.514237    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7zzr" podUID="f487c012-9aff-45d1-af45-3dd071a10e2e"
Sep 07 13:57:50.514429 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:50.514384    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6ks2" podUID="73aad428-d904-4b67-aa24-363d9a75d104"
Sep 07 13:57:51.514614 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:51.514573    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:57:51.515153 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:51.514701    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6hnr" podUID="4016228e-6351-475d-a718-c2ff55edbfee"
Sep 07 13:57:52.514302 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:52.514212    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:57:52.514469 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:52.514213    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:52.514469 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:52.514372    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7zzr" podUID="f487c012-9aff-45d1-af45-3dd071a10e2e"
Sep 07 13:57:52.514469 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:52.514415    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6ks2" podUID="73aad428-d904-4b67-aa24-363d9a75d104"
Sep 07 13:57:53.517079 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:53.517046    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:57:53.517489 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:53.517146    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6hnr" podUID="4016228e-6351-475d-a718-c2ff55edbfee"
Sep 07 13:57:54.514214 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:54.514167    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:54.514405 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:54.514229    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:57:54.514405 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:54.514375    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6ks2" podUID="73aad428-d904-4b67-aa24-363d9a75d104"
Sep 07 13:57:54.514564 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:54.514537    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7zzr" podUID="f487c012-9aff-45d1-af45-3dd071a10e2e"
Sep 07 13:57:55.516894 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:55.516870    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:57:55.517276 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:55.516959    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6hnr" podUID="4016228e-6351-475d-a718-c2ff55edbfee"
Sep 07 13:57:56.165626 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:56.165587    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs\") pod \"network-metrics-daemon-z7zzr\" (UID: \"f487c012-9aff-45d1-af45-3dd071a10e2e\") " pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:57:56.165823 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:56.165752    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 13:57:56.165887 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:56.165830    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs podName:f487c012-9aff-45d1-af45-3dd071a10e2e nodeName:}" failed. No retries permitted until 2026-09-07 13:58:12.165807462 +0000 UTC m=+33.166235854 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs") pod "network-metrics-daemon-z7zzr" (UID: "f487c012-9aff-45d1-af45-3dd071a10e2e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 13:57:56.266823 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:56.266780    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcplz\" (UniqueName: \"kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz\") pod \"network-check-target-l6hnr\" (UID: \"4016228e-6351-475d-a718-c2ff55edbfee\") " pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:57:56.267002 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:56.266979    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret\") pod \"global-pull-secret-syncer-l6ks2\" (UID: \"73aad428-d904-4b67-aa24-363d9a75d104\") " pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:56.267064 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:56.266988    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 13:57:56.267107 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:56.267082    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 13:57:56.267107 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:56.267095    2581 projected.go:196] Error preparing data for projected volume kube-api-access-rcplz for pod openshift-network-diagnostics/network-check-target-l6hnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 13:57:56.267270 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:56.267052    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 13:57:56.267270 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:56.267159    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz podName:4016228e-6351-475d-a718-c2ff55edbfee nodeName:}" failed. No retries permitted until 2026-09-07 13:58:12.267137694 +0000 UTC m=+33.267566084 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rcplz" (UniqueName: "kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz") pod "network-check-target-l6hnr" (UID: "4016228e-6351-475d-a718-c2ff55edbfee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 13:57:56.267270 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:56.267202    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret podName:73aad428-d904-4b67-aa24-363d9a75d104 nodeName:}" failed. No retries permitted until 2026-09-07 13:58:12.267186862 +0000 UTC m=+33.267615237 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret") pod "global-pull-secret-syncer-l6ks2" (UID: "73aad428-d904-4b67-aa24-363d9a75d104") : object "kube-system"/"original-pull-secret" not registered
Sep 07 13:57:56.514155 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:56.514076    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:57:56.514155 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:56.514082    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:56.514382 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:56.514207    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7zzr" podUID="f487c012-9aff-45d1-af45-3dd071a10e2e"
Sep 07 13:57:56.514382 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:56.514349    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6ks2" podUID="73aad428-d904-4b67-aa24-363d9a75d104"
Sep 07 13:57:57.517333 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:57.517303    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:57:57.517773 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:57.517432    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6hnr" podUID="4016228e-6351-475d-a718-c2ff55edbfee"
Sep 07 13:57:58.514297 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:58.514240    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:57:58.514297 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:58.514276    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:57:58.514518 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:58.514427    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7zzr" podUID="f487c012-9aff-45d1-af45-3dd071a10e2e"
Sep 07 13:57:58.514613 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:58.514588    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6ks2" podUID="73aad428-d904-4b67-aa24-363d9a75d104"
Sep 07 13:57:59.514621 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:57:59.514595    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:57:59.514895 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:57:59.514679    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6hnr" podUID="4016228e-6351-475d-a718-c2ff55edbfee"
Sep 07 13:58:00.514533 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.514310    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:58:00.514692 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.514366    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:58:00.514692 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:00.514550    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6ks2" podUID="73aad428-d904-4b67-aa24-363d9a75d104"
Sep 07 13:58:00.514692 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:00.514662    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7zzr" podUID="f487c012-9aff-45d1-af45-3dd071a10e2e"
Sep 07 13:58:00.625307 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.625262    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mwtrw" event={"ID":"6e1fe657-72f7-49a7-ad98-1adb910682be","Type":"ContainerStarted","Data":"9876a77c53a1bf19e1aca6a7293e325b27b8143d25de164a85c4e912c79b9060"}
Sep 07 13:58:00.626907 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.626886    2581 generic.go:356] "Generic (PLEG): container finished" podID="2826663e-857c-488f-8102-0845b2f46709" containerID="318ddf7dce955df56c0662eedb4d0abdc733bb41d1fa80552ed9d812e81a7d52" exitCode=0
Sep 07 13:58:00.626960 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.626952    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lwhm" event={"ID":"2826663e-857c-488f-8102-0845b2f46709","Type":"ContainerDied","Data":"318ddf7dce955df56c0662eedb4d0abdc733bb41d1fa80552ed9d812e81a7d52"}
Sep 07 13:58:00.628586 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.628564    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal" event={"ID":"47cc00c1a8f55722dda32e7fd4a06975","Type":"ContainerStarted","Data":"0a8cafeffff8c8c98ff94de912c74e64a9023ae13c2fd8ab70c5987335156d54"}
Sep 07 13:58:00.630140 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.630120    2581 generic.go:356] "Generic (PLEG): container finished" podID="52afddd129028853a2fcf4c4b95c33ca" containerID="6145e40fb78db63bbc2408e351fe74a920ae0b7594ecaac9a203ed5ac7da4c04" exitCode=0
Sep 07 13:58:00.630229 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.630187    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal" event={"ID":"52afddd129028853a2fcf4c4b95c33ca","Type":"ContainerDied","Data":"6145e40fb78db63bbc2408e351fe74a920ae0b7594ecaac9a203ed5ac7da4c04"}
Sep 07 13:58:00.631660 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.631641    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9" event={"ID":"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38","Type":"ContainerStarted","Data":"020b09fd34fdfe6a49f4d6a62c5359eaba7edd6b2466ac9bcf371351c9215fe3"}
Sep 07 13:58:00.633041 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.633020    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mfkdb" event={"ID":"eb770b10-368c-4e07-b98b-bb0dc4a12a27","Type":"ContainerStarted","Data":"cd629910edb9b140a34fe31eb62d831a5c288431dd7eca81c146642c20444a8e"}
Sep 07 13:58:00.634497 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.634446    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-44mrd" event={"ID":"80593104-b03b-4e55-9146-02b5f0f94c9b","Type":"ContainerStarted","Data":"a8c02cba596069e2f4698aea6011f66f97e7f48039de705aa8967771b69e056b"}
Sep 07 13:58:00.635822 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.635802    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kqfcv" event={"ID":"d7c1dfc5-6f69-4094-8899-8762438becac","Type":"ContainerStarted","Data":"bb4689ac4dbbfd26ee0cf2f9d922e87d6104023e830a4f3eaa647239baf4e92c"}
Sep 07 13:58:00.638800 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.638779    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4qnph" event={"ID":"f4e085e4-1e00-4e03-ac87-cdf6155e0f83","Type":"ContainerStarted","Data":"0d14f7521ef631d22062763f305a0f3665b6e817fbdb38cb3ebe05e059787fe2"}
Sep 07 13:58:00.638884 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.638836    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4qnph" event={"ID":"f4e085e4-1e00-4e03-ac87-cdf6155e0f83","Type":"ContainerStarted","Data":"1b06deb85b2ae941c75f8bedd5f0f646e79f7eec88759eb3e4a997c0ecf11d3a"}
Sep 07 13:58:00.638884 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.638876    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4qnph" event={"ID":"f4e085e4-1e00-4e03-ac87-cdf6155e0f83","Type":"ContainerStarted","Data":"b0bbbbf518960e836d586ab268f158864a1d4e3954a3f282aafdae878fc30b36"}
Sep 07 13:58:00.638970 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.638910    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4qnph" event={"ID":"f4e085e4-1e00-4e03-ac87-cdf6155e0f83","Type":"ContainerStarted","Data":"66d39668dd47ba6d94e2c75ec919155c3fbcf4c27b1832d4f6f16b804b9b8542"}
Sep 07 13:58:00.638970 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.638946    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4qnph" event={"ID":"f4e085e4-1e00-4e03-ac87-cdf6155e0f83","Type":"ContainerStarted","Data":"01cd988757ee95597d4404c825e7bf4c041540d3d09167b6922b970198a43431"}
Sep 07 13:58:00.639041 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.638978    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4qnph" event={"ID":"f4e085e4-1e00-4e03-ac87-cdf6155e0f83","Type":"ContainerStarted","Data":"dd0fdaddf151e0affdc80e1fe940a317c72060ccf455ff130ebbc2d8a8745866"}
Sep 07 13:58:00.640344 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.640303    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mwtrw" podStartSLOduration=1.897246539 podStartE2EDuration="20.640275515s" totalImagesPullingTime="18.743028976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:58:00.639676998 +0000 UTC m=+21.640105393" watchObservedRunningTime="2026-09-07 13:58:00.640275515 +0000 UTC m=+21.640703886"
Sep 07 13:58:00.640423 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.640346    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mdmtf" event={"ID":"a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d","Type":"ContainerStarted","Data":"eabf31c69a44e0a5d88e87f6a0d381756732d047c6ec9f24a19664deb0a8dae9"}
Sep 07 13:58:00.666448 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.666391    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-134.ec2.internal" podStartSLOduration=20.66637027 podStartE2EDuration="20.66637027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:57:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:58:00.6657945 +0000 UTC m=+21.666222893" watchObservedRunningTime="2026-09-07 13:58:00.66637027 +0000 UTC m=+21.666798666"
Sep 07 13:58:00.702070 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.702020    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mfkdb" podStartSLOduration=10.673706208 podStartE2EDuration="21.702004941s" totalImagesPullingTime="11.028298733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:58:00.701998448 +0000 UTC m=+21.702426842" watchObservedRunningTime="2026-09-07 13:58:00.702004941 +0000 UTC m=+21.702433334"
Sep 07 13:58:00.718153 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.718111    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kqfcv" podStartSLOduration=3.294410929 podStartE2EDuration="21.718098359s" totalImagesPullingTime="18.42368743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:58:00.717815419 +0000 UTC m=+21.718243813" watchObservedRunningTime="2026-09-07 13:58:00.718098359 +0000 UTC m=+21.718526751"
Sep 07 13:58:00.733925 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.733751    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-44mrd" podStartSLOduration=1.991362147 podStartE2EDuration="20.733726607s" totalImagesPullingTime="18.74236446s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:58:00.73279739 +0000 UTC m=+21.733225784" watchObservedRunningTime="2026-09-07 13:58:00.733726607 +0000 UTC m=+21.734155001"
Sep 07 13:58:00.749516 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:00.749455    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mdmtf" podStartSLOduration=3.231441999 podStartE2EDuration="21.749440434s" totalImagesPullingTime="18.517998435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:58:00.748802892 +0000 UTC m=+21.749231286" watchObservedRunningTime="2026-09-07 13:58:00.749440434 +0000 UTC m=+21.749868827"
Sep 07 13:58:01.224640 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:01.224616    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 07 13:58:01.518891 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:01.518811    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:58:01.519699 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:01.518931    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6hnr" podUID="4016228e-6351-475d-a718-c2ff55edbfee"
Sep 07 13:58:01.626911 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:01.626777    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T13:58:01.22463489Z","UUID":"99fe26f9-ed57-4057-9cf9-cfa444ec3ef2","Handler":null,"Name":"","Endpoint":""}
Sep 07 13:58:01.628358 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:01.628336    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 07 13:58:01.628358 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:01.628365    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 07 13:58:01.644303 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:01.644252    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wdc79" event={"ID":"238e154a-f3f9-49f4-a251-93d41a3b2bdc","Type":"ContainerStarted","Data":"1939f8f7ab4d430ef60b591fbc149a6787d1725720079461bdf33bc284744361"}
Sep 07 13:58:01.646521 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:01.646483    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal" event={"ID":"52afddd129028853a2fcf4c4b95c33ca","Type":"ContainerStarted","Data":"002648a3b14602581811640739d8dd072ee00793d0e040858568c4696a3ca2ad"}
Sep 07 13:58:01.648618 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:01.648589    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9" event={"ID":"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38","Type":"ContainerStarted","Data":"5f8958ff319c4dd1f0d9fcd5a9dde2f1d77162d28c9c8d27523de1a50bfe53fa"}
Sep 07 13:58:01.661107 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:01.661052    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wdc79" podStartSLOduration=2.93162772 podStartE2EDuration="21.661031936s" totalImagesPullingTime="18.729404216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:58:01.66046388 +0000 UTC m=+22.660892274" watchObservedRunningTime="2026-09-07 13:58:01.661031936 +0000 UTC m=+22.661460328"
Sep 07 13:58:01.675907 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:01.675849    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-134.ec2.internal" podStartSLOduration=21.675828156 podStartE2EDuration="21.675828156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:57:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:58:01.674822861 +0000 UTC m=+22.675251255" watchObservedRunningTime="2026-09-07 13:58:01.675828156 +0000 UTC m=+22.676256550"
Sep 07 13:58:02.097036 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:02.096872    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mfkdb"
Sep 07 13:58:02.097637 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:02.097609    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mfkdb"
Sep 07 13:58:02.514145 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:02.514084    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:58:02.514145 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:02.514140    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:58:02.514388 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:02.514273    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7zzr" podUID="f487c012-9aff-45d1-af45-3dd071a10e2e"
Sep 07 13:58:02.514388 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:02.514369    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6ks2" podUID="73aad428-d904-4b67-aa24-363d9a75d104"
Sep 07 13:58:02.653707 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:02.653613    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9" event={"ID":"945c28a6-bcd8-4de3-bbb7-e29ee0eeab38","Type":"ContainerStarted","Data":"41bd8aa1a84b439ca025c63109c984d391bc91eab9b58aeb79007e670f75d258"}
Sep 07 13:58:02.657457 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:02.657424    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4qnph" event={"ID":"f4e085e4-1e00-4e03-ac87-cdf6155e0f83","Type":"ContainerStarted","Data":"4b11da3b684b25dc7bfa8694db801d2ed2ffcf02705898b5d5cfecd770203a5a"}
Sep 07 13:58:02.657988 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:02.657962    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mfkdb"
Sep 07 13:58:02.658426 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:02.658412    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mfkdb"
Sep 07 13:58:02.670611 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:02.670537    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsqt9" podStartSLOduration=3.37755028 podStartE2EDuration="23.670515836s" totalImagesPullingTime="20.292965556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:57:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:58:02.670082022 +0000 UTC m=+23.670510415" watchObservedRunningTime="2026-09-07 13:58:02.670515836 +0000 UTC m=+23.670944232"
Sep 07 13:58:03.515095 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:03.514868    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:58:03.515378 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:03.515202    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6hnr" podUID="4016228e-6351-475d-a718-c2ff55edbfee"
Sep 07 13:58:04.515095 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:04.515058    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:58:04.515566 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:04.515107    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:58:04.515566 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:04.515202    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7zzr" podUID="f487c012-9aff-45d1-af45-3dd071a10e2e"
Sep 07 13:58:04.515566 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:04.515351    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6ks2" podUID="73aad428-d904-4b67-aa24-363d9a75d104"
Sep 07 13:58:05.514721 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:05.514687    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:58:05.514896 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:05.514837    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6hnr" podUID="4016228e-6351-475d-a718-c2ff55edbfee"
Sep 07 13:58:06.514655 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:06.514486    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:58:06.515079 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:06.514486    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:58:06.515079 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:06.514726    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6ks2" podUID="73aad428-d904-4b67-aa24-363d9a75d104"
Sep 07 13:58:06.515079 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:06.514842    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7zzr" podUID="f487c012-9aff-45d1-af45-3dd071a10e2e"
Sep 07 13:58:06.669605 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:06.669573    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4qnph" event={"ID":"f4e085e4-1e00-4e03-ac87-cdf6155e0f83","Type":"ContainerStarted","Data":"0e86eae02604d2608eab2d4c0dc6e216fecd7c57129a997bb364a6ac06e603e3"}
Sep 07 13:58:06.669841 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:06.669816    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:58:06.671658 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:06.671633    2581 generic.go:356] "Generic (PLEG): container finished" podID="2826663e-857c-488f-8102-0845b2f46709" containerID="0d0554f28a9e5c1a9d1e26ec8669a69e457461c68ac47e43f5dad6e07a64dfd2" exitCode=0
Sep 07 13:58:06.671753 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:06.671683    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lwhm" event={"ID":"2826663e-857c-488f-8102-0845b2f46709","Type":"ContainerDied","Data":"0d0554f28a9e5c1a9d1e26ec8669a69e457461c68ac47e43f5dad6e07a64dfd2"}
Sep 07 13:58:06.685376 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:06.685355    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:58:06.702241 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:06.701239    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4qnph" podStartSLOduration=9.152536783 podStartE2EDuration="27.701219721s" totalImagesPullingTime="18.548682938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:58:06.700886973 +0000 UTC m=+27.701315367" watchObservedRunningTime="2026-09-07 13:58:06.701219721 +0000 UTC m=+27.701648162"
Sep 07 13:58:07.515104 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:07.515079    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:58:07.515487 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:07.515236    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6hnr" podUID="4016228e-6351-475d-a718-c2ff55edbfee"
Sep 07 13:58:07.664587 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:07.664552    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l6ks2"]
Sep 07 13:58:07.664761 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:07.664693    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:58:07.664831 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:07.664805    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6ks2" podUID="73aad428-d904-4b67-aa24-363d9a75d104"
Sep 07 13:58:07.667581 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:07.667552    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l6hnr"]
Sep 07 13:58:07.668364 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:07.668338    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z7zzr"]
Sep 07 13:58:07.668468 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:07.668460    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:58:07.668594 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:07.668575    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7zzr" podUID="f487c012-9aff-45d1-af45-3dd071a10e2e"
Sep 07 13:58:07.676355 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:07.676331    2581 generic.go:356] "Generic (PLEG): container finished" podID="2826663e-857c-488f-8102-0845b2f46709" containerID="651639044f9eb01922683b5d4e2b35e6440575e88d936a8e2689636f74ca2616" exitCode=0
Sep 07 13:58:07.676470 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:07.676406    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lwhm" event={"ID":"2826663e-857c-488f-8102-0845b2f46709","Type":"ContainerDied","Data":"651639044f9eb01922683b5d4e2b35e6440575e88d936a8e2689636f74ca2616"}
Sep 07 13:58:07.676669 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:07.676643    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:58:07.676778 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:07.676743    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6hnr" podUID="4016228e-6351-475d-a718-c2ff55edbfee"
Sep 07 13:58:07.676852 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:07.676837    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:58:07.677404 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:07.677278    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:58:07.693969 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:07.693899    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:58:09.515527 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:09.515494    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:58:09.516106 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:09.515587    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6ks2" podUID="73aad428-d904-4b67-aa24-363d9a75d104"
Sep 07 13:58:09.516106 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:09.515636    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:58:09.516106 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:09.515700    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6hnr" podUID="4016228e-6351-475d-a718-c2ff55edbfee"
Sep 07 13:58:09.516106 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:09.515740    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:58:09.516106 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:09.515866    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7zzr" podUID="f487c012-9aff-45d1-af45-3dd071a10e2e"
Sep 07 13:58:09.682457 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:09.682379    2581 generic.go:356] "Generic (PLEG): container finished" podID="2826663e-857c-488f-8102-0845b2f46709" containerID="87857d24f5ae0ccb2e3b0db94b48f061e89c9c626a67132565327a88f1ed1b49" exitCode=0
Sep 07 13:58:09.682591 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:09.682457    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lwhm" event={"ID":"2826663e-857c-488f-8102-0845b2f46709","Type":"ContainerDied","Data":"87857d24f5ae0ccb2e3b0db94b48f061e89c9c626a67132565327a88f1ed1b49"}
Sep 07 13:58:11.515021 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:11.514793    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:58:11.515471 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:11.514792    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:58:11.515471 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:11.515116    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l6hnr" podUID="4016228e-6351-475d-a718-c2ff55edbfee"
Sep 07 13:58:11.515471 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:11.515200    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l6ks2" podUID="73aad428-d904-4b67-aa24-363d9a75d104"
Sep 07 13:58:11.515471 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:11.514792    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:58:11.515471 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:11.515332    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7zzr" podUID="f487c012-9aff-45d1-af45-3dd071a10e2e"
Sep 07 13:58:12.175395 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:12.175364    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs\") pod \"network-metrics-daemon-z7zzr\" (UID: \"f487c012-9aff-45d1-af45-3dd071a10e2e\") " pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:58:12.175597 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:12.175499    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 13:58:12.175597 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:12.175559    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs podName:f487c012-9aff-45d1-af45-3dd071a10e2e nodeName:}" failed. No retries permitted until 2026-09-07 13:58:44.175539109 +0000 UTC m=+65.175967493 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs") pod "network-metrics-daemon-z7zzr" (UID: "f487c012-9aff-45d1-af45-3dd071a10e2e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 13:58:12.276062 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:12.276030    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret\") pod \"global-pull-secret-syncer-l6ks2\" (UID: \"73aad428-d904-4b67-aa24-363d9a75d104\") " pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:58:12.276201 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:12.276077    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcplz\" (UniqueName: \"kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz\") pod \"network-check-target-l6hnr\" (UID: \"4016228e-6351-475d-a718-c2ff55edbfee\") " pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:58:12.276201 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:12.276164    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 13:58:12.276201 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:12.276173    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 13:58:12.276201 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:12.276188    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 13:58:12.276201 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:12.276196    2581 projected.go:196] Error preparing data for projected volume kube-api-access-rcplz for pod openshift-network-diagnostics/network-check-target-l6hnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 13:58:12.276393 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:12.276224    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret podName:73aad428-d904-4b67-aa24-363d9a75d104 nodeName:}" failed. No retries permitted until 2026-09-07 13:58:44.276206591 +0000 UTC m=+65.276634968 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret") pod "global-pull-secret-syncer-l6ks2" (UID: "73aad428-d904-4b67-aa24-363d9a75d104") : object "kube-system"/"original-pull-secret" not registered
Sep 07 13:58:12.276393 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:12.276237    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz podName:4016228e-6351-475d-a718-c2ff55edbfee nodeName:}" failed. No retries permitted until 2026-09-07 13:58:44.276231836 +0000 UTC m=+65.276660206 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rcplz" (UniqueName: "kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz") pod "network-check-target-l6hnr" (UID: "4016228e-6351-475d-a718-c2ff55edbfee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 13:58:13.283754 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.283722    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-134.ec2.internal" event="NodeReady"
Sep 07 13:58:13.284213 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.283879    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 07 13:58:13.321324 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.321282    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-748b686f65-q9rz7"]
Sep 07 13:58:13.338217 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.338181    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.345008 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.344979    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 07 13:58:13.345160 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.344993    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 07 13:58:13.345261 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.345242    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 07 13:58:13.345471 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.345447    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-d97bl\""
Sep 07 13:58:13.358404 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.358373    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 07 13:58:13.359482 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.359343    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-748b686f65-q9rz7"]
Sep 07 13:58:13.360607 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.360572    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9qh6w"]
Sep 07 13:58:13.374075 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.374045    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sxmvt"]
Sep 07 13:58:13.374221 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.374174    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:58:13.376918 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.376866    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 07 13:58:13.377123 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.377108    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 07 13:58:13.377210 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.377127    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4n9w8\""
Sep 07 13:58:13.386353 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.386331    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9qh6w"]
Sep 07 13:58:13.386444 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.386419    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sxmvt"
Sep 07 13:58:13.388856 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.388830    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sxmvt"]
Sep 07 13:58:13.389548 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.389528    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 07 13:58:13.389650 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.389628    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vrb2s\""
Sep 07 13:58:13.397574 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.397554    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 07 13:58:13.397666 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.397625    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 07 13:58:13.483787 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.483697    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39e32f83-7ada-441f-ae68-282d20bb4698-cert\") pod \"ingress-canary-sxmvt\" (UID: \"39e32f83-7ada-441f-ae68-282d20bb4698\") " pod="openshift-ingress-canary/ingress-canary-sxmvt"
Sep 07 13:58:13.483787 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.483739    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54faae80-3d59-4007-8e7d-8226638369fe-ca-trust-extracted\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.483787 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.483761    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54faae80-3d59-4007-8e7d-8226638369fe-registry-certificates\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.484052 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.483804    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54faae80-3d59-4007-8e7d-8226638369fe-trusted-ca\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.484052 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.483829    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69fd2a51-3aad-48e2-938e-7bc82deab21a-tmp-dir\") pod \"dns-default-9qh6w\" (UID: \"69fd2a51-3aad-48e2-938e-7bc82deab21a\") " pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:58:13.484052 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.483878    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls\") pod \"dns-default-9qh6w\" (UID: \"69fd2a51-3aad-48e2-938e-7bc82deab21a\") " pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:58:13.484052 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.483898    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn7mw\" (UniqueName: \"kubernetes.io/projected/39e32f83-7ada-441f-ae68-282d20bb4698-kube-api-access-dn7mw\") pod \"ingress-canary-sxmvt\" (UID: \"39e32f83-7ada-441f-ae68-282d20bb4698\") " pod="openshift-ingress-canary/ingress-canary-sxmvt"
Sep 07 13:58:13.484052 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.483945    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54faae80-3d59-4007-8e7d-8226638369fe-installation-pull-secrets\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.484052 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.484003    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/69fd2a51-3aad-48e2-938e-7bc82deab21a-config-volume\") pod \"dns-default-9qh6w\" (UID: \"69fd2a51-3aad-48e2-938e-7bc82deab21a\") " pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:58:13.484052 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.484043    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t82g\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-kube-api-access-9t82g\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.484351 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.484072    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54faae80-3d59-4007-8e7d-8226638369fe-image-registry-private-configuration\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.484351 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.484097    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7ntq\" (UniqueName: \"kubernetes.io/projected/69fd2a51-3aad-48e2-938e-7bc82deab21a-kube-api-access-z7ntq\") pod \"dns-default-9qh6w\" (UID: \"69fd2a51-3aad-48e2-938e-7bc82deab21a\") " pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:58:13.484351 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.484140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.484351 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.484159    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-bound-sa-token\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.514992 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.514960    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:58:13.514992 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.514985    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:58:13.514992 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.514960    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:58:13.517725 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.517690    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 13:58:13.517849 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.517749    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k4wzp\""
Sep 07 13:58:13.517849 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.517795    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 13:58:13.517943 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.517690    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5p88d\""
Sep 07 13:58:13.518002 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.517988    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 13:58:13.518093 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.518074    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 13:58:13.585056 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.585017    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39e32f83-7ada-441f-ae68-282d20bb4698-cert\") pod \"ingress-canary-sxmvt\" (UID: \"39e32f83-7ada-441f-ae68-282d20bb4698\") " pod="openshift-ingress-canary/ingress-canary-sxmvt"
Sep 07 13:58:13.585255 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.585065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54faae80-3d59-4007-8e7d-8226638369fe-ca-trust-extracted\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.585255 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.585094    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54faae80-3d59-4007-8e7d-8226638369fe-registry-certificates\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.585255 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.585124    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54faae80-3d59-4007-8e7d-8226638369fe-trusted-ca\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.585255 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.585148    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69fd2a51-3aad-48e2-938e-7bc82deab21a-tmp-dir\") pod \"dns-default-9qh6w\" (UID: \"69fd2a51-3aad-48e2-938e-7bc82deab21a\") " pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:58:13.585255 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.585175    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls\") pod \"dns-default-9qh6w\" (UID: \"69fd2a51-3aad-48e2-938e-7bc82deab21a\") " pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:58:13.585255 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.585204    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn7mw\" (UniqueName: \"kubernetes.io/projected/39e32f83-7ada-441f-ae68-282d20bb4698-kube-api-access-dn7mw\") pod \"ingress-canary-sxmvt\" (UID: \"39e32f83-7ada-441f-ae68-282d20bb4698\") " pod="openshift-ingress-canary/ingress-canary-sxmvt"
Sep 07 13:58:13.585255 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.585253    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54faae80-3d59-4007-8e7d-8226638369fe-installation-pull-secrets\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.585625 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.585284    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/69fd2a51-3aad-48e2-938e-7bc82deab21a-config-volume\") pod \"dns-default-9qh6w\" (UID: \"69fd2a51-3aad-48e2-938e-7bc82deab21a\") " pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:58:13.585625 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.585327    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t82g\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-kube-api-access-9t82g\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.585625 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.585354    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54faae80-3d59-4007-8e7d-8226638369fe-image-registry-private-configuration\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.585625 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.585381    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7ntq\" (UniqueName: \"kubernetes.io/projected/69fd2a51-3aad-48e2-938e-7bc82deab21a-kube-api-access-z7ntq\") pod \"dns-default-9qh6w\" (UID: \"69fd2a51-3aad-48e2-938e-7bc82deab21a\") " pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:58:13.585625 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.585436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.585625 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.585458    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-bound-sa-token\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.585625 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.585527    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54faae80-3d59-4007-8e7d-8226638369fe-ca-trust-extracted\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.585625 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.585527    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69fd2a51-3aad-48e2-938e-7bc82deab21a-tmp-dir\") pod \"dns-default-9qh6w\" (UID: \"69fd2a51-3aad-48e2-938e-7bc82deab21a\") " pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:58:13.585983 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:13.585769    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 13:58:13.585983 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:13.585829    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls podName:69fd2a51-3aad-48e2-938e-7bc82deab21a nodeName:}" failed. No retries permitted until 2026-09-07 13:58:14.085809372 +0000 UTC m=+35.086237759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls") pod "dns-default-9qh6w" (UID: "69fd2a51-3aad-48e2-938e-7bc82deab21a") : secret "dns-default-metrics-tls" not found
Sep 07 13:58:13.586098 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.585991    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/69fd2a51-3aad-48e2-938e-7bc82deab21a-config-volume\") pod \"dns-default-9qh6w\" (UID: \"69fd2a51-3aad-48e2-938e-7bc82deab21a\") " pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:58:13.586098 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:13.586080    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 13:58:13.586098 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:13.586093    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-748b686f65-q9rz7: secret "image-registry-tls" not found
Sep 07 13:58:13.586244 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:13.586137    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls podName:54faae80-3d59-4007-8e7d-8226638369fe nodeName:}" failed. No retries permitted until 2026-09-07 13:58:14.086125141 +0000 UTC m=+35.086553512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls") pod "image-registry-748b686f65-q9rz7" (UID: "54faae80-3d59-4007-8e7d-8226638369fe") : secret "image-registry-tls" not found
Sep 07 13:58:13.586337 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.586283    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54faae80-3d59-4007-8e7d-8226638369fe-registry-certificates\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.589724 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.589701    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54faae80-3d59-4007-8e7d-8226638369fe-image-registry-private-configuration\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.589847 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.589736    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39e32f83-7ada-441f-ae68-282d20bb4698-cert\") pod \"ingress-canary-sxmvt\" (UID: \"39e32f83-7ada-441f-ae68-282d20bb4698\") " pod="openshift-ingress-canary/ingress-canary-sxmvt"
Sep 07 13:58:13.590242 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.590222    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54faae80-3d59-4007-8e7d-8226638369fe-installation-pull-secrets\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.594342 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.594317    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54faae80-3d59-4007-8e7d-8226638369fe-trusted-ca\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.604214 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.604184    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7ntq\" (UniqueName: \"kubernetes.io/projected/69fd2a51-3aad-48e2-938e-7bc82deab21a-kube-api-access-z7ntq\") pod \"dns-default-9qh6w\" (UID: \"69fd2a51-3aad-48e2-938e-7bc82deab21a\") " pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:58:13.604377 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.604282    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn7mw\" (UniqueName: \"kubernetes.io/projected/39e32f83-7ada-441f-ae68-282d20bb4698-kube-api-access-dn7mw\") pod \"ingress-canary-sxmvt\" (UID: \"39e32f83-7ada-441f-ae68-282d20bb4698\") " pod="openshift-ingress-canary/ingress-canary-sxmvt"
Sep 07 13:58:13.604441 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.604408    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t82g\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-kube-api-access-9t82g\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.604763 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.604741    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-bound-sa-token\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:13.690143 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.690104    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mfkdb_eb770b10-368c-4e07-b98b-bb0dc4a12a27/konnectivity-agent/0.log" limit=1024
Sep 07 13:58:13.697233 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:13.697202    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sxmvt"
Sep 07 13:58:14.089771 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:14.089737    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:14.089988 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:14.089800    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls\") pod \"dns-default-9qh6w\" (UID: \"69fd2a51-3aad-48e2-938e-7bc82deab21a\") " pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:58:14.089988 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:14.089915    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 13:58:14.090099 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:14.089920    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 13:58:14.090099 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:14.090017    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-748b686f65-q9rz7: secret "image-registry-tls" not found
Sep 07 13:58:14.090099 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:14.090000    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls podName:69fd2a51-3aad-48e2-938e-7bc82deab21a nodeName:}" failed. No retries permitted until 2026-09-07 13:58:15.089979169 +0000 UTC m=+36.090407544 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls") pod "dns-default-9qh6w" (UID: "69fd2a51-3aad-48e2-938e-7bc82deab21a") : secret "dns-default-metrics-tls" not found
Sep 07 13:58:14.090218 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:14.090110    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls podName:54faae80-3d59-4007-8e7d-8226638369fe nodeName:}" failed. No retries permitted until 2026-09-07 13:58:15.090088825 +0000 UTC m=+36.090517201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls") pod "image-registry-748b686f65-q9rz7" (UID: "54faae80-3d59-4007-8e7d-8226638369fe") : secret "image-registry-tls" not found
Sep 07 13:58:14.530720 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:14.530638    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sxmvt"]
Sep 07 13:58:14.553577 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:58:14.553542    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39e32f83_7ada_441f_ae68_282d20bb4698.slice/crio-ca1874c7d849bf5d0ee31469269fd0f5db901badc9b381ba8ed50494c753ab9f WatchSource:0}: Error finding container ca1874c7d849bf5d0ee31469269fd0f5db901badc9b381ba8ed50494c753ab9f: Status 404 returned error can't find the container with id ca1874c7d849bf5d0ee31469269fd0f5db901badc9b381ba8ed50494c753ab9f
Sep 07 13:58:14.695004 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:14.694973    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sxmvt" event={"ID":"39e32f83-7ada-441f-ae68-282d20bb4698","Type":"ContainerStarted","Data":"ca1874c7d849bf5d0ee31469269fd0f5db901badc9b381ba8ed50494c753ab9f"}
Sep 07 13:58:14.949994 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:14.949963    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mfkdb_eb770b10-368c-4e07-b98b-bb0dc4a12a27/konnectivity-agent/0.log" limit=1024
Sep 07 13:58:15.097705 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:15.097668    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls\") pod \"dns-default-9qh6w\" (UID: \"69fd2a51-3aad-48e2-938e-7bc82deab21a\") " pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:58:15.098035 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:15.097781    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:15.098035 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:15.097835    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 13:58:15.098035 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:15.097890    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 13:58:15.098035 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:15.097904    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-748b686f65-q9rz7: secret "image-registry-tls" not found
Sep 07 13:58:15.098035 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:15.097914    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls podName:69fd2a51-3aad-48e2-938e-7bc82deab21a nodeName:}" failed. No retries permitted until 2026-09-07 13:58:17.097892431 +0000 UTC m=+38.098320808 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls") pod "dns-default-9qh6w" (UID: "69fd2a51-3aad-48e2-938e-7bc82deab21a") : secret "dns-default-metrics-tls" not found
Sep 07 13:58:15.098035 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:15.097954    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls podName:54faae80-3d59-4007-8e7d-8226638369fe nodeName:}" failed. No retries permitted until 2026-09-07 13:58:17.097937899 +0000 UTC m=+38.098366304 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls") pod "image-registry-748b686f65-q9rz7" (UID: "54faae80-3d59-4007-8e7d-8226638369fe") : secret "image-registry-tls" not found
Sep 07 13:58:15.701177 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:15.700981    2581 generic.go:356] "Generic (PLEG): container finished" podID="2826663e-857c-488f-8102-0845b2f46709" containerID="3eecf7b7ab05b9f13d82b4a32a7ce071191b94fe47baafdcc13a4d066d03bc54" exitCode=0
Sep 07 13:58:15.701177 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:15.701065    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lwhm" event={"ID":"2826663e-857c-488f-8102-0845b2f46709","Type":"ContainerDied","Data":"3eecf7b7ab05b9f13d82b4a32a7ce071191b94fe47baafdcc13a4d066d03bc54"}
Sep 07 13:58:16.707654 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:16.707616    2581 generic.go:356] "Generic (PLEG): container finished" podID="2826663e-857c-488f-8102-0845b2f46709" containerID="8ddc02ec0baccaedc38795399b0346d92992f13262310b71fe58a2819be759dd" exitCode=0
Sep 07 13:58:16.708137 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:16.707674    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lwhm" event={"ID":"2826663e-857c-488f-8102-0845b2f46709","Type":"ContainerDied","Data":"8ddc02ec0baccaedc38795399b0346d92992f13262310b71fe58a2819be759dd"}
Sep 07 13:58:17.116428 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:17.116397    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls\") pod \"dns-default-9qh6w\" (UID: \"69fd2a51-3aad-48e2-938e-7bc82deab21a\") " pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:58:17.116544 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:17.116478    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:17.116597 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:17.116548    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 13:58:17.116597 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:17.116561    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 13:58:17.116597 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:17.116571    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-748b686f65-q9rz7: secret "image-registry-tls" not found
Sep 07 13:58:17.116748 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:17.116617    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls podName:69fd2a51-3aad-48e2-938e-7bc82deab21a nodeName:}" failed. No retries permitted until 2026-09-07 13:58:21.116597981 +0000 UTC m=+42.117026351 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls") pod "dns-default-9qh6w" (UID: "69fd2a51-3aad-48e2-938e-7bc82deab21a") : secret "dns-default-metrics-tls" not found
Sep 07 13:58:17.116748 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:17.116633    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls podName:54faae80-3d59-4007-8e7d-8226638369fe nodeName:}" failed. No retries permitted until 2026-09-07 13:58:21.116627131 +0000 UTC m=+42.117055502 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls") pod "image-registry-748b686f65-q9rz7" (UID: "54faae80-3d59-4007-8e7d-8226638369fe") : secret "image-registry-tls" not found
Sep 07 13:58:17.711790 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:17.711693    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sxmvt" event={"ID":"39e32f83-7ada-441f-ae68-282d20bb4698","Type":"ContainerStarted","Data":"f8658c1ab96f13fa2d233c85954130b6fb3544ebffbb2a6cd4392fb8aaa6ee66"}
Sep 07 13:58:17.715451 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:17.715425    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lwhm" event={"ID":"2826663e-857c-488f-8102-0845b2f46709","Type":"ContainerStarted","Data":"dd898b7ad0639566ab85d827b4fb6668232f209cbde335723495f754850a37bc"}
Sep 07 13:58:17.728938 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:17.728875    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sxmvt" podStartSLOduration=1.851340633 podStartE2EDuration="4.728854137s" totalImagesPullingTime="2.877513504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:58:17.728383575 +0000 UTC m=+38.728811970" watchObservedRunningTime="2026-09-07 13:58:17.728854137 +0000 UTC m=+38.729282546"
Sep 07 13:58:17.753240 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:17.753176    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6lwhm" podStartSLOduration=7.899201281 podStartE2EDuration="38.753155575s" totalImagesPullingTime="30.853954294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:57:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:58:17.753140337 +0000 UTC m=+38.753568742" watchObservedRunningTime="2026-09-07 13:58:17.753155575 +0000 UTC m=+38.753583969"
Sep 07 13:58:21.145641 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:21.145595    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:21.146027 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:21.145663    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls\") pod \"dns-default-9qh6w\" (UID: \"69fd2a51-3aad-48e2-938e-7bc82deab21a\") " pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:58:21.146027 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:21.145760    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 13:58:21.146027 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:21.145769    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 13:58:21.146027 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:21.145778    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-748b686f65-q9rz7: secret "image-registry-tls" not found
Sep 07 13:58:21.146027 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:21.145832    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls podName:54faae80-3d59-4007-8e7d-8226638369fe nodeName:}" failed. No retries permitted until 2026-09-07 13:58:29.145814626 +0000 UTC m=+50.146243000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls") pod "image-registry-748b686f65-q9rz7" (UID: "54faae80-3d59-4007-8e7d-8226638369fe") : secret "image-registry-tls" not found
Sep 07 13:58:21.146027 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:21.145847    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls podName:69fd2a51-3aad-48e2-938e-7bc82deab21a nodeName:}" failed. No retries permitted until 2026-09-07 13:58:29.145841423 +0000 UTC m=+50.146269794 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls") pod "dns-default-9qh6w" (UID: "69fd2a51-3aad-48e2-938e-7bc82deab21a") : secret "dns-default-metrics-tls" not found
Sep 07 13:58:29.202542 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:29.202488    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:29.202934 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:29.202564    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls\") pod \"dns-default-9qh6w\" (UID: \"69fd2a51-3aad-48e2-938e-7bc82deab21a\") " pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:58:29.202934 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:29.202664    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 13:58:29.202934 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:29.202669    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 13:58:29.202934 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:29.202689    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-748b686f65-q9rz7: secret "image-registry-tls" not found
Sep 07 13:58:29.202934 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:29.202745    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls podName:69fd2a51-3aad-48e2-938e-7bc82deab21a nodeName:}" failed. No retries permitted until 2026-09-07 13:58:45.202726092 +0000 UTC m=+66.203154477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls") pod "dns-default-9qh6w" (UID: "69fd2a51-3aad-48e2-938e-7bc82deab21a") : secret "dns-default-metrics-tls" not found
Sep 07 13:58:29.202934 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:29.202758    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls podName:54faae80-3d59-4007-8e7d-8226638369fe nodeName:}" failed. No retries permitted until 2026-09-07 13:58:45.202752362 +0000 UTC m=+66.203180733 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls") pod "image-registry-748b686f65-q9rz7" (UID: "54faae80-3d59-4007-8e7d-8226638369fe") : secret "image-registry-tls" not found
Sep 07 13:58:39.697353 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:39.697323    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4qnph"
Sep 07 13:58:44.212270 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:44.212224    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs\") pod \"network-metrics-daemon-z7zzr\" (UID: \"f487c012-9aff-45d1-af45-3dd071a10e2e\") " pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:58:44.214996 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:44.214975    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 13:58:44.223101 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:44.223077    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 07 13:58:44.223188 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:44.223140    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs podName:f487c012-9aff-45d1-af45-3dd071a10e2e nodeName:}" failed. No retries permitted until 2026-09-07 13:59:48.223124285 +0000 UTC m=+129.223552656 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs") pod "network-metrics-daemon-z7zzr" (UID: "f487c012-9aff-45d1-af45-3dd071a10e2e") : secret "metrics-daemon-secret" not found
Sep 07 13:58:44.313546 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:44.313494    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcplz\" (UniqueName: \"kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz\") pod \"network-check-target-l6hnr\" (UID: \"4016228e-6351-475d-a718-c2ff55edbfee\") " pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:58:44.313695 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:44.313568    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret\") pod \"global-pull-secret-syncer-l6ks2\" (UID: \"73aad428-d904-4b67-aa24-363d9a75d104\") " pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:58:44.316578 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:44.316558    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 13:58:44.316681 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:44.316568    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 13:58:44.326925 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:44.326905    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 13:58:44.327831 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:44.327816    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73aad428-d904-4b67-aa24-363d9a75d104-original-pull-secret\") pod \"global-pull-secret-syncer-l6ks2\" (UID: \"73aad428-d904-4b67-aa24-363d9a75d104\") " pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:58:44.336941 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:44.336911    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcplz\" (UniqueName: \"kubernetes.io/projected/4016228e-6351-475d-a718-c2ff55edbfee-kube-api-access-rcplz\") pod \"network-check-target-l6hnr\" (UID: \"4016228e-6351-475d-a718-c2ff55edbfee\") " pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:58:44.428813 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:44.428779    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k4wzp\""
Sep 07 13:58:44.436500 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:44.436477    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:58:44.440093 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:44.440075    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l6ks2"
Sep 07 13:58:44.713542 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:44.713504    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l6hnr"]
Sep 07 13:58:44.715591 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:44.715569    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l6ks2"]
Sep 07 13:58:44.716193 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:58:44.716167    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4016228e_6351_475d_a718_c2ff55edbfee.slice/crio-6f149a4e2c0c676e19d8e4f9ecfe1f21a68cd99536cde635b260c4c84c44504d WatchSource:0}: Error finding container 6f149a4e2c0c676e19d8e4f9ecfe1f21a68cd99536cde635b260c4c84c44504d: Status 404 returned error can't find the container with id 6f149a4e2c0c676e19d8e4f9ecfe1f21a68cd99536cde635b260c4c84c44504d
Sep 07 13:58:44.718369 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:58:44.718348    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73aad428_d904_4b67_aa24_363d9a75d104.slice/crio-1b8ed5bfeaf3f266cd2ed4907712ee9e71c06e405bbf05a087705033aa3e5837 WatchSource:0}: Error finding container 1b8ed5bfeaf3f266cd2ed4907712ee9e71c06e405bbf05a087705033aa3e5837: Status 404 returned error can't find the container with id 1b8ed5bfeaf3f266cd2ed4907712ee9e71c06e405bbf05a087705033aa3e5837
Sep 07 13:58:44.782578 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:44.782500    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l6hnr" event={"ID":"4016228e-6351-475d-a718-c2ff55edbfee","Type":"ContainerStarted","Data":"6f149a4e2c0c676e19d8e4f9ecfe1f21a68cd99536cde635b260c4c84c44504d"}
Sep 07 13:58:44.783531 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:44.783510    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l6ks2" event={"ID":"73aad428-d904-4b67-aa24-363d9a75d104","Type":"ContainerStarted","Data":"1b8ed5bfeaf3f266cd2ed4907712ee9e71c06e405bbf05a087705033aa3e5837"}
Sep 07 13:58:45.221010 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:45.220973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:58:45.221475 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:45.221039    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls\") pod \"dns-default-9qh6w\" (UID: \"69fd2a51-3aad-48e2-938e-7bc82deab21a\") " pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:58:45.221475 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:45.221158    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 13:58:45.221475 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:45.221169    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 13:58:45.221475 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:45.221191    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-748b686f65-q9rz7: secret "image-registry-tls" not found
Sep 07 13:58:45.221475 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:45.221230    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls podName:69fd2a51-3aad-48e2-938e-7bc82deab21a nodeName:}" failed. No retries permitted until 2026-09-07 13:59:17.221207422 +0000 UTC m=+98.221635808 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls") pod "dns-default-9qh6w" (UID: "69fd2a51-3aad-48e2-938e-7bc82deab21a") : secret "dns-default-metrics-tls" not found
Sep 07 13:58:45.221475 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:45.221249    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls podName:54faae80-3d59-4007-8e7d-8226638369fe nodeName:}" failed. No retries permitted until 2026-09-07 13:59:17.221239868 +0000 UTC m=+98.221668242 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls") pod "image-registry-748b686f65-q9rz7" (UID: "54faae80-3d59-4007-8e7d-8226638369fe") : secret "image-registry-tls" not found
Sep 07 13:58:49.797242 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:49.797142    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l6ks2" event={"ID":"73aad428-d904-4b67-aa24-363d9a75d104","Type":"ContainerStarted","Data":"ed4fdd4a8a81b7e6dba2f67bdf9994d1e0b7c5d78b11f786cf52de6be5e0aac3"}
Sep 07 13:58:49.798619 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:49.798595    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l6hnr" event={"ID":"4016228e-6351-475d-a718-c2ff55edbfee","Type":"ContainerStarted","Data":"94aec1f7ee7a91dc965efb05c7e22cec2f341e7365b2b001daa73a8dca62289f"}
Sep 07 13:58:49.798723 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:49.798650    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:58:49.817041 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:49.816996    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-l6ks2" podStartSLOduration=65.078936719 podStartE2EDuration="1m9.816983211s" totalImagesPullingTime="4.738046492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:58:49.816493001 +0000 UTC m=+70.816921394" watchObservedRunningTime="2026-09-07 13:58:49.816983211 +0000 UTC m=+70.817411604"
Sep 07 13:58:49.832749 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:49.832709    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-l6hnr" podStartSLOduration=66.096923605 podStartE2EDuration="1m10.832695314s" totalImagesPullingTime="4.735771709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:58:49.832454385 +0000 UTC m=+70.832882779" watchObservedRunningTime="2026-09-07 13:58:49.832695314 +0000 UTC m=+70.833123727"
Sep 07 13:58:55.347448 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.347406    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vkrjq"]
Sep 07 13:58:55.350701 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.350678    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-br4lq"]
Sep 07 13:58:55.350822 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.350804    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vkrjq"
Sep 07 13:58:55.353144 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.353124    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 07 13:58:55.353144 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.353131    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 07 13:58:55.353324 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.353166    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-j4qmn\""
Sep 07 13:58:55.353409 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.353393    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-lfgqm"]
Sep 07 13:58:55.353481 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.353465    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 07 13:58:55.353529 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.353514    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq"
Sep 07 13:58:55.355387 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.355369    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 07 13:58:55.355477 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.355453    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 07 13:58:55.355523 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.355492    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 07 13:58:55.355821 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.355806    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dcvvd\""
Sep 07 13:58:55.355892 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.355879    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 07 13:58:55.355948 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.355934    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-lfgqm"
Sep 07 13:58:55.358017 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.357987    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 07 13:58:55.358702 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.358681    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 07 13:58:55.359089 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.359068    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 07 13:58:55.359537 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.359521    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8n55z\""
Sep 07 13:58:55.359611 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.359541    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 07 13:58:55.360523 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.360506    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 07 13:58:55.363096 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.362873    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vkrjq"]
Sep 07 13:58:55.364414 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.364393    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-lfgqm"]
Sep 07 13:58:55.365417 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.365399    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-br4lq"]
Sep 07 13:58:55.398931 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.398901    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rspkr\" (UniqueName: \"kubernetes.io/projected/cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4-kube-api-access-rspkr\") pod \"service-ca-operator-859f94c4b-lfgqm\" (UID: \"cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-lfgqm"
Sep 07 13:58:55.398931 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.398932    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4k2h\" (UniqueName: \"kubernetes.io/projected/270f9ec5-070f-46ba-bc25-ef02408c53a5-kube-api-access-w4k2h\") pod \"insights-operator-76bcd6ccf5-br4lq\" (UID: \"270f9ec5-070f-46ba-bc25-ef02408c53a5\") " pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq"
Sep 07 13:58:55.399089 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.398954    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/270f9ec5-070f-46ba-bc25-ef02408c53a5-snapshots\") pod \"insights-operator-76bcd6ccf5-br4lq\" (UID: \"270f9ec5-070f-46ba-bc25-ef02408c53a5\") " pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq"
Sep 07 13:58:55.399089 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.398979    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4-serving-cert\") pod \"service-ca-operator-859f94c4b-lfgqm\" (UID: \"cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-lfgqm"
Sep 07 13:58:55.399089 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.399040    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/270f9ec5-070f-46ba-bc25-ef02408c53a5-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-br4lq\" (UID: \"270f9ec5-070f-46ba-bc25-ef02408c53a5\") " pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq"
Sep 07 13:58:55.399089 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.399066    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/270f9ec5-070f-46ba-bc25-ef02408c53a5-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-br4lq\" (UID: \"270f9ec5-070f-46ba-bc25-ef02408c53a5\") " pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq"
Sep 07 13:58:55.399210 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.399108    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/270f9ec5-070f-46ba-bc25-ef02408c53a5-tmp\") pod \"insights-operator-76bcd6ccf5-br4lq\" (UID: \"270f9ec5-070f-46ba-bc25-ef02408c53a5\") " pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq"
Sep 07 13:58:55.399210 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.399129    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e40a3b4-79fd-4e21-962d-d989ab5c78f2-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-vkrjq\" (UID: \"6e40a3b4-79fd-4e21-962d-d989ab5c78f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vkrjq"
Sep 07 13:58:55.399210 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.399145    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dz8z\" (UniqueName: \"kubernetes.io/projected/6e40a3b4-79fd-4e21-962d-d989ab5c78f2-kube-api-access-6dz8z\") pod \"cluster-samples-operator-7cdcfcf76c-vkrjq\" (UID: \"6e40a3b4-79fd-4e21-962d-d989ab5c78f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vkrjq"
Sep 07 13:58:55.399210 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.399160    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4-config\") pod \"service-ca-operator-859f94c4b-lfgqm\" (UID: \"cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-lfgqm"
Sep 07 13:58:55.399210 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.399173    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/270f9ec5-070f-46ba-bc25-ef02408c53a5-serving-cert\") pod \"insights-operator-76bcd6ccf5-br4lq\" (UID: \"270f9ec5-070f-46ba-bc25-ef02408c53a5\") " pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq"
Sep 07 13:58:55.500355 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.500278    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/270f9ec5-070f-46ba-bc25-ef02408c53a5-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-br4lq\" (UID: \"270f9ec5-070f-46ba-bc25-ef02408c53a5\") " pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq"
Sep 07 13:58:55.500355 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.500353    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/270f9ec5-070f-46ba-bc25-ef02408c53a5-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-br4lq\" (UID: \"270f9ec5-070f-46ba-bc25-ef02408c53a5\") " pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq"
Sep 07 13:58:55.500567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.500397    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/270f9ec5-070f-46ba-bc25-ef02408c53a5-tmp\") pod \"insights-operator-76bcd6ccf5-br4lq\" (UID: \"270f9ec5-070f-46ba-bc25-ef02408c53a5\") " pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq"
Sep 07 13:58:55.500567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.500419    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e40a3b4-79fd-4e21-962d-d989ab5c78f2-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-vkrjq\" (UID: \"6e40a3b4-79fd-4e21-962d-d989ab5c78f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vkrjq"
Sep 07 13:58:55.500567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.500437    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dz8z\" (UniqueName: \"kubernetes.io/projected/6e40a3b4-79fd-4e21-962d-d989ab5c78f2-kube-api-access-6dz8z\") pod \"cluster-samples-operator-7cdcfcf76c-vkrjq\" (UID: \"6e40a3b4-79fd-4e21-962d-d989ab5c78f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vkrjq"
Sep 07 13:58:55.500567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.500460    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4-config\") pod \"service-ca-operator-859f94c4b-lfgqm\" (UID: \"cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-lfgqm"
Sep 07 13:58:55.500567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.500488    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/270f9ec5-070f-46ba-bc25-ef02408c53a5-serving-cert\") pod \"insights-operator-76bcd6ccf5-br4lq\" (UID: \"270f9ec5-070f-46ba-bc25-ef02408c53a5\") " pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq"
Sep 07 13:58:55.500567 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.500551    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rspkr\" (UniqueName: \"kubernetes.io/projected/cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4-kube-api-access-rspkr\") pod \"service-ca-operator-859f94c4b-lfgqm\" (UID: \"cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-lfgqm"
Sep 07 13:58:55.500862 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.500597    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4k2h\" (UniqueName: \"kubernetes.io/projected/270f9ec5-070f-46ba-bc25-ef02408c53a5-kube-api-access-w4k2h\") pod \"insights-operator-76bcd6ccf5-br4lq\" (UID: \"270f9ec5-070f-46ba-bc25-ef02408c53a5\") " pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq"
Sep 07 13:58:55.500927 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.500906    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/270f9ec5-070f-46ba-bc25-ef02408c53a5-snapshots\") pod \"insights-operator-76bcd6ccf5-br4lq\" (UID: \"270f9ec5-070f-46ba-bc25-ef02408c53a5\") " pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq"
Sep 07 13:58:55.500980 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.500955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4-serving-cert\") pod \"service-ca-operator-859f94c4b-lfgqm\" (UID: \"cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-lfgqm"
Sep 07 13:58:55.501026 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:55.501008    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 07 13:58:55.501077 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.501056    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/270f9ec5-070f-46ba-bc25-ef02408c53a5-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-br4lq\" (UID: \"270f9ec5-070f-46ba-bc25-ef02408c53a5\") " pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq"
Sep 07 13:58:55.501132 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:55.501082    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e40a3b4-79fd-4e21-962d-d989ab5c78f2-samples-operator-tls podName:6e40a3b4-79fd-4e21-962d-d989ab5c78f2 nodeName:}" failed. No retries permitted until 2026-09-07 13:58:56.001063582 +0000 UTC m=+77.001491955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6e40a3b4-79fd-4e21-962d-d989ab5c78f2-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-vkrjq" (UID: "6e40a3b4-79fd-4e21-962d-d989ab5c78f2") : secret "samples-operator-tls" not found
Sep 07 13:58:55.501132 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.501118    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/270f9ec5-070f-46ba-bc25-ef02408c53a5-tmp\") pod \"insights-operator-76bcd6ccf5-br4lq\" (UID: \"270f9ec5-070f-46ba-bc25-ef02408c53a5\") " pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq"
Sep 07 13:58:55.501132 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.501123    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4-config\") pod \"service-ca-operator-859f94c4b-lfgqm\" (UID: \"cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-lfgqm"
Sep 07 13:58:55.501507 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.501481    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/270f9ec5-070f-46ba-bc25-ef02408c53a5-snapshots\") pod \"insights-operator-76bcd6ccf5-br4lq\" (UID: \"270f9ec5-070f-46ba-bc25-ef02408c53a5\") " pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq"
Sep 07 13:58:55.501999 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.501975    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/270f9ec5-070f-46ba-bc25-ef02408c53a5-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-br4lq\" (UID: \"270f9ec5-070f-46ba-bc25-ef02408c53a5\") " pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq"
Sep 07 13:58:55.502942 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.502922    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/270f9ec5-070f-46ba-bc25-ef02408c53a5-serving-cert\") pod \"insights-operator-76bcd6ccf5-br4lq\" (UID: \"270f9ec5-070f-46ba-bc25-ef02408c53a5\") " pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq"
Sep 07 13:58:55.503105 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.503089    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4-serving-cert\") pod \"service-ca-operator-859f94c4b-lfgqm\" (UID: \"cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-lfgqm"
Sep 07 13:58:55.514197 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.514176    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4k2h\" (UniqueName: \"kubernetes.io/projected/270f9ec5-070f-46ba-bc25-ef02408c53a5-kube-api-access-w4k2h\") pod \"insights-operator-76bcd6ccf5-br4lq\" (UID: \"270f9ec5-070f-46ba-bc25-ef02408c53a5\") " pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq"
Sep 07 13:58:55.514457 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.514436    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rspkr\" (UniqueName: \"kubernetes.io/projected/cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4-kube-api-access-rspkr\") pod \"service-ca-operator-859f94c4b-lfgqm\" (UID: \"cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-lfgqm"
Sep 07 13:58:55.514677 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.514659    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dz8z\" (UniqueName: \"kubernetes.io/projected/6e40a3b4-79fd-4e21-962d-d989ab5c78f2-kube-api-access-6dz8z\") pod \"cluster-samples-operator-7cdcfcf76c-vkrjq\" (UID: \"6e40a3b4-79fd-4e21-962d-d989ab5c78f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vkrjq"
Sep 07 13:58:55.545868 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.545839    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-stcr2"]
Sep 07 13:58:55.550047 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.550027    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-stcr2"
Sep 07 13:58:55.552774 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.552749    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-zc4jv\""
Sep 07 13:58:55.553105 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.553069    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 07 13:58:55.553229 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.553210    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 07 13:58:55.553458 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.553440    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 07 13:58:55.556455 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.553667    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 07 13:58:55.564216 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.564197    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-stcr2"]
Sep 07 13:58:55.602026 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.601946    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/465c83e0-d454-4446-8f6a-360687eff180-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-stcr2\" (UID: \"465c83e0-d454-4446-8f6a-360687eff180\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-stcr2"
Sep 07 13:58:55.602026 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.601981    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h77cj\" (UniqueName: \"kubernetes.io/projected/465c83e0-d454-4446-8f6a-360687eff180-kube-api-access-h77cj\") pod \"kube-storage-version-migrator-operator-8d7dd4675-stcr2\" (UID: \"465c83e0-d454-4446-8f6a-360687eff180\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-stcr2"
Sep 07 13:58:55.602189 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.602043    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/465c83e0-d454-4446-8f6a-360687eff180-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-stcr2\" (UID: \"465c83e0-d454-4446-8f6a-360687eff180\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-stcr2"
Sep 07 13:58:55.668439 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.668388    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq"
Sep 07 13:58:55.674329 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.674298    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-lfgqm"
Sep 07 13:58:55.702672 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.702636    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/465c83e0-d454-4446-8f6a-360687eff180-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-stcr2\" (UID: \"465c83e0-d454-4446-8f6a-360687eff180\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-stcr2"
Sep 07 13:58:55.702810 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.702679    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h77cj\" (UniqueName: \"kubernetes.io/projected/465c83e0-d454-4446-8f6a-360687eff180-kube-api-access-h77cj\") pod \"kube-storage-version-migrator-operator-8d7dd4675-stcr2\" (UID: \"465c83e0-d454-4446-8f6a-360687eff180\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-stcr2"
Sep 07 13:58:55.702810 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.702752    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/465c83e0-d454-4446-8f6a-360687eff180-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-stcr2\" (UID: \"465c83e0-d454-4446-8f6a-360687eff180\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-stcr2"
Sep 07 13:58:55.703392 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.703243    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/465c83e0-d454-4446-8f6a-360687eff180-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-stcr2\" (UID: \"465c83e0-d454-4446-8f6a-360687eff180\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-stcr2"
Sep 07 13:58:55.705399 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.705371    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/465c83e0-d454-4446-8f6a-360687eff180-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-stcr2\" (UID: \"465c83e0-d454-4446-8f6a-360687eff180\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-stcr2"
Sep 07 13:58:55.710825 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.710802    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h77cj\" (UniqueName: \"kubernetes.io/projected/465c83e0-d454-4446-8f6a-360687eff180-kube-api-access-h77cj\") pod \"kube-storage-version-migrator-operator-8d7dd4675-stcr2\" (UID: \"465c83e0-d454-4446-8f6a-360687eff180\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-stcr2"
Sep 07 13:58:55.860826 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.860745    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-stcr2"
Sep 07 13:58:55.943949 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.943917    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-br4lq"]
Sep 07 13:58:55.946836 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:58:55.946809    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod270f9ec5_070f_46ba_bc25_ef02408c53a5.slice/crio-5038dcc0b98677ebe77454513f748fbecbc4b0413b64f0525175e3220418fbbb WatchSource:0}: Error finding container 5038dcc0b98677ebe77454513f748fbecbc4b0413b64f0525175e3220418fbbb: Status 404 returned error can't find the container with id 5038dcc0b98677ebe77454513f748fbecbc4b0413b64f0525175e3220418fbbb
Sep 07 13:58:55.960828 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:55.960805    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-lfgqm"]
Sep 07 13:58:55.963986 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:58:55.963963    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcacbc5ee_3f48_4e09_a4a2_1a5f45d69ae4.slice/crio-69b5f5affa19eab8f52dfc4877cf33fb266b57969ef63e2a5da35678536ab1d9 WatchSource:0}: Error finding container 69b5f5affa19eab8f52dfc4877cf33fb266b57969ef63e2a5da35678536ab1d9: Status 404 returned error can't find the container with id 69b5f5affa19eab8f52dfc4877cf33fb266b57969ef63e2a5da35678536ab1d9
Sep 07 13:58:56.005845 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:56.005815    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e40a3b4-79fd-4e21-962d-d989ab5c78f2-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-vkrjq\" (UID: \"6e40a3b4-79fd-4e21-962d-d989ab5c78f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vkrjq"
Sep 07 13:58:56.005970 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:56.005940    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 07 13:58:56.006014 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:56.005990    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e40a3b4-79fd-4e21-962d-d989ab5c78f2-samples-operator-tls podName:6e40a3b4-79fd-4e21-962d-d989ab5c78f2 nodeName:}" failed. No retries permitted until 2026-09-07 13:58:57.005977408 +0000 UTC m=+78.006405778 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6e40a3b4-79fd-4e21-962d-d989ab5c78f2-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-vkrjq" (UID: "6e40a3b4-79fd-4e21-962d-d989ab5c78f2") : secret "samples-operator-tls" not found
Sep 07 13:58:56.129755 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:56.129671    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-stcr2"]
Sep 07 13:58:56.133186 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:58:56.133157    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod465c83e0_d454_4446_8f6a_360687eff180.slice/crio-f98a256948f19e067f3c4893e0229281d3e782ba5e96d257627778011a269366 WatchSource:0}: Error finding container f98a256948f19e067f3c4893e0229281d3e782ba5e96d257627778011a269366: Status 404 returned error can't find the container with id f98a256948f19e067f3c4893e0229281d3e782ba5e96d257627778011a269366
Sep 07 13:58:56.817137 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:56.817101    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-lfgqm" event={"ID":"cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4","Type":"ContainerStarted","Data":"69b5f5affa19eab8f52dfc4877cf33fb266b57969ef63e2a5da35678536ab1d9"}
Sep 07 13:58:56.819247 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:56.819136    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq" event={"ID":"270f9ec5-070f-46ba-bc25-ef02408c53a5","Type":"ContainerStarted","Data":"5038dcc0b98677ebe77454513f748fbecbc4b0413b64f0525175e3220418fbbb"}
Sep 07 13:58:56.820970 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:56.820786    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-stcr2" event={"ID":"465c83e0-d454-4446-8f6a-360687eff180","Type":"ContainerStarted","Data":"f98a256948f19e067f3c4893e0229281d3e782ba5e96d257627778011a269366"}
Sep 07 13:58:56.829675 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:56.829645    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-b7xvd"]
Sep 07 13:58:56.832655 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:56.832635    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-b7xvd"
Sep 07 13:58:56.834779 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:56.834758    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xgf2d\""
Sep 07 13:58:56.841205 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:56.841178    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-b7xvd"]
Sep 07 13:58:56.913691 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:56.913659    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8h7k\" (UniqueName: \"kubernetes.io/projected/aa9e9b9c-ad3f-465c-b0b9-68045c26e9fe-kube-api-access-b8h7k\") pod \"network-check-source-685456655f-b7xvd\" (UID: \"aa9e9b9c-ad3f-465c-b0b9-68045c26e9fe\") " pod="openshift-network-diagnostics/network-check-source-685456655f-b7xvd"
Sep 07 13:58:57.015596 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:57.014715    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e40a3b4-79fd-4e21-962d-d989ab5c78f2-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-vkrjq\" (UID: \"6e40a3b4-79fd-4e21-962d-d989ab5c78f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vkrjq"
Sep 07 13:58:57.015596 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:57.014771    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8h7k\" (UniqueName: \"kubernetes.io/projected/aa9e9b9c-ad3f-465c-b0b9-68045c26e9fe-kube-api-access-b8h7k\") pod \"network-check-source-685456655f-b7xvd\" (UID: \"aa9e9b9c-ad3f-465c-b0b9-68045c26e9fe\") " pod="openshift-network-diagnostics/network-check-source-685456655f-b7xvd"
Sep 07 13:58:57.015596 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:57.015198    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 07 13:58:57.015596 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:57.015262    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e40a3b4-79fd-4e21-962d-d989ab5c78f2-samples-operator-tls podName:6e40a3b4-79fd-4e21-962d-d989ab5c78f2 nodeName:}" failed. No retries permitted until 2026-09-07 13:58:59.015242154 +0000 UTC m=+80.015670526 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6e40a3b4-79fd-4e21-962d-d989ab5c78f2-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-vkrjq" (UID: "6e40a3b4-79fd-4e21-962d-d989ab5c78f2") : secret "samples-operator-tls" not found
Sep 07 13:58:57.029104 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:57.029075    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8h7k\" (UniqueName: \"kubernetes.io/projected/aa9e9b9c-ad3f-465c-b0b9-68045c26e9fe-kube-api-access-b8h7k\") pod \"network-check-source-685456655f-b7xvd\" (UID: \"aa9e9b9c-ad3f-465c-b0b9-68045c26e9fe\") " pod="openshift-network-diagnostics/network-check-source-685456655f-b7xvd"
Sep 07 13:58:57.148041 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:57.147970    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-b7xvd"
Sep 07 13:58:57.436488 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:57.436403    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-b7xvd"]
Sep 07 13:58:57.922595 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:58:57.922565    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa9e9b9c_ad3f_465c_b0b9_68045c26e9fe.slice/crio-773c8e574219bec0e7a82ac239f89b6e3bbd11dc33b01042243c92b2ee142d8e WatchSource:0}: Error finding container 773c8e574219bec0e7a82ac239f89b6e3bbd11dc33b01042243c92b2ee142d8e: Status 404 returned error can't find the container with id 773c8e574219bec0e7a82ac239f89b6e3bbd11dc33b01042243c92b2ee142d8e
Sep 07 13:58:58.828239 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:58.828193    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-b7xvd" event={"ID":"aa9e9b9c-ad3f-465c-b0b9-68045c26e9fe","Type":"ContainerStarted","Data":"773c8e574219bec0e7a82ac239f89b6e3bbd11dc33b01042243c92b2ee142d8e"}
Sep 07 13:58:59.030163 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:59.030121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e40a3b4-79fd-4e21-962d-d989ab5c78f2-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-vkrjq\" (UID: \"6e40a3b4-79fd-4e21-962d-d989ab5c78f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vkrjq"
Sep 07 13:58:59.030541 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:59.030362    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 07 13:58:59.030541 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:58:59.030420    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e40a3b4-79fd-4e21-962d-d989ab5c78f2-samples-operator-tls podName:6e40a3b4-79fd-4e21-962d-d989ab5c78f2 nodeName:}" failed. No retries permitted until 2026-09-07 13:59:03.030402149 +0000 UTC m=+84.030830522 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6e40a3b4-79fd-4e21-962d-d989ab5c78f2-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-vkrjq" (UID: "6e40a3b4-79fd-4e21-962d-d989ab5c78f2") : secret "samples-operator-tls" not found
Sep 07 13:58:59.833443 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:59.833401    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-b7xvd" event={"ID":"aa9e9b9c-ad3f-465c-b0b9-68045c26e9fe","Type":"ContainerStarted","Data":"e07571daa1fa9f93af67cbd386708171f5d4940a97a7c63abe0815d3bce0c97f"}
Sep 07 13:58:59.835413 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:59.835166    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-lfgqm" event={"ID":"cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4","Type":"ContainerStarted","Data":"75a11bff672f407a5e122cd49b7913c937ece6d4b4dd85bae135c40a0c4c7a47"}
Sep 07 13:58:59.836726 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:59.836694    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq" event={"ID":"270f9ec5-070f-46ba-bc25-ef02408c53a5","Type":"ContainerStarted","Data":"471319e767671bfbdb670399a4ae5876281ccfcce80a1ab771032e6f9edd5e47"}
Sep 07 13:58:59.838510 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:59.838486    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-stcr2" event={"ID":"465c83e0-d454-4446-8f6a-360687eff180","Type":"ContainerStarted","Data":"9631a0c64b5daeaabe32f9be8de5e1592fcf81e656c0d1306adf3944db39f33b"}
Sep 07 13:58:59.867792 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:59.867739    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-lfgqm" podStartSLOduration=1.908942874 podStartE2EDuration="4.86771875s" totalImagesPullingTime="2.958775876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:58:59.867397485 +0000 UTC m=+80.867825881" watchObservedRunningTime="2026-09-07 13:58:59.86771875 +0000 UTC m=+80.868147148"
Sep 07 13:58:59.868087 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:59.868047    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-b7xvd" podStartSLOduration=3.868037783 podStartE2EDuration="3.868037783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:58:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:58:59.851997508 +0000 UTC m=+80.852425902" watchObservedRunningTime="2026-09-07 13:58:59.868037783 +0000 UTC m=+80.868466177"
Sep 07 13:58:59.887011 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:59.886952    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-stcr2" podStartSLOduration=2.091386698 podStartE2EDuration="4.886932368s" totalImagesPullingTime="2.79554567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:58:59.886274305 +0000 UTC m=+80.886702699" watchObservedRunningTime="2026-09-07 13:58:59.886932368 +0000 UTC m=+80.887360762"
Sep 07 13:58:59.907738 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:58:59.907665    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq" podStartSLOduration=1.935297863 podStartE2EDuration="4.907643773s" totalImagesPullingTime="2.97234591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:58:59.907452668 +0000 UTC m=+80.907881064" watchObservedRunningTime="2026-09-07 13:58:59.907643773 +0000 UTC m=+80.908072169"
Sep 07 13:59:00.358751 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:00.358713    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gplqp"]
Sep 07 13:59:00.362581 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:00.362555    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:00.365033 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:00.365001    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 07 13:59:00.365033 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:00.365007    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 07 13:59:00.365186 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:00.365122    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lj6jr\""
Sep 07 13:59:00.373706 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:00.373681    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gplqp"]
Sep 07 13:59:00.442352 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:00.442308    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtczw\" (UniqueName: \"kubernetes.io/projected/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-kube-api-access-vtczw\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:00.442519 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:00.442369    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-data-volume\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:00.442519 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:00.442397    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:00.442519 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:00.442424    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:00.442519 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:00.442492    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-crio-socket\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:00.544374 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:00.543952    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtczw\" (UniqueName: \"kubernetes.io/projected/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-kube-api-access-vtczw\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:00.544374 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:00.544012    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-data-volume\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:00.544374 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:00.544047    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:00.544374 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:00.544070    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:00.544374 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:00.544104    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-crio-socket\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:00.544374 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:00.544220    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-crio-socket\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:00.544744 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:00.544451    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 13:59:00.544744 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:00.544523    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-kube-rbac-proxy-cm podName:7e716e19-8ce8-4865-ad0d-612bb4b7d6bd nodeName:}" failed. No retries permitted until 2026-09-07 13:59:01.044505682 +0000 UTC m=+82.044934072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gplqp" (UID: "7e716e19-8ce8-4865-ad0d-612bb4b7d6bd") : configmap "kube-rbac-proxy" not found
Sep 07 13:59:00.544744 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:00.544538    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 13:59:00.544744 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:00.544615    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-insights-runtime-extractor-tls podName:7e716e19-8ce8-4865-ad0d-612bb4b7d6bd nodeName:}" failed. No retries permitted until 2026-09-07 13:59:01.044591294 +0000 UTC m=+82.045019670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gplqp" (UID: "7e716e19-8ce8-4865-ad0d-612bb4b7d6bd") : secret "insights-runtime-extractor-tls" not found
Sep 07 13:59:00.544744 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:00.544700    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-data-volume\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:00.552949 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:00.552925    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtczw\" (UniqueName: \"kubernetes.io/projected/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-kube-api-access-vtczw\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:01.049214 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:01.049158    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:01.049214 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:01.049223    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:01.049455 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:01.049303    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 13:59:01.049455 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:01.049332    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 13:59:01.049455 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:01.049369    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-insights-runtime-extractor-tls podName:7e716e19-8ce8-4865-ad0d-612bb4b7d6bd nodeName:}" failed. No retries permitted until 2026-09-07 13:59:02.049353405 +0000 UTC m=+83.049781776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gplqp" (UID: "7e716e19-8ce8-4865-ad0d-612bb4b7d6bd") : secret "insights-runtime-extractor-tls" not found
Sep 07 13:59:01.049455 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:01.049386    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-kube-rbac-proxy-cm podName:7e716e19-8ce8-4865-ad0d-612bb4b7d6bd nodeName:}" failed. No retries permitted until 2026-09-07 13:59:02.049379192 +0000 UTC m=+83.049807562 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gplqp" (UID: "7e716e19-8ce8-4865-ad0d-612bb4b7d6bd") : configmap "kube-rbac-proxy" not found
Sep 07 13:59:02.058078 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:02.057956    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:02.058482 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:02.058089    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 13:59:02.058482 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:02.058097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:02.058482 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:02.058155    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-kube-rbac-proxy-cm podName:7e716e19-8ce8-4865-ad0d-612bb4b7d6bd nodeName:}" failed. No retries permitted until 2026-09-07 13:59:04.058135984 +0000 UTC m=+85.058564377 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gplqp" (UID: "7e716e19-8ce8-4865-ad0d-612bb4b7d6bd") : configmap "kube-rbac-proxy" not found
Sep 07 13:59:02.058482 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:02.058201    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 13:59:02.058482 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:02.058238    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-insights-runtime-extractor-tls podName:7e716e19-8ce8-4865-ad0d-612bb4b7d6bd nodeName:}" failed. No retries permitted until 2026-09-07 13:59:04.058227269 +0000 UTC m=+85.058655650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gplqp" (UID: "7e716e19-8ce8-4865-ad0d-612bb4b7d6bd") : secret "insights-runtime-extractor-tls" not found
Sep 07 13:59:02.516602 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:02.516570    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mwtrw_6e1fe657-72f7-49a7-ad98-1adb910682be/dns-node-resolver/0.log"
Sep 07 13:59:03.066911 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:03.066871    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e40a3b4-79fd-4e21-962d-d989ab5c78f2-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-vkrjq\" (UID: \"6e40a3b4-79fd-4e21-962d-d989ab5c78f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vkrjq"
Sep 07 13:59:03.067364 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:03.067031    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 07 13:59:03.067364 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:03.067099    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e40a3b4-79fd-4e21-962d-d989ab5c78f2-samples-operator-tls podName:6e40a3b4-79fd-4e21-962d-d989ab5c78f2 nodeName:}" failed. No retries permitted until 2026-09-07 13:59:11.067083964 +0000 UTC m=+92.067512339 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6e40a3b4-79fd-4e21-962d-d989ab5c78f2-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-vkrjq" (UID: "6e40a3b4-79fd-4e21-962d-d989ab5c78f2") : secret "samples-operator-tls" not found
Sep 07 13:59:03.122118 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:03.122091    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-44mrd_80593104-b03b-4e55-9146-02b5f0f94c9b/node-ca/0.log"
Sep 07 13:59:04.073898 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:04.073865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:04.074399 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:04.073991    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 13:59:04.074399 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:04.074006    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:04.074399 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:04.074056    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-kube-rbac-proxy-cm podName:7e716e19-8ce8-4865-ad0d-612bb4b7d6bd nodeName:}" failed. No retries permitted until 2026-09-07 13:59:08.074038614 +0000 UTC m=+89.074467005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gplqp" (UID: "7e716e19-8ce8-4865-ad0d-612bb4b7d6bd") : configmap "kube-rbac-proxy" not found
Sep 07 13:59:04.074399 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:04.074110    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 13:59:04.074399 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:04.074156    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-insights-runtime-extractor-tls podName:7e716e19-8ce8-4865-ad0d-612bb4b7d6bd nodeName:}" failed. No retries permitted until 2026-09-07 13:59:08.074143939 +0000 UTC m=+89.074572323 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gplqp" (UID: "7e716e19-8ce8-4865-ad0d-612bb4b7d6bd") : secret "insights-runtime-extractor-tls" not found
Sep 07 13:59:04.314901 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:04.314870    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sxmvt_39e32f83-7ada-441f-ae68-282d20bb4698/serve-healthcheck-canary/0.log"
Sep 07 13:59:08.110902 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:08.110862    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:08.111284 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:08.110908    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:08.111284 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:08.111016    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 13:59:08.111284 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:08.111017    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 13:59:08.111284 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:08.111073    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-kube-rbac-proxy-cm podName:7e716e19-8ce8-4865-ad0d-612bb4b7d6bd nodeName:}" failed. No retries permitted until 2026-09-07 13:59:16.11105846 +0000 UTC m=+97.111486849 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gplqp" (UID: "7e716e19-8ce8-4865-ad0d-612bb4b7d6bd") : configmap "kube-rbac-proxy" not found
Sep 07 13:59:08.111284 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:08.111087    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-insights-runtime-extractor-tls podName:7e716e19-8ce8-4865-ad0d-612bb4b7d6bd nodeName:}" failed. No retries permitted until 2026-09-07 13:59:16.111081374 +0000 UTC m=+97.111509746 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gplqp" (UID: "7e716e19-8ce8-4865-ad0d-612bb4b7d6bd") : secret "insights-runtime-extractor-tls" not found
Sep 07 13:59:11.136625 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:11.136581    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e40a3b4-79fd-4e21-962d-d989ab5c78f2-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-vkrjq\" (UID: \"6e40a3b4-79fd-4e21-962d-d989ab5c78f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vkrjq"
Sep 07 13:59:11.138934 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:11.138912    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e40a3b4-79fd-4e21-962d-d989ab5c78f2-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-vkrjq\" (UID: \"6e40a3b4-79fd-4e21-962d-d989ab5c78f2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vkrjq"
Sep 07 13:59:11.260549 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:11.260515    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vkrjq"
Sep 07 13:59:11.535217 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:11.535144    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vkrjq"]
Sep 07 13:59:11.873615 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:11.873584    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vkrjq" event={"ID":"6e40a3b4-79fd-4e21-962d-d989ab5c78f2","Type":"ContainerStarted","Data":"a9f1adcd11802ff5655360ef16a035cc01bce503bfed6933b09739688688450e"}
Sep 07 13:59:13.881473 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:13.881427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vkrjq" event={"ID":"6e40a3b4-79fd-4e21-962d-d989ab5c78f2","Type":"ContainerStarted","Data":"b1189a28fe88b253929426885398bb3363ce059caea4f4bad574710fc8d6a3cf"}
Sep 07 13:59:13.881840 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:13.881501    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vkrjq" event={"ID":"6e40a3b4-79fd-4e21-962d-d989ab5c78f2","Type":"ContainerStarted","Data":"918a6f4078cb05643141106ad3388649c6b3c632a4112f7b2b931aaf2fff68ec"}
Sep 07 13:59:13.902461 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:13.902407    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vkrjq" podStartSLOduration=17.237651511 podStartE2EDuration="18.902391189s" totalImagesPullingTime="1.664739678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:59:13.90207453 +0000 UTC m=+94.902502924" watchObservedRunningTime="2026-09-07 13:59:13.902391189 +0000 UTC m=+94.902819582"
Sep 07 13:59:16.177116 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:16.177080    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:16.177116 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:16.177116    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:16.177663 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:16.177248    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 13:59:16.177663 ip-10-0-139-134 kubenswrapper[2581]: E0907 13:59:16.177367    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-insights-runtime-extractor-tls podName:7e716e19-8ce8-4865-ad0d-612bb4b7d6bd nodeName:}" failed. No retries permitted until 2026-09-07 13:59:32.177345125 +0000 UTC m=+113.177773501 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gplqp" (UID: "7e716e19-8ce8-4865-ad0d-612bb4b7d6bd") : secret "insights-runtime-extractor-tls" not found
Sep 07 13:59:16.177663 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:16.177631    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:17.286192 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:17.286151    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls\") pod \"dns-default-9qh6w\" (UID: \"69fd2a51-3aad-48e2-938e-7bc82deab21a\") " pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:59:17.286560 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:17.286256    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:59:17.288522 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:17.288495    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69fd2a51-3aad-48e2-938e-7bc82deab21a-metrics-tls\") pod \"dns-default-9qh6w\" (UID: \"69fd2a51-3aad-48e2-938e-7bc82deab21a\") " pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:59:17.288638 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:17.288615    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls\") pod \"image-registry-748b686f65-q9rz7\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") " pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:59:17.551851 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:17.551771    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-d97bl\""
Sep 07 13:59:17.559723 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:17.559702    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:59:17.585670 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:17.585640    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4n9w8\""
Sep 07 13:59:17.593765 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:17.593741    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:59:17.832893 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:17.832864    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-748b686f65-q9rz7"]
Sep 07 13:59:17.836224 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:59:17.836189    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54faae80_3d59_4007_8e7d_8226638369fe.slice/crio-a38f0e5dc2b39731ce1eb094e6ebbd5cf8c8eb9f763d88516e6314c766ffe830 WatchSource:0}: Error finding container a38f0e5dc2b39731ce1eb094e6ebbd5cf8c8eb9f763d88516e6314c766ffe830: Status 404 returned error can't find the container with id a38f0e5dc2b39731ce1eb094e6ebbd5cf8c8eb9f763d88516e6314c766ffe830
Sep 07 13:59:17.875806 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:17.875784    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9qh6w"]
Sep 07 13:59:17.877743 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:59:17.877711    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69fd2a51_3aad_48e2_938e_7bc82deab21a.slice/crio-c5a4e9fde643b212efc7b761bdd8cace345f675b37fae9d6735d235863bdeb50 WatchSource:0}: Error finding container c5a4e9fde643b212efc7b761bdd8cace345f675b37fae9d6735d235863bdeb50: Status 404 returned error can't find the container with id c5a4e9fde643b212efc7b761bdd8cace345f675b37fae9d6735d235863bdeb50
Sep 07 13:59:17.895000 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:17.894969    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9qh6w" event={"ID":"69fd2a51-3aad-48e2-938e-7bc82deab21a","Type":"ContainerStarted","Data":"c5a4e9fde643b212efc7b761bdd8cace345f675b37fae9d6735d235863bdeb50"}
Sep 07 13:59:17.896587 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:17.896560    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-748b686f65-q9rz7" event={"ID":"54faae80-3d59-4007-8e7d-8226638369fe","Type":"ContainerStarted","Data":"439496608c7b1ad59f5ad35048645932858f8004b69aa8229841bc92c1e3cea3"}
Sep 07 13:59:17.896685 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:17.896604    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-748b686f65-q9rz7" event={"ID":"54faae80-3d59-4007-8e7d-8226638369fe","Type":"ContainerStarted","Data":"a38f0e5dc2b39731ce1eb094e6ebbd5cf8c8eb9f763d88516e6314c766ffe830"}
Sep 07 13:59:17.896746 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:17.896713    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:59:17.915583 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:17.915541    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-748b686f65-q9rz7" podStartSLOduration=97.915527306 podStartE2EDuration="1m37.915527306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:57:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:59:17.914469887 +0000 UTC m=+98.914898281" watchObservedRunningTime="2026-09-07 13:59:17.915527306 +0000 UTC m=+98.915955699"
Sep 07 13:59:19.906461 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:19.906422    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9qh6w" event={"ID":"69fd2a51-3aad-48e2-938e-7bc82deab21a","Type":"ContainerStarted","Data":"6daa97377d09363e460424b7e86e128d57031b21b513ed675f087f5dbd56847d"}
Sep 07 13:59:19.906923 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:19.906489    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9qh6w" event={"ID":"69fd2a51-3aad-48e2-938e-7bc82deab21a","Type":"ContainerStarted","Data":"ebd7f51db5a22e63b7437a3ed2d8d14ee156bc3f73560c740b1d944bb2112996"}
Sep 07 13:59:19.906923 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:19.906520    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:59:19.926626 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:19.926581    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9qh6w" podStartSLOduration=65.095261665 podStartE2EDuration="1m6.926565216s" totalImagesPullingTime="1.831303551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:59:19.926416662 +0000 UTC m=+100.926845055" watchObservedRunningTime="2026-09-07 13:59:19.926565216 +0000 UTC m=+100.926993608"
Sep 07 13:59:20.806966 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:20.806928    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-l6hnr"
Sep 07 13:59:26.836664 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:26.836629    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75589f7546-cqcx9"]
Sep 07 13:59:26.841205 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:26.841187    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75589f7546-cqcx9"
Sep 07 13:59:26.843518 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:26.843498    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 07 13:59:26.843631 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:26.843582    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 07 13:59:26.844579 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:26.844558    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 07 13:59:26.844579 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:26.844570    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 07 13:59:26.852455 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:26.852432    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75589f7546-cqcx9"]
Sep 07 13:59:26.964760 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:26.964727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/455992ef-5e0c-421a-baa5-f7abf63d32b5-tmp\") pod \"klusterlet-addon-workmgr-75589f7546-cqcx9\" (UID: \"455992ef-5e0c-421a-baa5-f7abf63d32b5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75589f7546-cqcx9"
Sep 07 13:59:26.964943 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:26.964804    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k6q8\" (UniqueName: \"kubernetes.io/projected/455992ef-5e0c-421a-baa5-f7abf63d32b5-kube-api-access-9k6q8\") pod \"klusterlet-addon-workmgr-75589f7546-cqcx9\" (UID: \"455992ef-5e0c-421a-baa5-f7abf63d32b5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75589f7546-cqcx9"
Sep 07 13:59:26.964943 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:26.964835    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/455992ef-5e0c-421a-baa5-f7abf63d32b5-klusterlet-config\") pod \"klusterlet-addon-workmgr-75589f7546-cqcx9\" (UID: \"455992ef-5e0c-421a-baa5-f7abf63d32b5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75589f7546-cqcx9"
Sep 07 13:59:27.066055 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:27.066022    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k6q8\" (UniqueName: \"kubernetes.io/projected/455992ef-5e0c-421a-baa5-f7abf63d32b5-kube-api-access-9k6q8\") pod \"klusterlet-addon-workmgr-75589f7546-cqcx9\" (UID: \"455992ef-5e0c-421a-baa5-f7abf63d32b5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75589f7546-cqcx9"
Sep 07 13:59:27.066055 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:27.066068    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/455992ef-5e0c-421a-baa5-f7abf63d32b5-klusterlet-config\") pod \"klusterlet-addon-workmgr-75589f7546-cqcx9\" (UID: \"455992ef-5e0c-421a-baa5-f7abf63d32b5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75589f7546-cqcx9"
Sep 07 13:59:27.066339 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:27.066128    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/455992ef-5e0c-421a-baa5-f7abf63d32b5-tmp\") pod \"klusterlet-addon-workmgr-75589f7546-cqcx9\" (UID: \"455992ef-5e0c-421a-baa5-f7abf63d32b5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75589f7546-cqcx9"
Sep 07 13:59:27.066540 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:27.066521    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/455992ef-5e0c-421a-baa5-f7abf63d32b5-tmp\") pod \"klusterlet-addon-workmgr-75589f7546-cqcx9\" (UID: \"455992ef-5e0c-421a-baa5-f7abf63d32b5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75589f7546-cqcx9"
Sep 07 13:59:27.068543 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:27.068525    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/455992ef-5e0c-421a-baa5-f7abf63d32b5-klusterlet-config\") pod \"klusterlet-addon-workmgr-75589f7546-cqcx9\" (UID: \"455992ef-5e0c-421a-baa5-f7abf63d32b5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75589f7546-cqcx9"
Sep 07 13:59:27.077834 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:27.077812    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k6q8\" (UniqueName: \"kubernetes.io/projected/455992ef-5e0c-421a-baa5-f7abf63d32b5-kube-api-access-9k6q8\") pod \"klusterlet-addon-workmgr-75589f7546-cqcx9\" (UID: \"455992ef-5e0c-421a-baa5-f7abf63d32b5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75589f7546-cqcx9"
Sep 07 13:59:27.150660 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:27.150566    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75589f7546-cqcx9"
Sep 07 13:59:27.422014 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:27.421938    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75589f7546-cqcx9"]
Sep 07 13:59:27.424668 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:59:27.424644    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod455992ef_5e0c_421a_baa5_f7abf63d32b5.slice/crio-fc1199ee16201b97ea6b8e23a67cccac3b3d88c355e5e90cbb204db5b37ced26 WatchSource:0}: Error finding container fc1199ee16201b97ea6b8e23a67cccac3b3d88c355e5e90cbb204db5b37ced26: Status 404 returned error can't find the container with id fc1199ee16201b97ea6b8e23a67cccac3b3d88c355e5e90cbb204db5b37ced26
Sep 07 13:59:27.935144 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:27.935106    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75589f7546-cqcx9" event={"ID":"455992ef-5e0c-421a-baa5-f7abf63d32b5","Type":"ContainerStarted","Data":"fc1199ee16201b97ea6b8e23a67cccac3b3d88c355e5e90cbb204db5b37ced26"}
Sep 07 13:59:29.912734 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:29.912701    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9qh6w"
Sep 07 13:59:31.953310 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:31.953259    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75589f7546-cqcx9" event={"ID":"455992ef-5e0c-421a-baa5-f7abf63d32b5","Type":"ContainerStarted","Data":"1448c7a48e60a66c0632b760d9c3f9e27c0ff3538e0ac05adb57c6f40ce3db7e"}
Sep 07 13:59:31.971490 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:31.971431    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75589f7546-cqcx9" podStartSLOduration=2.168941249 podStartE2EDuration="5.971409967s" totalImagesPullingTime="3.802468718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:59:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:59:31.970653371 +0000 UTC m=+112.971081756" watchObservedRunningTime="2026-09-07 13:59:31.971409967 +0000 UTC m=+112.971838361"
Sep 07 13:59:32.211465 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:32.211377    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:32.213604 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:32.213585    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e716e19-8ce8-4865-ad0d-612bb4b7d6bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gplqp\" (UID: \"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd\") " pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:32.471946 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:32.471860    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gplqp"
Sep 07 13:59:32.746458 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:32.746391    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gplqp"]
Sep 07 13:59:32.748824 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:59:32.748801    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e716e19_8ce8_4865_ad0d_612bb4b7d6bd.slice/crio-3027cb2737199803ec434a4c8f3801f6c04df39515e7cdc52ff971ca03c5cd36 WatchSource:0}: Error finding container 3027cb2737199803ec434a4c8f3801f6c04df39515e7cdc52ff971ca03c5cd36: Status 404 returned error can't find the container with id 3027cb2737199803ec434a4c8f3801f6c04df39515e7cdc52ff971ca03c5cd36
Sep 07 13:59:32.957936 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:32.957893    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gplqp" event={"ID":"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd","Type":"ContainerStarted","Data":"2097f57255f3c92a919f90c096f743efbb67b885cffcd32a6672ae8c53514e2f"}
Sep 07 13:59:32.958326 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:32.957990    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gplqp" event={"ID":"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd","Type":"ContainerStarted","Data":"3027cb2737199803ec434a4c8f3801f6c04df39515e7cdc52ff971ca03c5cd36"}
Sep 07 13:59:32.958326 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:32.958019    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75589f7546-cqcx9"
Sep 07 13:59:32.959895 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:32.959866    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75589f7546-cqcx9"
Sep 07 13:59:33.963324 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:33.963269    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gplqp" event={"ID":"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd","Type":"ContainerStarted","Data":"8c6cb9e755e41938f9bc57f246efdaf362d4d51034bd7e369e0bea9a9d192cff"}
Sep 07 13:59:34.012101 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.012072    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-hswqc"]
Sep 07 13:59:34.015203 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.015185    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-hswqc"
Sep 07 13:59:34.017499 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.017474    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 07 13:59:34.017747 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.017726    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 07 13:59:34.017832 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.017789    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 07 13:59:34.018779 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.018761    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 07 13:59:34.019051 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.019032    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-tm4ff\""
Sep 07 13:59:34.019051 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.019044    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 07 13:59:34.024400 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.024377    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-hswqc"]
Sep 07 13:59:34.127313 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.127261    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7flvn\" (UniqueName: \"kubernetes.io/projected/4ddba003-6ec1-469a-ad2a-42bd138f34b7-kube-api-access-7flvn\") pod \"prometheus-operator-6f4946db56-hswqc\" (UID: \"4ddba003-6ec1-469a-ad2a-42bd138f34b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hswqc"
Sep 07 13:59:34.127488 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.127354    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ddba003-6ec1-469a-ad2a-42bd138f34b7-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-hswqc\" (UID: \"4ddba003-6ec1-469a-ad2a-42bd138f34b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hswqc"
Sep 07 13:59:34.127488 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.127398    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ddba003-6ec1-469a-ad2a-42bd138f34b7-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-hswqc\" (UID: \"4ddba003-6ec1-469a-ad2a-42bd138f34b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hswqc"
Sep 07 13:59:34.127488 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.127416    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ddba003-6ec1-469a-ad2a-42bd138f34b7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-hswqc\" (UID: \"4ddba003-6ec1-469a-ad2a-42bd138f34b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hswqc"
Sep 07 13:59:34.228342 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.228243    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7flvn\" (UniqueName: \"kubernetes.io/projected/4ddba003-6ec1-469a-ad2a-42bd138f34b7-kube-api-access-7flvn\") pod \"prometheus-operator-6f4946db56-hswqc\" (UID: \"4ddba003-6ec1-469a-ad2a-42bd138f34b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hswqc"
Sep 07 13:59:34.228523 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.228345    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ddba003-6ec1-469a-ad2a-42bd138f34b7-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-hswqc\" (UID: \"4ddba003-6ec1-469a-ad2a-42bd138f34b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hswqc"
Sep 07 13:59:34.228523 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.228414    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ddba003-6ec1-469a-ad2a-42bd138f34b7-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-hswqc\" (UID: \"4ddba003-6ec1-469a-ad2a-42bd138f34b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hswqc"
Sep 07 13:59:34.228523 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.228443    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ddba003-6ec1-469a-ad2a-42bd138f34b7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-hswqc\" (UID: \"4ddba003-6ec1-469a-ad2a-42bd138f34b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hswqc"
Sep 07 13:59:34.229171 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.229134    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ddba003-6ec1-469a-ad2a-42bd138f34b7-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-hswqc\" (UID: \"4ddba003-6ec1-469a-ad2a-42bd138f34b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hswqc"
Sep 07 13:59:34.231105 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.231081    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ddba003-6ec1-469a-ad2a-42bd138f34b7-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-hswqc\" (UID: \"4ddba003-6ec1-469a-ad2a-42bd138f34b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hswqc"
Sep 07 13:59:34.231208 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.231151    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ddba003-6ec1-469a-ad2a-42bd138f34b7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-hswqc\" (UID: \"4ddba003-6ec1-469a-ad2a-42bd138f34b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hswqc"
Sep 07 13:59:34.239794 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.239772    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7flvn\" (UniqueName: \"kubernetes.io/projected/4ddba003-6ec1-469a-ad2a-42bd138f34b7-kube-api-access-7flvn\") pod \"prometheus-operator-6f4946db56-hswqc\" (UID: \"4ddba003-6ec1-469a-ad2a-42bd138f34b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hswqc"
Sep 07 13:59:34.326040 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.326001    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-hswqc"
Sep 07 13:59:34.604417 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.603970    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-hswqc"]
Sep 07 13:59:34.819613 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:59:34.819572    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ddba003_6ec1_469a_ad2a_42bd138f34b7.slice/crio-e18876d92e7ac9dd8aff9d065ba19f83f11179900b1a182c2419424d739ecf19 WatchSource:0}: Error finding container e18876d92e7ac9dd8aff9d065ba19f83f11179900b1a182c2419424d739ecf19: Status 404 returned error can't find the container with id e18876d92e7ac9dd8aff9d065ba19f83f11179900b1a182c2419424d739ecf19
Sep 07 13:59:34.969035 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.969002    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gplqp" event={"ID":"7e716e19-8ce8-4865-ad0d-612bb4b7d6bd","Type":"ContainerStarted","Data":"e91c31cae39b57dfad730ab434e214a83f52417af60d0f9662637c17ce21a760"}
Sep 07 13:59:34.970263 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.970236    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-hswqc" event={"ID":"4ddba003-6ec1-469a-ad2a-42bd138f34b7","Type":"ContainerStarted","Data":"e18876d92e7ac9dd8aff9d065ba19f83f11179900b1a182c2419424d739ecf19"}
Sep 07 13:59:34.989741 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:34.989690    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gplqp" podStartSLOduration=32.98128649 podStartE2EDuration="34.98967487s" totalImagesPullingTime="2.00838838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:59:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:59:34.988461749 +0000 UTC m=+115.988890144" watchObservedRunningTime="2026-09-07 13:59:34.98967487 +0000 UTC m=+115.990103262"
Sep 07 13:59:36.978422 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:36.978380    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-hswqc" event={"ID":"4ddba003-6ec1-469a-ad2a-42bd138f34b7","Type":"ContainerStarted","Data":"546064f1ad23f9d58ee8d4492c2c0e08b8953da795a8ef6b6361d119d4d6f917"}
Sep 07 13:59:36.978805 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:36.978485    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-hswqc" event={"ID":"4ddba003-6ec1-469a-ad2a-42bd138f34b7","Type":"ContainerStarted","Data":"4f2d7885859353b6da64aea0f680c7d029bae09683af6c349db949544672c8ec"}
Sep 07 13:59:36.997270 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:36.997219    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-hswqc" podStartSLOduration=2.687885636 podStartE2EDuration="3.997204495s" totalImagesPullingTime="1.309318859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:59:36.996136471 +0000 UTC m=+117.996564864" watchObservedRunningTime="2026-09-07 13:59:36.997204495 +0000 UTC m=+117.997632888"
Sep 07 13:59:37.564578 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:37.564539    2581 patch_prober.go:28] interesting pod/image-registry-748b686f65-q9rz7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 07 13:59:37.564749 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:37.564593    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-748b686f65-q9rz7" podUID="54faae80-3d59-4007-8e7d-8226638369fe" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 13:59:38.905453 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:38.905420    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 13:59:39.385135 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.385102    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-btsmx"]
Sep 07 13:59:39.388562 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.388537    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.390792 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.390770    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 07 13:59:39.391028 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.391011    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 07 13:59:39.391142 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.391124    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 07 13:59:39.391182 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.391133    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kp7f5\""
Sep 07 13:59:39.569921 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.569876    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-node-exporter-accelerators-collector-config\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.570059 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.569935    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-root\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.570059 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.569960    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.570059 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.569996    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-node-exporter-wtmp\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.570059 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.570017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-node-exporter-tls\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.570059 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.570043    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-sys\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.570235 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.570072    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-metrics-client-ca\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.570235 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.570105    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-node-exporter-textfile\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.570235 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.570161    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx7z7\" (UniqueName: \"kubernetes.io/projected/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-kube-api-access-zx7z7\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.671145 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.671050    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-root\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.671145 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.671095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.671145 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.671130    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-node-exporter-wtmp\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.671438 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.671164    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-node-exporter-tls\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.671438 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.671165    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-root\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.671438 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.671194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-sys\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.671438 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.671223    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-metrics-client-ca\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.671438 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.671266    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-node-exporter-textfile\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.671438 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.671329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx7z7\" (UniqueName: \"kubernetes.io/projected/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-kube-api-access-zx7z7\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.671438 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.671359    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-sys\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.671438 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.671372    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-node-exporter-accelerators-collector-config\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.671438 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.671374    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-node-exporter-wtmp\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.671757 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.671681    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-node-exporter-textfile\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.671871 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.671851    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-metrics-client-ca\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.673757 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.673727    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 07 13:59:39.673757 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.673737    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 07 13:59:39.673923 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.673811    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 07 13:59:39.682178 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.682148    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-node-exporter-accelerators-collector-config\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.684068 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.684044    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-node-exporter-tls\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.684181 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.684112    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.684833 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.684813    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx7z7\" (UniqueName: \"kubernetes.io/projected/3ceb2c46-6927-46bc-a86a-f74c0ec80d41-kube-api-access-zx7z7\") pod \"node-exporter-btsmx\" (UID: \"3ceb2c46-6927-46bc-a86a-f74c0ec80d41\") " pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.700456 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.700424    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kp7f5\""
Sep 07 13:59:39.708359 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.708336    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-btsmx"
Sep 07 13:59:39.720049 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:59:39.720022    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ceb2c46_6927_46bc_a86a_f74c0ec80d41.slice/crio-e1a1392fff0b9aa7edd6734529bde1c70230f6a3aa0eeee1d2002d6e3c73c423 WatchSource:0}: Error finding container e1a1392fff0b9aa7edd6734529bde1c70230f6a3aa0eeee1d2002d6e3c73c423: Status 404 returned error can't find the container with id e1a1392fff0b9aa7edd6734529bde1c70230f6a3aa0eeee1d2002d6e3c73c423
Sep 07 13:59:39.990400 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:39.990317    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-btsmx" event={"ID":"3ceb2c46-6927-46bc-a86a-f74c0ec80d41","Type":"ContainerStarted","Data":"e1a1392fff0b9aa7edd6734529bde1c70230f6a3aa0eeee1d2002d6e3c73c423"}
Sep 07 13:59:40.995490 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:40.995401    2581 generic.go:356] "Generic (PLEG): container finished" podID="3ceb2c46-6927-46bc-a86a-f74c0ec80d41" containerID="42d5c48c779892a63f02758760baae5ddedf79eb83aa242066000758a21d211c" exitCode=0
Sep 07 13:59:40.995490 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:40.995457    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-btsmx" event={"ID":"3ceb2c46-6927-46bc-a86a-f74c0ec80d41","Type":"ContainerDied","Data":"42d5c48c779892a63f02758760baae5ddedf79eb83aa242066000758a21d211c"}
Sep 07 13:59:42.000750 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.000717    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-btsmx" event={"ID":"3ceb2c46-6927-46bc-a86a-f74c0ec80d41","Type":"ContainerStarted","Data":"f822ac819381712ed8908afae2698853e69478c70337dd21cb255f7ac94ba7ee"}
Sep 07 13:59:42.001234 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.000774    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-btsmx" event={"ID":"3ceb2c46-6927-46bc-a86a-f74c0ec80d41","Type":"ContainerStarted","Data":"c320505521ec55bed928efd043e40694ecf83c8152d6e020663f1fbadb01137a"}
Sep 07 13:59:42.035635 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.035576    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-btsmx" podStartSLOduration=2.020824637 podStartE2EDuration="3.035557511s" totalImagesPullingTime="949.864037ms" totalInitContainerRuntime="64.868837ms" isStatefulPod=true podCreationTimestamp="2026-09-07 13:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:59:42.034106125 +0000 UTC m=+123.034534545" watchObservedRunningTime="2026-09-07 13:59:42.035557511 +0000 UTC m=+123.035985903"
Sep 07 13:59:42.392412 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.392371    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6694465ff-8cj6w"]
Sep 07 13:59:42.396025 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.396001    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.398602 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.398574    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 07 13:59:42.398602 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.398582    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-23i96trnki29n\""
Sep 07 13:59:42.398794 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.398585    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 07 13:59:42.398922 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.398908    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 07 13:59:42.398981 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.398963    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 07 13:59:42.399033 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.398979    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 07 13:59:42.399033 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.398984    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6qhrp\""
Sep 07 13:59:42.409774 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.409754    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6694465ff-8cj6w"]
Sep 07 13:59:42.496158 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.496108    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69d6d779-9b56-4220-b354-096a66073b3a-secret-grpc-tls\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.496410 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.496165    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/69d6d779-9b56-4220-b354-096a66073b3a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.496410 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.496202    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nskk\" (UniqueName: \"kubernetes.io/projected/69d6d779-9b56-4220-b354-096a66073b3a-kube-api-access-8nskk\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.496410 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.496272    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69d6d779-9b56-4220-b354-096a66073b3a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.496410 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.496322    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69d6d779-9b56-4220-b354-096a66073b3a-metrics-client-ca\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.496410 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.496360    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/69d6d779-9b56-4220-b354-096a66073b3a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.496759 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.496431    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/69d6d779-9b56-4220-b354-096a66073b3a-secret-thanos-querier-tls\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.496759 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.496466    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69d6d779-9b56-4220-b354-096a66073b3a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.597370 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.597332    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69d6d779-9b56-4220-b354-096a66073b3a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.597370 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.597375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69d6d779-9b56-4220-b354-096a66073b3a-metrics-client-ca\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.597603 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.597397    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/69d6d779-9b56-4220-b354-096a66073b3a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.597603 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.597430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/69d6d779-9b56-4220-b354-096a66073b3a-secret-thanos-querier-tls\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.597603 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.597449    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69d6d779-9b56-4220-b354-096a66073b3a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.597603 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.597483    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69d6d779-9b56-4220-b354-096a66073b3a-secret-grpc-tls\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.597603 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.597505    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/69d6d779-9b56-4220-b354-096a66073b3a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.597603 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.597531    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nskk\" (UniqueName: \"kubernetes.io/projected/69d6d779-9b56-4220-b354-096a66073b3a-kube-api-access-8nskk\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.598298 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.598257    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69d6d779-9b56-4220-b354-096a66073b3a-metrics-client-ca\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.600225 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.600201    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/69d6d779-9b56-4220-b354-096a66073b3a-secret-thanos-querier-tls\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.600434 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.600409    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69d6d779-9b56-4220-b354-096a66073b3a-secret-grpc-tls\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.600517 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.600472    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/69d6d779-9b56-4220-b354-096a66073b3a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.600517 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.600497    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69d6d779-9b56-4220-b354-096a66073b3a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.600670 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.600518    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69d6d779-9b56-4220-b354-096a66073b3a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.600670 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.600589    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/69d6d779-9b56-4220-b354-096a66073b3a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.609284 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.609261    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nskk\" (UniqueName: \"kubernetes.io/projected/69d6d779-9b56-4220-b354-096a66073b3a-kube-api-access-8nskk\") pod \"thanos-querier-6694465ff-8cj6w\" (UID: \"69d6d779-9b56-4220-b354-096a66073b3a\") " pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.705625 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.705543    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:42.988228 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:42.988145    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6694465ff-8cj6w"]
Sep 07 13:59:42.991132 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:59:42.991110    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69d6d779_9b56_4220_b354_096a66073b3a.slice/crio-223644cdef59d4a8ee3f171be8298b6ec8204ce61fdd4185b94ce584a5f35863 WatchSource:0}: Error finding container 223644cdef59d4a8ee3f171be8298b6ec8204ce61fdd4185b94ce584a5f35863: Status 404 returned error can't find the container with id 223644cdef59d4a8ee3f171be8298b6ec8204ce61fdd4185b94ce584a5f35863
Sep 07 13:59:43.004777 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:43.004750    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w" event={"ID":"69d6d779-9b56-4220-b354-096a66073b3a","Type":"ContainerStarted","Data":"223644cdef59d4a8ee3f171be8298b6ec8204ce61fdd4185b94ce584a5f35863"}
Sep 07 13:59:43.806184 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:43.806148    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7f9c5467b7-zr55b"]
Sep 07 13:59:43.809550 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:43.809528    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:43.813573 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:43.813505    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 07 13:59:43.813573 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:43.813529    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 07 13:59:43.813573 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:43.813554    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jbqtk\""
Sep 07 13:59:43.813873 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:43.813713    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 07 13:59:43.813873 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:43.813804    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 07 13:59:43.813873 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:43.813846    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-471ecccof67b3\""
Sep 07 13:59:43.822470 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:43.822447    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7f9c5467b7-zr55b"]
Sep 07 13:59:43.909389 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:43.909343    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0f3a5789-8dff-487a-95ea-52bcdb782875-audit-log\") pod \"metrics-server-7f9c5467b7-zr55b\" (UID: \"0f3a5789-8dff-487a-95ea-52bcdb782875\") " pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:43.909598 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:43.909434    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0f3a5789-8dff-487a-95ea-52bcdb782875-secret-metrics-server-tls\") pod \"metrics-server-7f9c5467b7-zr55b\" (UID: \"0f3a5789-8dff-487a-95ea-52bcdb782875\") " pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:43.909598 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:43.909487    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0f3a5789-8dff-487a-95ea-52bcdb782875-secret-metrics-server-client-certs\") pod \"metrics-server-7f9c5467b7-zr55b\" (UID: \"0f3a5789-8dff-487a-95ea-52bcdb782875\") " pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:43.909598 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:43.909525    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f3a5789-8dff-487a-95ea-52bcdb782875-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f9c5467b7-zr55b\" (UID: \"0f3a5789-8dff-487a-95ea-52bcdb782875\") " pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:43.909598 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:43.909552    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qnfs\" (UniqueName: \"kubernetes.io/projected/0f3a5789-8dff-487a-95ea-52bcdb782875-kube-api-access-4qnfs\") pod \"metrics-server-7f9c5467b7-zr55b\" (UID: \"0f3a5789-8dff-487a-95ea-52bcdb782875\") " pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:43.909749 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:43.909630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0f3a5789-8dff-487a-95ea-52bcdb782875-metrics-server-audit-profiles\") pod \"metrics-server-7f9c5467b7-zr55b\" (UID: \"0f3a5789-8dff-487a-95ea-52bcdb782875\") " pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:43.909749 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:43.909675    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f3a5789-8dff-487a-95ea-52bcdb782875-client-ca-bundle\") pod \"metrics-server-7f9c5467b7-zr55b\" (UID: \"0f3a5789-8dff-487a-95ea-52bcdb782875\") " pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:44.010539 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.010506    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0f3a5789-8dff-487a-95ea-52bcdb782875-audit-log\") pod \"metrics-server-7f9c5467b7-zr55b\" (UID: \"0f3a5789-8dff-487a-95ea-52bcdb782875\") " pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:44.011005 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.010597    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0f3a5789-8dff-487a-95ea-52bcdb782875-secret-metrics-server-tls\") pod \"metrics-server-7f9c5467b7-zr55b\" (UID: \"0f3a5789-8dff-487a-95ea-52bcdb782875\") " pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:44.011005 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.010627    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0f3a5789-8dff-487a-95ea-52bcdb782875-secret-metrics-server-client-certs\") pod \"metrics-server-7f9c5467b7-zr55b\" (UID: \"0f3a5789-8dff-487a-95ea-52bcdb782875\") " pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:44.011005 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.010774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f3a5789-8dff-487a-95ea-52bcdb782875-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f9c5467b7-zr55b\" (UID: \"0f3a5789-8dff-487a-95ea-52bcdb782875\") " pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:44.011005 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.010811    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qnfs\" (UniqueName: \"kubernetes.io/projected/0f3a5789-8dff-487a-95ea-52bcdb782875-kube-api-access-4qnfs\") pod \"metrics-server-7f9c5467b7-zr55b\" (UID: \"0f3a5789-8dff-487a-95ea-52bcdb782875\") " pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:44.011005 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.010846    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0f3a5789-8dff-487a-95ea-52bcdb782875-metrics-server-audit-profiles\") pod \"metrics-server-7f9c5467b7-zr55b\" (UID: \"0f3a5789-8dff-487a-95ea-52bcdb782875\") " pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:44.011005 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.010885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f3a5789-8dff-487a-95ea-52bcdb782875-client-ca-bundle\") pod \"metrics-server-7f9c5467b7-zr55b\" (UID: \"0f3a5789-8dff-487a-95ea-52bcdb782875\") " pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:44.011005 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.010918    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0f3a5789-8dff-487a-95ea-52bcdb782875-audit-log\") pod \"metrics-server-7f9c5467b7-zr55b\" (UID: \"0f3a5789-8dff-487a-95ea-52bcdb782875\") " pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:44.011547 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.011512    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f3a5789-8dff-487a-95ea-52bcdb782875-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f9c5467b7-zr55b\" (UID: \"0f3a5789-8dff-487a-95ea-52bcdb782875\") " pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:44.011968 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.011910    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0f3a5789-8dff-487a-95ea-52bcdb782875-metrics-server-audit-profiles\") pod \"metrics-server-7f9c5467b7-zr55b\" (UID: \"0f3a5789-8dff-487a-95ea-52bcdb782875\") " pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:44.013400 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.013377    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0f3a5789-8dff-487a-95ea-52bcdb782875-secret-metrics-server-tls\") pod \"metrics-server-7f9c5467b7-zr55b\" (UID: \"0f3a5789-8dff-487a-95ea-52bcdb782875\") " pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:44.013500 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.013402    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0f3a5789-8dff-487a-95ea-52bcdb782875-secret-metrics-server-client-certs\") pod \"metrics-server-7f9c5467b7-zr55b\" (UID: \"0f3a5789-8dff-487a-95ea-52bcdb782875\") " pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:44.014002 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.013978    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f3a5789-8dff-487a-95ea-52bcdb782875-client-ca-bundle\") pod \"metrics-server-7f9c5467b7-zr55b\" (UID: \"0f3a5789-8dff-487a-95ea-52bcdb782875\") " pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:44.020191 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.020170    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qnfs\" (UniqueName: \"kubernetes.io/projected/0f3a5789-8dff-487a-95ea-52bcdb782875-kube-api-access-4qnfs\") pod \"metrics-server-7f9c5467b7-zr55b\" (UID: \"0f3a5789-8dff-487a-95ea-52bcdb782875\") " pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:44.122447 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.122408    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 13:59:44.140394 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.140350    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-pcwvv"]
Sep 07 13:59:44.144159 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.144131    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-pcwvv"
Sep 07 13:59:44.146764 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.146556    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-smgrn\""
Sep 07 13:59:44.146764 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.146610    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 07 13:59:44.151989 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.151966    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-pcwvv"]
Sep 07 13:59:44.314574 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.314533    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4dd88c76-afbd-47c3-9d1b-80386b202e95-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-pcwvv\" (UID: \"4dd88c76-afbd-47c3-9d1b-80386b202e95\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-pcwvv"
Sep 07 13:59:44.314747 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.314585    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lg7f\" (UniqueName: \"kubernetes.io/projected/4dd88c76-afbd-47c3-9d1b-80386b202e95-kube-api-access-6lg7f\") pod \"monitoring-plugin-85bbbbbf4-pcwvv\" (UID: \"4dd88c76-afbd-47c3-9d1b-80386b202e95\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-pcwvv"
Sep 07 13:59:44.404649 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.404625    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7f9c5467b7-zr55b"]
Sep 07 13:59:44.407329 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:59:44.407282    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f3a5789_8dff_487a_95ea_52bcdb782875.slice/crio-485f0eaf883b7ac5563cbbbdbd71cef73f684c22fdc5393cbdc816d1c2bf4ad3 WatchSource:0}: Error finding container 485f0eaf883b7ac5563cbbbdbd71cef73f684c22fdc5393cbdc816d1c2bf4ad3: Status 404 returned error can't find the container with id 485f0eaf883b7ac5563cbbbdbd71cef73f684c22fdc5393cbdc816d1c2bf4ad3
Sep 07 13:59:44.415150 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.415126    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4dd88c76-afbd-47c3-9d1b-80386b202e95-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-pcwvv\" (UID: \"4dd88c76-afbd-47c3-9d1b-80386b202e95\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-pcwvv"
Sep 07 13:59:44.415244 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.415162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lg7f\" (UniqueName: \"kubernetes.io/projected/4dd88c76-afbd-47c3-9d1b-80386b202e95-kube-api-access-6lg7f\") pod \"monitoring-plugin-85bbbbbf4-pcwvv\" (UID: \"4dd88c76-afbd-47c3-9d1b-80386b202e95\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-pcwvv"
Sep 07 13:59:44.417513 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.417489    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4dd88c76-afbd-47c3-9d1b-80386b202e95-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-pcwvv\" (UID: \"4dd88c76-afbd-47c3-9d1b-80386b202e95\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-pcwvv"
Sep 07 13:59:44.423339 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.423318    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lg7f\" (UniqueName: \"kubernetes.io/projected/4dd88c76-afbd-47c3-9d1b-80386b202e95-kube-api-access-6lg7f\") pod \"monitoring-plugin-85bbbbbf4-pcwvv\" (UID: \"4dd88c76-afbd-47c3-9d1b-80386b202e95\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-pcwvv"
Sep 07 13:59:44.459342 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.459309    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-pcwvv"
Sep 07 13:59:44.734979 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:44.734891    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-pcwvv"]
Sep 07 13:59:45.014089 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:45.014005    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b" event={"ID":"0f3a5789-8dff-487a-95ea-52bcdb782875","Type":"ContainerStarted","Data":"485f0eaf883b7ac5563cbbbdbd71cef73f684c22fdc5393cbdc816d1c2bf4ad3"}
Sep 07 13:59:45.104582 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:59:45.104551    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dd88c76_afbd_47c3_9d1b_80386b202e95.slice/crio-6d8f38bb0533d3ba2af86d6f4a191650a44ba7537fb81f3d85522217cc8be99c WatchSource:0}: Error finding container 6d8f38bb0533d3ba2af86d6f4a191650a44ba7537fb81f3d85522217cc8be99c: Status 404 returned error can't find the container with id 6d8f38bb0533d3ba2af86d6f4a191650a44ba7537fb81f3d85522217cc8be99c
Sep 07 13:59:46.023224 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:46.023096    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-pcwvv" event={"ID":"4dd88c76-afbd-47c3-9d1b-80386b202e95","Type":"ContainerStarted","Data":"6d8f38bb0533d3ba2af86d6f4a191650a44ba7537fb81f3d85522217cc8be99c"}
Sep 07 13:59:46.028533 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:46.028483    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w" event={"ID":"69d6d779-9b56-4220-b354-096a66073b3a","Type":"ContainerStarted","Data":"a14e2e29d4917218f607fdb7cfac463d36bd0228a563dc725e51b2141e6c0e8b"}
Sep 07 13:59:46.028666 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:46.028561    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w" event={"ID":"69d6d779-9b56-4220-b354-096a66073b3a","Type":"ContainerStarted","Data":"c69a34cceaac0f5810b3ed130bd8aaae51c91c2b63d91f817087de890d20ef53"}
Sep 07 13:59:46.028982 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:46.028956    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w" event={"ID":"69d6d779-9b56-4220-b354-096a66073b3a","Type":"ContainerStarted","Data":"4e6f2ff1e89c03c3c6d54d297aab72547f51dd0a9f6551d9b3729b0f2b4c1683"}
Sep 07 13:59:47.036061 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:47.036028    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w" event={"ID":"69d6d779-9b56-4220-b354-096a66073b3a","Type":"ContainerStarted","Data":"cf068504509a209860d726508ce9e8e1cf7441082c711c601390b765ccc85085"}
Sep 07 13:59:47.036487 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:47.036152    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w" event={"ID":"69d6d779-9b56-4220-b354-096a66073b3a","Type":"ContainerStarted","Data":"535697c21465329f2420438b6ff1f284a30320d1fd482299743c8da2c5252494"}
Sep 07 13:59:47.037660 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:47.037634    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b" event={"ID":"0f3a5789-8dff-487a-95ea-52bcdb782875","Type":"ContainerStarted","Data":"99c6aa6689e0854e869c8c218a9395e5a6c50347a1c0e20ec89d006cc642331b"}
Sep 07 13:59:47.039269 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:47.039247    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-pcwvv" event={"ID":"4dd88c76-afbd-47c3-9d1b-80386b202e95","Type":"ContainerStarted","Data":"5d46beaf7cf27b847f981ea76bc4af1943ed21c11fbb25e7c104ba31682d63ab"}
Sep 07 13:59:47.039668 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:47.039652    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-pcwvv"
Sep 07 13:59:47.044588 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:47.044567    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-pcwvv"
Sep 07 13:59:47.056670 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:47.056624    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b" podStartSLOduration=1.624302668 podStartE2EDuration="4.056605342s" totalImagesPullingTime="2.432302674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:59:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:59:47.055498883 +0000 UTC m=+128.055927280" watchObservedRunningTime="2026-09-07 13:59:47.056605342 +0000 UTC m=+128.057033788"
Sep 07 13:59:47.071087 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:47.071011    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-pcwvv" podStartSLOduration=1.33301463 podStartE2EDuration="3.070995158s" totalImagesPullingTime="1.737980528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:59:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:59:47.070146274 +0000 UTC m=+128.070574669" watchObservedRunningTime="2026-09-07 13:59:47.070995158 +0000 UTC m=+128.071423577"
Sep 07 13:59:48.046465 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:48.046434    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w" event={"ID":"69d6d779-9b56-4220-b354-096a66073b3a","Type":"ContainerStarted","Data":"285f6d809217aa128a08dc41fa31044ec22dd72cb7a85b64a4ea714a59cec711"}
Sep 07 13:59:48.068990 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:48.068942    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w" podStartSLOduration=2.424356649 podStartE2EDuration="6.068927055s" totalImagesPullingTime="3.644570406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:59:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:59:48.067992755 +0000 UTC m=+129.068421148" watchObservedRunningTime="2026-09-07 13:59:48.068927055 +0000 UTC m=+129.069355442"
Sep 07 13:59:48.253852 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:48.253815    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs\") pod \"network-metrics-daemon-z7zzr\" (UID: \"f487c012-9aff-45d1-af45-3dd071a10e2e\") " pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:59:48.256339 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:48.256282    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f487c012-9aff-45d1-af45-3dd071a10e2e-metrics-certs\") pod \"network-metrics-daemon-z7zzr\" (UID: \"f487c012-9aff-45d1-af45-3dd071a10e2e\") " pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:59:48.336590 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:48.336559    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5p88d\""
Sep 07 13:59:48.344681 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:48.344656    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7zzr"
Sep 07 13:59:48.619039 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:48.618898    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z7zzr"]
Sep 07 13:59:48.621588 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:59:48.621562    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf487c012_9aff_45d1_af45_3dd071a10e2e.slice/crio-6f4ff6133f97b017d7095891b1583d8a45afdb91c1f7e3fb3afde956fb0a5c29 WatchSource:0}: Error finding container 6f4ff6133f97b017d7095891b1583d8a45afdb91c1f7e3fb3afde956fb0a5c29: Status 404 returned error can't find the container with id 6f4ff6133f97b017d7095891b1583d8a45afdb91c1f7e3fb3afde956fb0a5c29
Sep 07 13:59:49.051005 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:49.050914    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z7zzr" event={"ID":"f487c012-9aff-45d1-af45-3dd071a10e2e","Type":"ContainerStarted","Data":"6f4ff6133f97b017d7095891b1583d8a45afdb91c1f7e3fb3afde956fb0a5c29"}
Sep 07 13:59:49.051474 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:49.051413    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:49.328067 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:49.328031    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-zg24k"]
Sep 07 13:59:49.333483 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:49.333463    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-zg24k"
Sep 07 13:59:49.336193 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:49.336173    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 07 13:59:49.336262 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:49.336217    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 07 13:59:49.336262 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:49.336246    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5q6sv\""
Sep 07 13:59:49.342308 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:49.342272    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-zg24k"]
Sep 07 13:59:49.364281 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:49.364252    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67kfv\" (UniqueName: \"kubernetes.io/projected/221b3998-648e-4b69-89fb-ebd2ed7abdac-kube-api-access-67kfv\") pod \"downloads-85d98c998f-zg24k\" (UID: \"221b3998-648e-4b69-89fb-ebd2ed7abdac\") " pod="openshift-console/downloads-85d98c998f-zg24k"
Sep 07 13:59:49.465787 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:49.465746    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67kfv\" (UniqueName: \"kubernetes.io/projected/221b3998-648e-4b69-89fb-ebd2ed7abdac-kube-api-access-67kfv\") pod \"downloads-85d98c998f-zg24k\" (UID: \"221b3998-648e-4b69-89fb-ebd2ed7abdac\") " pod="openshift-console/downloads-85d98c998f-zg24k"
Sep 07 13:59:49.479860 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:49.479826    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67kfv\" (UniqueName: \"kubernetes.io/projected/221b3998-648e-4b69-89fb-ebd2ed7abdac-kube-api-access-67kfv\") pod \"downloads-85d98c998f-zg24k\" (UID: \"221b3998-648e-4b69-89fb-ebd2ed7abdac\") " pod="openshift-console/downloads-85d98c998f-zg24k"
Sep 07 13:59:49.537329 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:49.537241    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-748b686f65-q9rz7"]
Sep 07 13:59:49.642914 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:49.642832    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-zg24k"
Sep 07 13:59:50.056009 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:50.055981    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z7zzr" event={"ID":"f487c012-9aff-45d1-af45-3dd071a10e2e","Type":"ContainerStarted","Data":"e74b0bf6b82b9bf166794f1e758af4e402318fae514e36a19e2b63be08ff2241"}
Sep 07 13:59:50.062162 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:50.062137    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6694465ff-8cj6w"
Sep 07 13:59:50.086240 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:50.086206    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-zg24k"]
Sep 07 13:59:50.090088 ip-10-0-139-134 kubenswrapper[2581]: W0907 13:59:50.090051    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod221b3998_648e_4b69_89fb_ebd2ed7abdac.slice/crio-9cec1cc8a95c41f2d5467b834adcd91e1f4c3c1d85f0270629036652f3b28df4 WatchSource:0}: Error finding container 9cec1cc8a95c41f2d5467b834adcd91e1f4c3c1d85f0270629036652f3b28df4: Status 404 returned error can't find the container with id 9cec1cc8a95c41f2d5467b834adcd91e1f4c3c1d85f0270629036652f3b28df4
Sep 07 13:59:51.061952 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:51.061912    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z7zzr" event={"ID":"f487c012-9aff-45d1-af45-3dd071a10e2e","Type":"ContainerStarted","Data":"de34592c7acacc80ec838528aadba36940a6224384f822e32ad3cd3555d81fae"}
Sep 07 13:59:51.063583 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:51.063553    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-zg24k" event={"ID":"221b3998-648e-4b69-89fb-ebd2ed7abdac","Type":"ContainerStarted","Data":"9cec1cc8a95c41f2d5467b834adcd91e1f4c3c1d85f0270629036652f3b28df4"}
Sep 07 13:59:51.079615 ip-10-0-139-134 kubenswrapper[2581]: I0907 13:59:51.079558    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z7zzr" podStartSLOduration=130.841119913 podStartE2EDuration="2m12.079539917s" totalImagesPullingTime="1.238420004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:59:51.078183201 +0000 UTC m=+132.078611594" watchObservedRunningTime="2026-09-07 13:59:51.079539917 +0000 UTC m=+132.079968310"
Sep 07 14:00:04.122959 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:04.122925    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 14:00:04.123478 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:04.122990    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 14:00:07.131954 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:07.131909    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-zg24k" event={"ID":"221b3998-648e-4b69-89fb-ebd2ed7abdac","Type":"ContainerStarted","Data":"d304368d15afe4738921c2177254a276cc2a8662f0fbae0e00df09555e1de356"}
Sep 07 14:00:07.132456 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:07.132140    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-zg24k"
Sep 07 14:00:07.144262 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:07.144231    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-zg24k"
Sep 07 14:00:07.153177 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:07.153124    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-zg24k" podStartSLOduration=1.883365366 podStartE2EDuration="18.153107509s" totalImagesPullingTime="16.269742143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 14:00:07.152019106 +0000 UTC m=+148.152447500" watchObservedRunningTime="2026-09-07 14:00:07.153107509 +0000 UTC m=+148.153535903"
Sep 07 14:00:08.866151 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:08.866119    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79b94b848d-dm4x2"]
Sep 07 14:00:08.894116 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:08.894083    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79b94b848d-dm4x2"]
Sep 07 14:00:08.894303 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:08.894199    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:08.898226 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:08.898196    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 07 14:00:08.898896 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:08.898871    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 07 14:00:08.899000 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:08.898936    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 07 14:00:08.899484 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:08.899461    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 07 14:00:08.899629 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:08.899609    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 07 14:00:08.901334 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:08.901315    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g7mmf\""
Sep 07 14:00:08.905884 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:08.905861    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 07 14:00:09.058578 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.058541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-trusted-ca-bundle\") pod \"console-79b94b848d-dm4x2\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") " pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.058755 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.058615    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-service-ca\") pod \"console-79b94b848d-dm4x2\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") " pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.058755 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.058674    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac3a004f-5160-4391-8039-55bb12d64ddf-console-serving-cert\") pod \"console-79b94b848d-dm4x2\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") " pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.058755 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.058733    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac3a004f-5160-4391-8039-55bb12d64ddf-console-oauth-config\") pod \"console-79b94b848d-dm4x2\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") " pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.058921 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.058787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-oauth-serving-cert\") pod \"console-79b94b848d-dm4x2\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") " pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.058921 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.058829    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcntz\" (UniqueName: \"kubernetes.io/projected/ac3a004f-5160-4391-8039-55bb12d64ddf-kube-api-access-bcntz\") pod \"console-79b94b848d-dm4x2\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") " pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.058921 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.058860    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-console-config\") pod \"console-79b94b848d-dm4x2\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") " pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.159419 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.159318    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-service-ca\") pod \"console-79b94b848d-dm4x2\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") " pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.159419 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.159393    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac3a004f-5160-4391-8039-55bb12d64ddf-console-serving-cert\") pod \"console-79b94b848d-dm4x2\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") " pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.159657 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.159424    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac3a004f-5160-4391-8039-55bb12d64ddf-console-oauth-config\") pod \"console-79b94b848d-dm4x2\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") " pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.159657 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.159460    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-oauth-serving-cert\") pod \"console-79b94b848d-dm4x2\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") " pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.159657 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.159491    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcntz\" (UniqueName: \"kubernetes.io/projected/ac3a004f-5160-4391-8039-55bb12d64ddf-kube-api-access-bcntz\") pod \"console-79b94b848d-dm4x2\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") " pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.159657 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.159637    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-console-config\") pod \"console-79b94b848d-dm4x2\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") " pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.159867 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.159693    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-trusted-ca-bundle\") pod \"console-79b94b848d-dm4x2\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") " pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.160162 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.160132    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-oauth-serving-cert\") pod \"console-79b94b848d-dm4x2\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") " pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.160252 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.160138    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-service-ca\") pod \"console-79b94b848d-dm4x2\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") " pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.160592 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.160570    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-trusted-ca-bundle\") pod \"console-79b94b848d-dm4x2\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") " pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.160706 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.160678    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-console-config\") pod \"console-79b94b848d-dm4x2\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") " pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.162569 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.162543    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac3a004f-5160-4391-8039-55bb12d64ddf-console-oauth-config\") pod \"console-79b94b848d-dm4x2\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") " pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.163014 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.162992    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac3a004f-5160-4391-8039-55bb12d64ddf-console-serving-cert\") pod \"console-79b94b848d-dm4x2\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") " pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.171527 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.171497    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcntz\" (UniqueName: \"kubernetes.io/projected/ac3a004f-5160-4391-8039-55bb12d64ddf-kube-api-access-bcntz\") pod \"console-79b94b848d-dm4x2\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") " pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.207476 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.207441    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:09.525299 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:09.525259    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79b94b848d-dm4x2"]
Sep 07 14:00:09.527603 ip-10-0-139-134 kubenswrapper[2581]: W0907 14:00:09.527569    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac3a004f_5160_4391_8039_55bb12d64ddf.slice/crio-f1247f718776db1eaf652123d12c097e3a46adb0a0d2fc87332173bb66157016 WatchSource:0}: Error finding container f1247f718776db1eaf652123d12c097e3a46adb0a0d2fc87332173bb66157016: Status 404 returned error can't find the container with id f1247f718776db1eaf652123d12c097e3a46adb0a0d2fc87332173bb66157016
Sep 07 14:00:10.146824 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:10.146785    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b94b848d-dm4x2" event={"ID":"ac3a004f-5160-4391-8039-55bb12d64ddf","Type":"ContainerStarted","Data":"f1247f718776db1eaf652123d12c097e3a46adb0a0d2fc87332173bb66157016"}
Sep 07 14:00:14.562968 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:14.562902    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-748b686f65-q9rz7" podUID="54faae80-3d59-4007-8e7d-8226638369fe" containerName="registry" containerID="cri-o://439496608c7b1ad59f5ad35048645932858f8004b69aa8229841bc92c1e3cea3" gracePeriod=30
Sep 07 14:00:14.911234 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:14.911197    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 14:00:14.915335 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:14.915276    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9t82g\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-kube-api-access-9t82g\") pod \"54faae80-3d59-4007-8e7d-8226638369fe\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") "
Sep 07 14:00:14.915492 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:14.915371    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54faae80-3d59-4007-8e7d-8226638369fe-installation-pull-secrets\") pod \"54faae80-3d59-4007-8e7d-8226638369fe\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") "
Sep 07 14:00:14.915492 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:14.915400    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54faae80-3d59-4007-8e7d-8226638369fe-image-registry-private-configuration\") pod \"54faae80-3d59-4007-8e7d-8226638369fe\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") "
Sep 07 14:00:14.915492 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:14.915442    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-bound-sa-token\") pod \"54faae80-3d59-4007-8e7d-8226638369fe\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") "
Sep 07 14:00:14.915492 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:14.915468    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls\") pod \"54faae80-3d59-4007-8e7d-8226638369fe\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") "
Sep 07 14:00:14.915687 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:14.915511    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54faae80-3d59-4007-8e7d-8226638369fe-registry-certificates\") pod \"54faae80-3d59-4007-8e7d-8226638369fe\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") "
Sep 07 14:00:14.915687 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:14.915534    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54faae80-3d59-4007-8e7d-8226638369fe-trusted-ca\") pod \"54faae80-3d59-4007-8e7d-8226638369fe\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") "
Sep 07 14:00:14.915687 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:14.915571    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54faae80-3d59-4007-8e7d-8226638369fe-ca-trust-extracted\") pod \"54faae80-3d59-4007-8e7d-8226638369fe\" (UID: \"54faae80-3d59-4007-8e7d-8226638369fe\") "
Sep 07 14:00:14.916449 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:14.916151    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54faae80-3d59-4007-8e7d-8226638369fe-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "54faae80-3d59-4007-8e7d-8226638369fe" (UID: "54faae80-3d59-4007-8e7d-8226638369fe"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 14:00:14.916449 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:14.916349    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54faae80-3d59-4007-8e7d-8226638369fe-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "54faae80-3d59-4007-8e7d-8226638369fe" (UID: "54faae80-3d59-4007-8e7d-8226638369fe"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 14:00:14.920445 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:14.919529    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54faae80-3d59-4007-8e7d-8226638369fe-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "54faae80-3d59-4007-8e7d-8226638369fe" (UID: "54faae80-3d59-4007-8e7d-8226638369fe"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:00:14.920445 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:14.919692    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-kube-api-access-9t82g" (OuterVolumeSpecName: "kube-api-access-9t82g") pod "54faae80-3d59-4007-8e7d-8226638369fe" (UID: "54faae80-3d59-4007-8e7d-8226638369fe"). InnerVolumeSpecName "kube-api-access-9t82g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 14:00:14.924089 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:14.921478    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54faae80-3d59-4007-8e7d-8226638369fe-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "54faae80-3d59-4007-8e7d-8226638369fe" (UID: "54faae80-3d59-4007-8e7d-8226638369fe"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:00:14.924089 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:14.922566    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "54faae80-3d59-4007-8e7d-8226638369fe" (UID: "54faae80-3d59-4007-8e7d-8226638369fe"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 14:00:14.924089 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:14.923672    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "54faae80-3d59-4007-8e7d-8226638369fe" (UID: "54faae80-3d59-4007-8e7d-8226638369fe"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 14:00:14.927133 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:14.927111    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54faae80-3d59-4007-8e7d-8226638369fe-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "54faae80-3d59-4007-8e7d-8226638369fe" (UID: "54faae80-3d59-4007-8e7d-8226638369fe"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 14:00:15.016420 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:15.016369    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t82g\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-kube-api-access-9t82g\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:00:15.016420 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:15.016408    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54faae80-3d59-4007-8e7d-8226638369fe-installation-pull-secrets\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:00:15.016668 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:15.016426    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54faae80-3d59-4007-8e7d-8226638369fe-image-registry-private-configuration\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:00:15.016668 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:15.016453    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-bound-sa-token\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:00:15.016668 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:15.016468    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54faae80-3d59-4007-8e7d-8226638369fe-registry-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:00:15.016668 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:15.016481    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54faae80-3d59-4007-8e7d-8226638369fe-registry-certificates\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:00:15.016668 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:15.016490    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54faae80-3d59-4007-8e7d-8226638369fe-trusted-ca\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:00:15.016668 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:15.016498    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54faae80-3d59-4007-8e7d-8226638369fe-ca-trust-extracted\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:00:15.172470 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:15.172378    2581 generic.go:356] "Generic (PLEG): container finished" podID="54faae80-3d59-4007-8e7d-8226638369fe" containerID="439496608c7b1ad59f5ad35048645932858f8004b69aa8229841bc92c1e3cea3" exitCode=0
Sep 07 14:00:15.172626 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:15.172534    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-748b686f65-q9rz7"
Sep 07 14:00:15.172869 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:15.172833    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-748b686f65-q9rz7" event={"ID":"54faae80-3d59-4007-8e7d-8226638369fe","Type":"ContainerDied","Data":"439496608c7b1ad59f5ad35048645932858f8004b69aa8229841bc92c1e3cea3"}
Sep 07 14:00:15.172998 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:15.172904    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-748b686f65-q9rz7" event={"ID":"54faae80-3d59-4007-8e7d-8226638369fe","Type":"ContainerDied","Data":"a38f0e5dc2b39731ce1eb094e6ebbd5cf8c8eb9f763d88516e6314c766ffe830"}
Sep 07 14:00:15.172998 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:15.172953    2581 scope.go:117] "RemoveContainer" containerID="439496608c7b1ad59f5ad35048645932858f8004b69aa8229841bc92c1e3cea3"
Sep 07 14:00:15.175639 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:15.175611    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b94b848d-dm4x2" event={"ID":"ac3a004f-5160-4391-8039-55bb12d64ddf","Type":"ContainerStarted","Data":"0ac7674a2c97f42e2914dc8ac7fdd155a0264281444ee7210d6294d0aac98857"}
Sep 07 14:00:15.183755 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:15.183700    2581 scope.go:117] "RemoveContainer" containerID="439496608c7b1ad59f5ad35048645932858f8004b69aa8229841bc92c1e3cea3"
Sep 07 14:00:15.184173 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:00:15.184145    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"439496608c7b1ad59f5ad35048645932858f8004b69aa8229841bc92c1e3cea3\": container with ID starting with 439496608c7b1ad59f5ad35048645932858f8004b69aa8229841bc92c1e3cea3 not found: ID does not exist" containerID="439496608c7b1ad59f5ad35048645932858f8004b69aa8229841bc92c1e3cea3"
Sep 07 14:00:15.184257 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:15.184182    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"439496608c7b1ad59f5ad35048645932858f8004b69aa8229841bc92c1e3cea3"} err="failed to get container status \"439496608c7b1ad59f5ad35048645932858f8004b69aa8229841bc92c1e3cea3\": rpc error: code = NotFound desc = could not find container \"439496608c7b1ad59f5ad35048645932858f8004b69aa8229841bc92c1e3cea3\": container with ID starting with 439496608c7b1ad59f5ad35048645932858f8004b69aa8229841bc92c1e3cea3 not found: ID does not exist"
Sep 07 14:00:15.198227 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:15.198175    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79b94b848d-dm4x2" podStartSLOduration=1.981336281 podStartE2EDuration="7.198155511s" totalImagesPullingTime="5.21681923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 14:00:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 14:00:15.196594282 +0000 UTC m=+156.197022682" watchObservedRunningTime="2026-09-07 14:00:15.198155511 +0000 UTC m=+156.198583904"
Sep 07 14:00:15.210270 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:15.210239    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-748b686f65-q9rz7"]
Sep 07 14:00:15.215495 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:15.215463    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-748b686f65-q9rz7"]
Sep 07 14:00:15.521653 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:15.521578    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54faae80-3d59-4007-8e7d-8226638369fe" path="/var/lib/kubelet/pods/54faae80-3d59-4007-8e7d-8226638369fe/volumes"
Sep 07 14:00:19.208123 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:19.208083    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:19.208605 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:19.208419    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:19.213137 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:19.213113    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:20.196479 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:20.196435    2581 generic.go:356] "Generic (PLEG): container finished" podID="270f9ec5-070f-46ba-bc25-ef02408c53a5" containerID="471319e767671bfbdb670399a4ae5876281ccfcce80a1ab771032e6f9edd5e47" exitCode=0
Sep 07 14:00:20.196652 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:20.196513    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq" event={"ID":"270f9ec5-070f-46ba-bc25-ef02408c53a5","Type":"ContainerDied","Data":"471319e767671bfbdb670399a4ae5876281ccfcce80a1ab771032e6f9edd5e47"}
Sep 07 14:00:20.196944 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:20.196931    2581 scope.go:117] "RemoveContainer" containerID="471319e767671bfbdb670399a4ae5876281ccfcce80a1ab771032e6f9edd5e47"
Sep 07 14:00:20.200633 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:20.200611    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:00:21.204524 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:21.204486    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-br4lq" event={"ID":"270f9ec5-070f-46ba-bc25-ef02408c53a5","Type":"ContainerStarted","Data":"873a1012bd3ae17c86a34d34d8e17e29a7b7a0c9a4c5bab54b29b1d48821d3da"}
Sep 07 14:00:24.128195 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:24.128166    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 14:00:24.131927 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:24.131901    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7f9c5467b7-zr55b"
Sep 07 14:00:25.220627 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:25.220590    2581 generic.go:356] "Generic (PLEG): container finished" podID="465c83e0-d454-4446-8f6a-360687eff180" containerID="9631a0c64b5daeaabe32f9be8de5e1592fcf81e656c0d1306adf3944db39f33b" exitCode=0
Sep 07 14:00:25.221112 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:25.220663    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-stcr2" event={"ID":"465c83e0-d454-4446-8f6a-360687eff180","Type":"ContainerDied","Data":"9631a0c64b5daeaabe32f9be8de5e1592fcf81e656c0d1306adf3944db39f33b"}
Sep 07 14:00:25.221112 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:25.220982    2581 scope.go:117] "RemoveContainer" containerID="9631a0c64b5daeaabe32f9be8de5e1592fcf81e656c0d1306adf3944db39f33b"
Sep 07 14:00:26.226157 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:26.226122    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-stcr2" event={"ID":"465c83e0-d454-4446-8f6a-360687eff180","Type":"ContainerStarted","Data":"caaf9b383dd67a1f647c6a6f3fb9b11e89f421f582914c81a3a1963030669b8b"}
Sep 07 14:00:29.238858 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:29.238825    2581 generic.go:356] "Generic (PLEG): container finished" podID="cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4" containerID="75a11bff672f407a5e122cd49b7913c937ece6d4b4dd85bae135c40a0c4c7a47" exitCode=0
Sep 07 14:00:29.239178 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:29.238896    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-lfgqm" event={"ID":"cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4","Type":"ContainerDied","Data":"75a11bff672f407a5e122cd49b7913c937ece6d4b4dd85bae135c40a0c4c7a47"}
Sep 07 14:00:29.239238 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:29.239220    2581 scope.go:117] "RemoveContainer" containerID="75a11bff672f407a5e122cd49b7913c937ece6d4b4dd85bae135c40a0c4c7a47"
Sep 07 14:00:30.244892 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:00:30.244858    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-lfgqm" event={"ID":"cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4","Type":"ContainerStarted","Data":"7e5492d56c202ae9cde26353679e8a3763e5ef26e7ead0497e6a0d85f02111d5"}
Sep 07 14:01:07.073006 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.072970    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65f5f56c9-2t846"]
Sep 07 14:01:07.073448 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.073262    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54faae80-3d59-4007-8e7d-8226638369fe" containerName="registry"
Sep 07 14:01:07.073448 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.073274    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="54faae80-3d59-4007-8e7d-8226638369fe" containerName="registry"
Sep 07 14:01:07.073448 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.073356    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="54faae80-3d59-4007-8e7d-8226638369fe" containerName="registry"
Sep 07 14:01:07.075171 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.075154    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.087548 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.087517    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65f5f56c9-2t846"]
Sep 07 14:01:07.167235 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.167200    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd88f4d3-75f2-40dc-b006-2e55ad107155-console-oauth-config\") pod \"console-65f5f56c9-2t846\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") " pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.167235 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.167238    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-oauth-serving-cert\") pod \"console-65f5f56c9-2t846\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") " pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.167487 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.167256    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd88f4d3-75f2-40dc-b006-2e55ad107155-console-serving-cert\") pod \"console-65f5f56c9-2t846\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") " pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.167487 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.167273    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-console-config\") pod \"console-65f5f56c9-2t846\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") " pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.167487 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.167363    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64zt6\" (UniqueName: \"kubernetes.io/projected/fd88f4d3-75f2-40dc-b006-2e55ad107155-kube-api-access-64zt6\") pod \"console-65f5f56c9-2t846\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") " pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.167487 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.167435    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-service-ca\") pod \"console-65f5f56c9-2t846\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") " pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.167636 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.167485    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-trusted-ca-bundle\") pod \"console-65f5f56c9-2t846\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") " pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.267976 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.267940    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-service-ca\") pod \"console-65f5f56c9-2t846\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") " pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.267976 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.267977    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-trusted-ca-bundle\") pod \"console-65f5f56c9-2t846\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") " pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.268237 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.268016    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd88f4d3-75f2-40dc-b006-2e55ad107155-console-oauth-config\") pod \"console-65f5f56c9-2t846\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") " pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.268237 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.268035    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-oauth-serving-cert\") pod \"console-65f5f56c9-2t846\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") " pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.268237 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.268140    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd88f4d3-75f2-40dc-b006-2e55ad107155-console-serving-cert\") pod \"console-65f5f56c9-2t846\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") " pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.268237 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.268183    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-console-config\") pod \"console-65f5f56c9-2t846\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") " pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.268467 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.268258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64zt6\" (UniqueName: \"kubernetes.io/projected/fd88f4d3-75f2-40dc-b006-2e55ad107155-kube-api-access-64zt6\") pod \"console-65f5f56c9-2t846\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") " pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.268847 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.268807    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-service-ca\") pod \"console-65f5f56c9-2t846\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") " pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.268847 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.268811    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-oauth-serving-cert\") pod \"console-65f5f56c9-2t846\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") " pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.268978 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.268895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-console-config\") pod \"console-65f5f56c9-2t846\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") " pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.269204 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.269179    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-trusted-ca-bundle\") pod \"console-65f5f56c9-2t846\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") " pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.270478 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.270459    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd88f4d3-75f2-40dc-b006-2e55ad107155-console-oauth-config\") pod \"console-65f5f56c9-2t846\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") " pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.270624 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.270605    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd88f4d3-75f2-40dc-b006-2e55ad107155-console-serving-cert\") pod \"console-65f5f56c9-2t846\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") " pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.278688 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.278657    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64zt6\" (UniqueName: \"kubernetes.io/projected/fd88f4d3-75f2-40dc-b006-2e55ad107155-kube-api-access-64zt6\") pod \"console-65f5f56c9-2t846\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") " pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.384713 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.384622    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:07.662448 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:07.662354    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65f5f56c9-2t846"]
Sep 07 14:01:07.665108 ip-10-0-139-134 kubenswrapper[2581]: W0907 14:01:07.665084    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd88f4d3_75f2_40dc_b006_2e55ad107155.slice/crio-e137da44b05d239749145c6bd8a4797a7185dab06e6e58431ac77ec1918fe805 WatchSource:0}: Error finding container e137da44b05d239749145c6bd8a4797a7185dab06e6e58431ac77ec1918fe805: Status 404 returned error can't find the container with id e137da44b05d239749145c6bd8a4797a7185dab06e6e58431ac77ec1918fe805
Sep 07 14:01:08.401193 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:08.401158    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f5f56c9-2t846" event={"ID":"fd88f4d3-75f2-40dc-b006-2e55ad107155","Type":"ContainerStarted","Data":"246188f407a5499780eaf3ecb8cb09b3f506ae9f53360e2b18125a3e5be0e0fc"}
Sep 07 14:01:08.401698 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:08.401213    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f5f56c9-2t846" event={"ID":"fd88f4d3-75f2-40dc-b006-2e55ad107155","Type":"ContainerStarted","Data":"e137da44b05d239749145c6bd8a4797a7185dab06e6e58431ac77ec1918fe805"}
Sep 07 14:01:08.426896 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:08.426834    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65f5f56c9-2t846" podStartSLOduration=1.426819222 podStartE2EDuration="1.426819222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 14:01:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 14:01:08.424584576 +0000 UTC m=+209.425012983" watchObservedRunningTime="2026-09-07 14:01:08.426819222 +0000 UTC m=+209.427247615"
Sep 07 14:01:17.385649 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:17.385608    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:17.386131 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:17.385668    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:17.390488 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:17.390460    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:17.439693 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:17.439658    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:01:17.495092 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:17.495018    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79b94b848d-dm4x2"]
Sep 07 14:01:42.514651 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.514596    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79b94b848d-dm4x2" podUID="ac3a004f-5160-4391-8039-55bb12d64ddf" containerName="console" containerID="cri-o://0ac7674a2c97f42e2914dc8ac7fdd155a0264281444ee7210d6294d0aac98857" gracePeriod=15
Sep 07 14:01:42.750169 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.750143    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:01:42.851151 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.851114    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-service-ca\") pod \"ac3a004f-5160-4391-8039-55bb12d64ddf\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") "
Sep 07 14:01:42.851339 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.851165    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcntz\" (UniqueName: \"kubernetes.io/projected/ac3a004f-5160-4391-8039-55bb12d64ddf-kube-api-access-bcntz\") pod \"ac3a004f-5160-4391-8039-55bb12d64ddf\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") "
Sep 07 14:01:42.851339 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.851214    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac3a004f-5160-4391-8039-55bb12d64ddf-console-oauth-config\") pod \"ac3a004f-5160-4391-8039-55bb12d64ddf\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") "
Sep 07 14:01:42.851339 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.851231    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-trusted-ca-bundle\") pod \"ac3a004f-5160-4391-8039-55bb12d64ddf\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") "
Sep 07 14:01:42.851339 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.851321    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-console-config\") pod \"ac3a004f-5160-4391-8039-55bb12d64ddf\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") "
Sep 07 14:01:42.851530 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.851361    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac3a004f-5160-4391-8039-55bb12d64ddf-console-serving-cert\") pod \"ac3a004f-5160-4391-8039-55bb12d64ddf\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") "
Sep 07 14:01:42.851530 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.851384    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-oauth-serving-cert\") pod \"ac3a004f-5160-4391-8039-55bb12d64ddf\" (UID: \"ac3a004f-5160-4391-8039-55bb12d64ddf\") "
Sep 07 14:01:42.851628 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.851564    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-service-ca" (OuterVolumeSpecName: "service-ca") pod "ac3a004f-5160-4391-8039-55bb12d64ddf" (UID: "ac3a004f-5160-4391-8039-55bb12d64ddf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 14:01:42.851889 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.851855    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ac3a004f-5160-4391-8039-55bb12d64ddf" (UID: "ac3a004f-5160-4391-8039-55bb12d64ddf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 14:01:42.851984 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.851908    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ac3a004f-5160-4391-8039-55bb12d64ddf" (UID: "ac3a004f-5160-4391-8039-55bb12d64ddf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 14:01:42.851984 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.851920    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-console-config" (OuterVolumeSpecName: "console-config") pod "ac3a004f-5160-4391-8039-55bb12d64ddf" (UID: "ac3a004f-5160-4391-8039-55bb12d64ddf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 14:01:42.853607 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.853587    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac3a004f-5160-4391-8039-55bb12d64ddf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ac3a004f-5160-4391-8039-55bb12d64ddf" (UID: "ac3a004f-5160-4391-8039-55bb12d64ddf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:01:42.853901 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.853884    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac3a004f-5160-4391-8039-55bb12d64ddf-kube-api-access-bcntz" (OuterVolumeSpecName: "kube-api-access-bcntz") pod "ac3a004f-5160-4391-8039-55bb12d64ddf" (UID: "ac3a004f-5160-4391-8039-55bb12d64ddf"). InnerVolumeSpecName "kube-api-access-bcntz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 14:01:42.853958 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.853898    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac3a004f-5160-4391-8039-55bb12d64ddf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ac3a004f-5160-4391-8039-55bb12d64ddf" (UID: "ac3a004f-5160-4391-8039-55bb12d64ddf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:01:42.952856 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.952816    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac3a004f-5160-4391-8039-55bb12d64ddf-console-oauth-config\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:01:42.952856 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.952847    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-trusted-ca-bundle\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:01:42.952856 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.952856    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-console-config\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:01:42.952856 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.952866    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac3a004f-5160-4391-8039-55bb12d64ddf-console-serving-cert\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:01:42.953112 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.952875    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-oauth-serving-cert\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:01:42.953112 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.952884    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac3a004f-5160-4391-8039-55bb12d64ddf-service-ca\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:01:42.953112 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:42.952892    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcntz\" (UniqueName: \"kubernetes.io/projected/ac3a004f-5160-4391-8039-55bb12d64ddf-kube-api-access-bcntz\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:01:43.537730 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:43.537699    2581 generic.go:356] "Generic (PLEG): container finished" podID="ac3a004f-5160-4391-8039-55bb12d64ddf" containerID="0ac7674a2c97f42e2914dc8ac7fdd155a0264281444ee7210d6294d0aac98857" exitCode=0
Sep 07 14:01:43.538166 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:43.537743    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b94b848d-dm4x2" event={"ID":"ac3a004f-5160-4391-8039-55bb12d64ddf","Type":"ContainerDied","Data":"0ac7674a2c97f42e2914dc8ac7fdd155a0264281444ee7210d6294d0aac98857"}
Sep 07 14:01:43.538166 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:43.537752    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b94b848d-dm4x2"
Sep 07 14:01:43.538166 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:43.537786    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b94b848d-dm4x2" event={"ID":"ac3a004f-5160-4391-8039-55bb12d64ddf","Type":"ContainerDied","Data":"f1247f718776db1eaf652123d12c097e3a46adb0a0d2fc87332173bb66157016"}
Sep 07 14:01:43.538166 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:43.537807    2581 scope.go:117] "RemoveContainer" containerID="0ac7674a2c97f42e2914dc8ac7fdd155a0264281444ee7210d6294d0aac98857"
Sep 07 14:01:43.546279 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:43.546260    2581 scope.go:117] "RemoveContainer" containerID="0ac7674a2c97f42e2914dc8ac7fdd155a0264281444ee7210d6294d0aac98857"
Sep 07 14:01:43.548862 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:01:43.546746    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ac7674a2c97f42e2914dc8ac7fdd155a0264281444ee7210d6294d0aac98857\": container with ID starting with 0ac7674a2c97f42e2914dc8ac7fdd155a0264281444ee7210d6294d0aac98857 not found: ID does not exist" containerID="0ac7674a2c97f42e2914dc8ac7fdd155a0264281444ee7210d6294d0aac98857"
Sep 07 14:01:43.548862 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:43.546788    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ac7674a2c97f42e2914dc8ac7fdd155a0264281444ee7210d6294d0aac98857"} err="failed to get container status \"0ac7674a2c97f42e2914dc8ac7fdd155a0264281444ee7210d6294d0aac98857\": rpc error: code = NotFound desc = could not find container \"0ac7674a2c97f42e2914dc8ac7fdd155a0264281444ee7210d6294d0aac98857\": container with ID starting with 0ac7674a2c97f42e2914dc8ac7fdd155a0264281444ee7210d6294d0aac98857 not found: ID does not exist"
Sep 07 14:01:43.555619 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:43.555594    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79b94b848d-dm4x2"]
Sep 07 14:01:43.558449 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:43.558425    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79b94b848d-dm4x2"]
Sep 07 14:01:45.519483 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:01:45.519449    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac3a004f-5160-4391-8039-55bb12d64ddf" path="/var/lib/kubelet/pods/ac3a004f-5160-4391-8039-55bb12d64ddf/volumes"
Sep 07 14:02:16.129224 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.129135    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c688f578f-rnnzr"]
Sep 07 14:02:16.129825 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.129583    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac3a004f-5160-4391-8039-55bb12d64ddf" containerName="console"
Sep 07 14:02:16.129825 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.129602    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac3a004f-5160-4391-8039-55bb12d64ddf" containerName="console"
Sep 07 14:02:16.129825 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.129697    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac3a004f-5160-4391-8039-55bb12d64ddf" containerName="console"
Sep 07 14:02:16.132738 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.132715    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.142418 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.142393    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c688f578f-rnnzr"]
Sep 07 14:02:16.208875 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.208842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-oauth-serving-cert\") pod \"console-c688f578f-rnnzr\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") " pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.209059 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.208887    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29affc33-12b4-4115-bc4b-362ba4f0f119-console-serving-cert\") pod \"console-c688f578f-rnnzr\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") " pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.209059 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.208906    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-service-ca\") pod \"console-c688f578f-rnnzr\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") " pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.209059 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.208923    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-console-config\") pod \"console-c688f578f-rnnzr\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") " pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.209059 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.208972    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29affc33-12b4-4115-bc4b-362ba4f0f119-console-oauth-config\") pod \"console-c688f578f-rnnzr\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") " pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.209059 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.209003    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnbph\" (UniqueName: \"kubernetes.io/projected/29affc33-12b4-4115-bc4b-362ba4f0f119-kube-api-access-pnbph\") pod \"console-c688f578f-rnnzr\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") " pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.209239 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.209067    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-trusted-ca-bundle\") pod \"console-c688f578f-rnnzr\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") " pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.310244 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.310200    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-oauth-serving-cert\") pod \"console-c688f578f-rnnzr\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") " pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.310462 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.310269    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29affc33-12b4-4115-bc4b-362ba4f0f119-console-serving-cert\") pod \"console-c688f578f-rnnzr\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") " pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.310462 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.310320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-service-ca\") pod \"console-c688f578f-rnnzr\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") " pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.310462 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.310343    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-console-config\") pod \"console-c688f578f-rnnzr\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") " pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.310462 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.310366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29affc33-12b4-4115-bc4b-362ba4f0f119-console-oauth-config\") pod \"console-c688f578f-rnnzr\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") " pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.310462 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.310388    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnbph\" (UniqueName: \"kubernetes.io/projected/29affc33-12b4-4115-bc4b-362ba4f0f119-kube-api-access-pnbph\") pod \"console-c688f578f-rnnzr\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") " pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.310462 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.310431    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-trusted-ca-bundle\") pod \"console-c688f578f-rnnzr\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") " pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.311115 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.311084    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-service-ca\") pod \"console-c688f578f-rnnzr\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") " pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.311219 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.311156    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-console-config\") pod \"console-c688f578f-rnnzr\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") " pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.311219 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.311156    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-oauth-serving-cert\") pod \"console-c688f578f-rnnzr\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") " pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.311330 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.311216    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-trusted-ca-bundle\") pod \"console-c688f578f-rnnzr\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") " pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.312773 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.312755    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29affc33-12b4-4115-bc4b-362ba4f0f119-console-oauth-config\") pod \"console-c688f578f-rnnzr\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") " pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.312867 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.312850    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29affc33-12b4-4115-bc4b-362ba4f0f119-console-serving-cert\") pod \"console-c688f578f-rnnzr\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") " pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.319246 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.319225    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnbph\" (UniqueName: \"kubernetes.io/projected/29affc33-12b4-4115-bc4b-362ba4f0f119-kube-api-access-pnbph\") pod \"console-c688f578f-rnnzr\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") " pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.443403 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.443315    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:16.724479 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:16.724406    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c688f578f-rnnzr"]
Sep 07 14:02:16.727962 ip-10-0-139-134 kubenswrapper[2581]: W0907 14:02:16.727934    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29affc33_12b4_4115_bc4b_362ba4f0f119.slice/crio-6aa106f5f9bde67b3f7cadb8a17ed7c66495db4a8f7932672c3219d4e3ebf3ce WatchSource:0}: Error finding container 6aa106f5f9bde67b3f7cadb8a17ed7c66495db4a8f7932672c3219d4e3ebf3ce: Status 404 returned error can't find the container with id 6aa106f5f9bde67b3f7cadb8a17ed7c66495db4a8f7932672c3219d4e3ebf3ce
Sep 07 14:02:17.666400 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:17.666361    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c688f578f-rnnzr" event={"ID":"29affc33-12b4-4115-bc4b-362ba4f0f119","Type":"ContainerStarted","Data":"7bfb36374e51f763b29ba2b570fb70841e37a305253f556567718bbc8e5b3cfe"}
Sep 07 14:02:17.666786 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:17.666420    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c688f578f-rnnzr" event={"ID":"29affc33-12b4-4115-bc4b-362ba4f0f119","Type":"ContainerStarted","Data":"6aa106f5f9bde67b3f7cadb8a17ed7c66495db4a8f7932672c3219d4e3ebf3ce"}
Sep 07 14:02:17.686390 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:17.686335    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c688f578f-rnnzr" podStartSLOduration=1.686319372 podStartE2EDuration="1.686319372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 14:02:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 14:02:17.685084171 +0000 UTC m=+278.685512564" watchObservedRunningTime="2026-09-07 14:02:17.686319372 +0000 UTC m=+278.686747767"
Sep 07 14:02:26.444302 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:26.444255    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:26.444769 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:26.444391    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:26.449103 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:26.449077    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:26.703857 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:26.703773    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:02:26.756238 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:26.756198    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65f5f56c9-2t846"]
Sep 07 14:02:39.435024 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:39.434992    2581 kubelet.go:1648] "Image garbage collection succeeded"
Sep 07 14:02:51.776304 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:51.776245    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65f5f56c9-2t846" podUID="fd88f4d3-75f2-40dc-b006-2e55ad107155" containerName="console" containerID="cri-o://246188f407a5499780eaf3ecb8cb09b3f506ae9f53360e2b18125a3e5be0e0fc" gracePeriod=15
Sep 07 14:02:52.018760 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.018734    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:02:52.104362 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.104332    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-service-ca\") pod \"fd88f4d3-75f2-40dc-b006-2e55ad107155\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") "
Sep 07 14:02:52.104522 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.104379    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-trusted-ca-bundle\") pod \"fd88f4d3-75f2-40dc-b006-2e55ad107155\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") "
Sep 07 14:02:52.104522 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.104442    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd88f4d3-75f2-40dc-b006-2e55ad107155-console-serving-cert\") pod \"fd88f4d3-75f2-40dc-b006-2e55ad107155\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") "
Sep 07 14:02:52.104522 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.104469    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-oauth-serving-cert\") pod \"fd88f4d3-75f2-40dc-b006-2e55ad107155\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") "
Sep 07 14:02:52.104522 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.104507    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-console-config\") pod \"fd88f4d3-75f2-40dc-b006-2e55ad107155\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") "
Sep 07 14:02:52.104694 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.104544    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd88f4d3-75f2-40dc-b006-2e55ad107155-console-oauth-config\") pod \"fd88f4d3-75f2-40dc-b006-2e55ad107155\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") "
Sep 07 14:02:52.104694 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.104571    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64zt6\" (UniqueName: \"kubernetes.io/projected/fd88f4d3-75f2-40dc-b006-2e55ad107155-kube-api-access-64zt6\") pod \"fd88f4d3-75f2-40dc-b006-2e55ad107155\" (UID: \"fd88f4d3-75f2-40dc-b006-2e55ad107155\") "
Sep 07 14:02:52.104867 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.104838    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-service-ca" (OuterVolumeSpecName: "service-ca") pod "fd88f4d3-75f2-40dc-b006-2e55ad107155" (UID: "fd88f4d3-75f2-40dc-b006-2e55ad107155"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 14:02:52.104961 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.104918    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fd88f4d3-75f2-40dc-b006-2e55ad107155" (UID: "fd88f4d3-75f2-40dc-b006-2e55ad107155"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 14:02:52.104961 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.104938    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fd88f4d3-75f2-40dc-b006-2e55ad107155" (UID: "fd88f4d3-75f2-40dc-b006-2e55ad107155"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 14:02:52.105257 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.105230    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-console-config" (OuterVolumeSpecName: "console-config") pod "fd88f4d3-75f2-40dc-b006-2e55ad107155" (UID: "fd88f4d3-75f2-40dc-b006-2e55ad107155"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 14:02:52.106672 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.106645    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd88f4d3-75f2-40dc-b006-2e55ad107155-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fd88f4d3-75f2-40dc-b006-2e55ad107155" (UID: "fd88f4d3-75f2-40dc-b006-2e55ad107155"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:02:52.106752 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.106676    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd88f4d3-75f2-40dc-b006-2e55ad107155-kube-api-access-64zt6" (OuterVolumeSpecName: "kube-api-access-64zt6") pod "fd88f4d3-75f2-40dc-b006-2e55ad107155" (UID: "fd88f4d3-75f2-40dc-b006-2e55ad107155"). InnerVolumeSpecName "kube-api-access-64zt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 14:02:52.106752 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.106724    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd88f4d3-75f2-40dc-b006-2e55ad107155-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fd88f4d3-75f2-40dc-b006-2e55ad107155" (UID: "fd88f4d3-75f2-40dc-b006-2e55ad107155"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:02:52.205340 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.205264    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-console-config\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:02:52.205340 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.205335    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd88f4d3-75f2-40dc-b006-2e55ad107155-console-oauth-config\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:02:52.205340 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.205346    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64zt6\" (UniqueName: \"kubernetes.io/projected/fd88f4d3-75f2-40dc-b006-2e55ad107155-kube-api-access-64zt6\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:02:52.205340 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.205357    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-service-ca\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:02:52.205612 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.205365    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-trusted-ca-bundle\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:02:52.205612 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.205374    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd88f4d3-75f2-40dc-b006-2e55ad107155-console-serving-cert\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:02:52.205612 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.205382    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd88f4d3-75f2-40dc-b006-2e55ad107155-oauth-serving-cert\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:02:52.799837 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.799798    2581 generic.go:356] "Generic (PLEG): container finished" podID="fd88f4d3-75f2-40dc-b006-2e55ad107155" containerID="246188f407a5499780eaf3ecb8cb09b3f506ae9f53360e2b18125a3e5be0e0fc" exitCode=0
Sep 07 14:02:52.799837 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.799838    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f5f56c9-2t846"
Sep 07 14:02:52.800325 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.799845    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f5f56c9-2t846" event={"ID":"fd88f4d3-75f2-40dc-b006-2e55ad107155","Type":"ContainerDied","Data":"246188f407a5499780eaf3ecb8cb09b3f506ae9f53360e2b18125a3e5be0e0fc"}
Sep 07 14:02:52.800325 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.799892    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f5f56c9-2t846" event={"ID":"fd88f4d3-75f2-40dc-b006-2e55ad107155","Type":"ContainerDied","Data":"e137da44b05d239749145c6bd8a4797a7185dab06e6e58431ac77ec1918fe805"}
Sep 07 14:02:52.800325 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.799912    2581 scope.go:117] "RemoveContainer" containerID="246188f407a5499780eaf3ecb8cb09b3f506ae9f53360e2b18125a3e5be0e0fc"
Sep 07 14:02:52.809433 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.809415    2581 scope.go:117] "RemoveContainer" containerID="246188f407a5499780eaf3ecb8cb09b3f506ae9f53360e2b18125a3e5be0e0fc"
Sep 07 14:02:52.809716 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:02:52.809696    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"246188f407a5499780eaf3ecb8cb09b3f506ae9f53360e2b18125a3e5be0e0fc\": container with ID starting with 246188f407a5499780eaf3ecb8cb09b3f506ae9f53360e2b18125a3e5be0e0fc not found: ID does not exist" containerID="246188f407a5499780eaf3ecb8cb09b3f506ae9f53360e2b18125a3e5be0e0fc"
Sep 07 14:02:52.809769 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.809725    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"246188f407a5499780eaf3ecb8cb09b3f506ae9f53360e2b18125a3e5be0e0fc"} err="failed to get container status \"246188f407a5499780eaf3ecb8cb09b3f506ae9f53360e2b18125a3e5be0e0fc\": rpc error: code = NotFound desc = could not find container \"246188f407a5499780eaf3ecb8cb09b3f506ae9f53360e2b18125a3e5be0e0fc\": container with ID starting with 246188f407a5499780eaf3ecb8cb09b3f506ae9f53360e2b18125a3e5be0e0fc not found: ID does not exist"
Sep 07 14:02:52.827666 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.827569    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65f5f56c9-2t846"]
Sep 07 14:02:52.829226 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:52.829204    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65f5f56c9-2t846"]
Sep 07 14:02:53.519556 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:02:53.519520    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd88f4d3-75f2-40dc-b006-2e55ad107155" path="/var/lib/kubelet/pods/fd88f4d3-75f2-40dc-b006-2e55ad107155/volumes"
Sep 07 14:04:26.703630 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:04:26.703597    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-695d6b979d-b75z5"]
Sep 07 14:04:26.704196 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:04:26.704044    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd88f4d3-75f2-40dc-b006-2e55ad107155" containerName="console"
Sep 07 14:04:26.704196 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:04:26.704065    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd88f4d3-75f2-40dc-b006-2e55ad107155" containerName="console"
Sep 07 14:04:26.704196 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:04:26.704137    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd88f4d3-75f2-40dc-b006-2e55ad107155" containerName="console"
Sep 07 14:04:26.707075 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:04:26.707054    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-695d6b979d-b75z5"
Sep 07 14:04:26.709606 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:04:26.709575    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Sep 07 14:04:26.709720 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:04:26.709662    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-dxntm\""
Sep 07 14:04:26.710469 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:04:26.710451    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Sep 07 14:04:26.723243 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:04:26.723212    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-695d6b979d-b75z5"]
Sep 07 14:04:26.773480 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:04:26.773444    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7b45\" (UniqueName: \"kubernetes.io/projected/f7e6fcdd-a98e-4637-990c-1f82d694eeb0-kube-api-access-r7b45\") pod \"feast-operator-controller-manager-695d6b979d-b75z5\" (UID: \"f7e6fcdd-a98e-4637-990c-1f82d694eeb0\") " pod="feast-operator-system/feast-operator-controller-manager-695d6b979d-b75z5"
Sep 07 14:04:26.874066 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:04:26.874022    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7b45\" (UniqueName: \"kubernetes.io/projected/f7e6fcdd-a98e-4637-990c-1f82d694eeb0-kube-api-access-r7b45\") pod \"feast-operator-controller-manager-695d6b979d-b75z5\" (UID: \"f7e6fcdd-a98e-4637-990c-1f82d694eeb0\") " pod="feast-operator-system/feast-operator-controller-manager-695d6b979d-b75z5"
Sep 07 14:04:26.883714 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:04:26.883682    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7b45\" (UniqueName: \"kubernetes.io/projected/f7e6fcdd-a98e-4637-990c-1f82d694eeb0-kube-api-access-r7b45\") pod \"feast-operator-controller-manager-695d6b979d-b75z5\" (UID: \"f7e6fcdd-a98e-4637-990c-1f82d694eeb0\") " pod="feast-operator-system/feast-operator-controller-manager-695d6b979d-b75z5"
Sep 07 14:04:27.016910 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:04:27.016821    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-695d6b979d-b75z5"
Sep 07 14:04:27.292630 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:04:27.292552    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-695d6b979d-b75z5"]
Sep 07 14:04:27.295852 ip-10-0-139-134 kubenswrapper[2581]: W0907 14:04:27.295816    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e6fcdd_a98e_4637_990c_1f82d694eeb0.slice/crio-575387d549655fe763512524f8c5a163db7e8fa0bf6bee7db0ecd1f4b78f978b WatchSource:0}: Error finding container 575387d549655fe763512524f8c5a163db7e8fa0bf6bee7db0ecd1f4b78f978b: Status 404 returned error can't find the container with id 575387d549655fe763512524f8c5a163db7e8fa0bf6bee7db0ecd1f4b78f978b
Sep 07 14:04:27.297578 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:04:27.297560    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 14:04:28.164931 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:04:28.164891    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-695d6b979d-b75z5" event={"ID":"f7e6fcdd-a98e-4637-990c-1f82d694eeb0","Type":"ContainerStarted","Data":"575387d549655fe763512524f8c5a163db7e8fa0bf6bee7db0ecd1f4b78f978b"}
Sep 07 14:04:30.174632 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:04:30.174595    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-695d6b979d-b75z5" event={"ID":"f7e6fcdd-a98e-4637-990c-1f82d694eeb0","Type":"ContainerStarted","Data":"abf2cde22d515884d76eabe8e982c610aa345849a02288526a3a5547cea78b55"}
Sep 07 14:04:30.175021 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:04:30.174686    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-695d6b979d-b75z5"
Sep 07 14:04:30.192752 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:04:30.192702    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-695d6b979d-b75z5" podStartSLOduration=1.726450781 podStartE2EDuration="4.192687881s" totalImagesPullingTime="2.4662371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 14:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 14:04:30.191788314 +0000 UTC m=+411.192216707" watchObservedRunningTime="2026-09-07 14:04:30.192687881 +0000 UTC m=+411.193116273"
Sep 07 14:04:41.180913 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:04:41.180881    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-695d6b979d-b75z5"
Sep 07 14:05:02.540682 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.540599    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"]
Sep 07 14:05:02.544275 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.544255    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:02.546722 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.546697    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 07 14:05:02.547074 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.547056    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 07 14:05:02.547708 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.547686    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 07 14:05:02.547828 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.547759    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 07 14:05:02.547828 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.547695    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-tfwmg\""
Sep 07 14:05:02.547828 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.547719    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 07 14:05:02.547828 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.547723    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 07 14:05:02.547828 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.547724    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Sep 07 14:05:02.557740 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.557718    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"]
Sep 07 14:05:02.673155 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.673123    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-online-tls\") pod \"feast-simple-feast-setup-7cc9474b77-fwrvl\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:02.673378 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.673166    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-ui-tls\") pod \"feast-simple-feast-setup-7cc9474b77-fwrvl\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:02.673378 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.673191    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnc9q\" (UniqueName: \"kubernetes.io/projected/ffae56e1-7806-4619-89e6-4011a134fc5c-kube-api-access-vnc9q\") pod \"feast-simple-feast-setup-7cc9474b77-fwrvl\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:02.673378 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.673216    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ffae56e1-7806-4619-89e6-4011a134fc5c-feast-data\") pod \"feast-simple-feast-setup-7cc9474b77-fwrvl\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:02.673378 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.673242    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-offline-tls\") pod \"feast-simple-feast-setup-7cc9474b77-fwrvl\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:02.673378 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.673311    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-registry-tls\") pod \"feast-simple-feast-setup-7cc9474b77-fwrvl\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:02.774616 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.774579    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-offline-tls\") pod \"feast-simple-feast-setup-7cc9474b77-fwrvl\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:02.774793 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.774628    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-registry-tls\") pod \"feast-simple-feast-setup-7cc9474b77-fwrvl\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:02.774793 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.774698    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-online-tls\") pod \"feast-simple-feast-setup-7cc9474b77-fwrvl\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:02.774793 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.774732    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-ui-tls\") pod \"feast-simple-feast-setup-7cc9474b77-fwrvl\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:02.774793 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.774755    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnc9q\" (UniqueName: \"kubernetes.io/projected/ffae56e1-7806-4619-89e6-4011a134fc5c-kube-api-access-vnc9q\") pod \"feast-simple-feast-setup-7cc9474b77-fwrvl\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:02.774793 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.774783    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ffae56e1-7806-4619-89e6-4011a134fc5c-feast-data\") pod \"feast-simple-feast-setup-7cc9474b77-fwrvl\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:02.775177 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.775151    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ffae56e1-7806-4619-89e6-4011a134fc5c-feast-data\") pod \"feast-simple-feast-setup-7cc9474b77-fwrvl\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:02.777216 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.777193    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-registry-tls\") pod \"feast-simple-feast-setup-7cc9474b77-fwrvl\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:02.777344 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.777267    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-ui-tls\") pod \"feast-simple-feast-setup-7cc9474b77-fwrvl\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:02.777344 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.777331    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-online-tls\") pod \"feast-simple-feast-setup-7cc9474b77-fwrvl\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:02.777462 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.777427    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-offline-tls\") pod \"feast-simple-feast-setup-7cc9474b77-fwrvl\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:02.784035 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.784013    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnc9q\" (UniqueName: \"kubernetes.io/projected/ffae56e1-7806-4619-89e6-4011a134fc5c-kube-api-access-vnc9q\") pod \"feast-simple-feast-setup-7cc9474b77-fwrvl\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:02.869420 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:02.869386    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:03.154991 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:03.154915    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"]
Sep 07 14:05:03.158097 ip-10-0-139-134 kubenswrapper[2581]: W0907 14:05:03.158069    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffae56e1_7806_4619_89e6_4011a134fc5c.slice/crio-4b6af588dda714477baa73f0acae012bcf839a07e50dac438803b1089c56dba5 WatchSource:0}: Error finding container 4b6af588dda714477baa73f0acae012bcf839a07e50dac438803b1089c56dba5: Status 404 returned error can't find the container with id 4b6af588dda714477baa73f0acae012bcf839a07e50dac438803b1089c56dba5
Sep 07 14:05:03.297559 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:03.297524    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" event={"ID":"ffae56e1-7806-4619-89e6-4011a134fc5c","Type":"ContainerStarted","Data":"4b6af588dda714477baa73f0acae012bcf839a07e50dac438803b1089c56dba5"}
Sep 07 14:05:26.970921 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:26.970883    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c688f578f-rnnzr"]
Sep 07 14:05:28.413234 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:28.413196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" event={"ID":"ffae56e1-7806-4619-89e6-4011a134fc5c","Type":"ContainerStarted","Data":"7487ab4a4ff2df04de5f154e9712978f857ba45f57e25813015554552fedd664"}
Sep 07 14:05:32.378668 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:05:32.378630    2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffae56e1_7806_4619_89e6_4011a134fc5c.slice/crio-7487ab4a4ff2df04de5f154e9712978f857ba45f57e25813015554552fedd664.scope\": RecentStats: unable to find data in memory cache]"
Sep 07 14:05:32.432369 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:32.432334    2581 generic.go:356] "Generic (PLEG): container finished" podID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerID="7487ab4a4ff2df04de5f154e9712978f857ba45f57e25813015554552fedd664" exitCode=0
Sep 07 14:05:32.432538 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:32.432386    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" event={"ID":"ffae56e1-7806-4619-89e6-4011a134fc5c","Type":"ContainerDied","Data":"7487ab4a4ff2df04de5f154e9712978f857ba45f57e25813015554552fedd664"}
Sep 07 14:05:33.438357 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:33.438321    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" event={"ID":"ffae56e1-7806-4619-89e6-4011a134fc5c","Type":"ContainerStarted","Data":"00d7785d055bf7669a545b79d6c3b7591a40ec1504f7072116482a291ac00009"}
Sep 07 14:05:38.459453 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:38.459417    2581 generic.go:356] "Generic (PLEG): container finished" podID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerID="00d7785d055bf7669a545b79d6c3b7591a40ec1504f7072116482a291ac00009" exitCode=0
Sep 07 14:05:38.459831 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:38.459490    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" event={"ID":"ffae56e1-7806-4619-89e6-4011a134fc5c","Type":"ContainerDied","Data":"00d7785d055bf7669a545b79d6c3b7591a40ec1504f7072116482a291ac00009"}
Sep 07 14:05:39.471535 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:39.471490    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" event={"ID":"ffae56e1-7806-4619-89e6-4011a134fc5c","Type":"ContainerStarted","Data":"7340493aea0d4f7d2577c876c22eb3241ac93acec6efcad0839ce5788c61dc53"}
Sep 07 14:05:39.472000 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:39.471556    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" event={"ID":"ffae56e1-7806-4619-89e6-4011a134fc5c","Type":"ContainerStarted","Data":"e5b1c4a38b6d46910aa34bae61e8b3555a4867759efc610ca33c13fac13a7380"}
Sep 07 14:05:39.472000 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:39.471576    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" event={"ID":"ffae56e1-7806-4619-89e6-4011a134fc5c","Type":"ContainerStarted","Data":"c232567d3719d05093241b0fa3e4c748537fc548beb07384610561306caf7304"}
Sep 07 14:05:39.472000 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:39.471592    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" event={"ID":"ffae56e1-7806-4619-89e6-4011a134fc5c","Type":"ContainerStarted","Data":"1903bc8aa0798ce49592f33b18ccfc0e01478ffedc4cbf6d6a43764e64dcd37c"}
Sep 07 14:05:39.502601 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:39.502536    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" podStartSLOduration=13.126082075 podStartE2EDuration="37.502513277s" totalImagesPullingTime="24.376431202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 14:05:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 14:05:39.500241832 +0000 UTC m=+480.500670227" watchObservedRunningTime="2026-09-07 14:05:39.502513277 +0000 UTC m=+480.502941671"
Sep 07 14:05:41.870617 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:41.870583    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:41.871158 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:41.871133    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:41.871158 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:41.871165    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:41.871389 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:41.871182    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:41.872740 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:41.872708    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused"
Sep 07 14:05:41.872938 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:41.872738    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.25:6571: connect: connection refused"
Sep 07 14:05:41.873007 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:41.872757    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
Sep 07 14:05:41.873007 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:41.872808    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.25:8816: connect: connection refused"
Sep 07 14:05:42.869508 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:42.869462    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:42.869805 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:42.869533    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:42.869805 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:42.869556    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:42.869805 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:42.869572    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:44.869842 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:44.869787    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused"
Sep 07 14:05:44.870349 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:44.869792    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.25:6571: connect: connection refused"
Sep 07 14:05:44.870349 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:44.869800    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
Sep 07 14:05:44.870566 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:44.870536    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.25:8816: connect: connection refused"
Sep 07 14:05:47.870882 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:47.870851    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:47.871278 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:47.870965    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:47.871278 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:47.871260    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:47.871972 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:47.871948    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:47.872226 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:47.872204    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:47.872337 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:47.872262    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:47.876587 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:47.876566    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:48.531665 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:48.531637    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:05:51.995165 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:51.995125    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c688f578f-rnnzr" podUID="29affc33-12b4-4115-bc4b-362ba4f0f119" containerName="console" containerID="cri-o://7bfb36374e51f763b29ba2b570fb70841e37a305253f556567718bbc8e5b3cfe" gracePeriod=15
Sep 07 14:05:52.545125 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:52.545089    2581 generic.go:356] "Generic (PLEG): container finished" podID="29affc33-12b4-4115-bc4b-362ba4f0f119" containerID="7bfb36374e51f763b29ba2b570fb70841e37a305253f556567718bbc8e5b3cfe" exitCode=0
Sep 07 14:05:52.545311 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:52.545134    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c688f578f-rnnzr" event={"ID":"29affc33-12b4-4115-bc4b-362ba4f0f119","Type":"ContainerDied","Data":"7bfb36374e51f763b29ba2b570fb70841e37a305253f556567718bbc8e5b3cfe"}
Sep 07 14:05:52.795939 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:52.795858    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:05:52.918525 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:52.918480    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-trusted-ca-bundle\") pod \"29affc33-12b4-4115-bc4b-362ba4f0f119\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") "
Sep 07 14:05:52.918728 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:52.918540    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29affc33-12b4-4115-bc4b-362ba4f0f119-console-serving-cert\") pod \"29affc33-12b4-4115-bc4b-362ba4f0f119\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") "
Sep 07 14:05:52.918728 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:52.918580    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnbph\" (UniqueName: \"kubernetes.io/projected/29affc33-12b4-4115-bc4b-362ba4f0f119-kube-api-access-pnbph\") pod \"29affc33-12b4-4115-bc4b-362ba4f0f119\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") "
Sep 07 14:05:52.918728 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:52.918628    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-service-ca\") pod \"29affc33-12b4-4115-bc4b-362ba4f0f119\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") "
Sep 07 14:05:52.918728 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:52.918678    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-oauth-serving-cert\") pod \"29affc33-12b4-4115-bc4b-362ba4f0f119\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") "
Sep 07 14:05:52.918728 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:52.918705    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29affc33-12b4-4115-bc4b-362ba4f0f119-console-oauth-config\") pod \"29affc33-12b4-4115-bc4b-362ba4f0f119\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") "
Sep 07 14:05:52.918972 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:52.918730    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-console-config\") pod \"29affc33-12b4-4115-bc4b-362ba4f0f119\" (UID: \"29affc33-12b4-4115-bc4b-362ba4f0f119\") "
Sep 07 14:05:52.919083 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:52.919052    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "29affc33-12b4-4115-bc4b-362ba4f0f119" (UID: "29affc33-12b4-4115-bc4b-362ba4f0f119"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 14:05:52.919224 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:52.919189    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "29affc33-12b4-4115-bc4b-362ba4f0f119" (UID: "29affc33-12b4-4115-bc4b-362ba4f0f119"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 14:05:52.919224 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:52.919201    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-service-ca" (OuterVolumeSpecName: "service-ca") pod "29affc33-12b4-4115-bc4b-362ba4f0f119" (UID: "29affc33-12b4-4115-bc4b-362ba4f0f119"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 14:05:52.919361 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:52.919226    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-console-config" (OuterVolumeSpecName: "console-config") pod "29affc33-12b4-4115-bc4b-362ba4f0f119" (UID: "29affc33-12b4-4115-bc4b-362ba4f0f119"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 14:05:52.920918 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:52.920891    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29affc33-12b4-4115-bc4b-362ba4f0f119-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "29affc33-12b4-4115-bc4b-362ba4f0f119" (UID: "29affc33-12b4-4115-bc4b-362ba4f0f119"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:05:52.921267 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:52.921244    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29affc33-12b4-4115-bc4b-362ba4f0f119-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "29affc33-12b4-4115-bc4b-362ba4f0f119" (UID: "29affc33-12b4-4115-bc4b-362ba4f0f119"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:05:52.921267 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:52.921256    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29affc33-12b4-4115-bc4b-362ba4f0f119-kube-api-access-pnbph" (OuterVolumeSpecName: "kube-api-access-pnbph") pod "29affc33-12b4-4115-bc4b-362ba4f0f119" (UID: "29affc33-12b4-4115-bc4b-362ba4f0f119"). InnerVolumeSpecName "kube-api-access-pnbph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 14:05:53.019698 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:53.019657    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-oauth-serving-cert\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:05:53.019698 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:53.019691    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29affc33-12b4-4115-bc4b-362ba4f0f119-console-oauth-config\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:05:53.019698 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:53.019705    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-console-config\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:05:53.020132 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:53.019719    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-trusted-ca-bundle\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:05:53.020132 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:53.019730    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29affc33-12b4-4115-bc4b-362ba4f0f119-console-serving-cert\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:05:53.020132 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:53.019741    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnbph\" (UniqueName: \"kubernetes.io/projected/29affc33-12b4-4115-bc4b-362ba4f0f119-kube-api-access-pnbph\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:05:53.020132 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:53.019752    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29affc33-12b4-4115-bc4b-362ba4f0f119-service-ca\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:05:53.550719 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:53.550683    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c688f578f-rnnzr" event={"ID":"29affc33-12b4-4115-bc4b-362ba4f0f119","Type":"ContainerDied","Data":"6aa106f5f9bde67b3f7cadb8a17ed7c66495db4a8f7932672c3219d4e3ebf3ce"}
Sep 07 14:05:53.550719 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:53.550712    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c688f578f-rnnzr"
Sep 07 14:05:53.550983 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:53.550749    2581 scope.go:117] "RemoveContainer" containerID="7bfb36374e51f763b29ba2b570fb70841e37a305253f556567718bbc8e5b3cfe"
Sep 07 14:05:53.587495 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:53.587454    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c688f578f-rnnzr"]
Sep 07 14:05:53.597630 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:53.597599    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c688f578f-rnnzr"]
Sep 07 14:05:55.520005 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:05:55.519968    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29affc33-12b4-4115-bc4b-362ba4f0f119" path="/var/lib/kubelet/pods/29affc33-12b4-4115-bc4b-362ba4f0f119/volumes"
Sep 07 14:06:50.663740 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:50.663705    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"]
Sep 07 14:06:50.664350 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:50.664025    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="registry" containerID="cri-o://1903bc8aa0798ce49592f33b18ccfc0e01478ffedc4cbf6d6a43764e64dcd37c" gracePeriod=30
Sep 07 14:06:50.664350 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:50.664198    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="offline" containerID="cri-o://e5b1c4a38b6d46910aa34bae61e8b3555a4867759efc610ca33c13fac13a7380" gracePeriod=30
Sep 07 14:06:50.664518 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:50.664354    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="online" containerID="cri-o://c232567d3719d05093241b0fa3e4c748537fc548beb07384610561306caf7304" gracePeriod=30
Sep 07 14:06:50.664518 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:50.664354    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="ui" containerID="cri-o://7340493aea0d4f7d2577c876c22eb3241ac93acec6efcad0839ce5788c61dc53" gracePeriod=30
Sep 07 14:06:51.038807 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.038717    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"]
Sep 07 14:06:51.039062 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.039049    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29affc33-12b4-4115-bc4b-362ba4f0f119" containerName="console"
Sep 07 14:06:51.039112 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.039064    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="29affc33-12b4-4115-bc4b-362ba4f0f119" containerName="console"
Sep 07 14:06:51.039151 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.039128    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="29affc33-12b4-4115-bc4b-362ba4f0f119" containerName="console"
Sep 07 14:06:51.043823 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.043804    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:06:51.046831 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.046802    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-6mmwt\""
Sep 07 14:06:51.056307 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.056265    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"]
Sep 07 14:06:51.184995 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.184954    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-ui-tls\") pod \"feast-simple-feast-setup-7cc9474b77-222xc\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:06:51.185204 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.185023    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2km5r\" (UniqueName: \"kubernetes.io/projected/37da795c-bad2-44e6-a446-5e1ee5466cf2-kube-api-access-2km5r\") pod \"feast-simple-feast-setup-7cc9474b77-222xc\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:06:51.185204 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.185067    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-offline-tls\") pod \"feast-simple-feast-setup-7cc9474b77-222xc\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:06:51.185204 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.185118    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-online-tls\") pod \"feast-simple-feast-setup-7cc9474b77-222xc\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:06:51.185204 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.185158    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-registry-tls\") pod \"feast-simple-feast-setup-7cc9474b77-222xc\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:06:51.185204 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.185178    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/37da795c-bad2-44e6-a446-5e1ee5466cf2-feast-data\") pod \"feast-simple-feast-setup-7cc9474b77-222xc\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:06:51.285875 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.285827    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-online-tls\") pod \"feast-simple-feast-setup-7cc9474b77-222xc\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:06:51.286070 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.285890    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-registry-tls\") pod \"feast-simple-feast-setup-7cc9474b77-222xc\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:06:51.286070 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.285918    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/37da795c-bad2-44e6-a446-5e1ee5466cf2-feast-data\") pod \"feast-simple-feast-setup-7cc9474b77-222xc\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:06:51.286070 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.285954    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-ui-tls\") pod \"feast-simple-feast-setup-7cc9474b77-222xc\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:06:51.286070 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.286009    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2km5r\" (UniqueName: \"kubernetes.io/projected/37da795c-bad2-44e6-a446-5e1ee5466cf2-kube-api-access-2km5r\") pod \"feast-simple-feast-setup-7cc9474b77-222xc\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:06:51.286070 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.286036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-offline-tls\") pod \"feast-simple-feast-setup-7cc9474b77-222xc\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:06:51.286797 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.286767    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/37da795c-bad2-44e6-a446-5e1ee5466cf2-feast-data\") pod \"feast-simple-feast-setup-7cc9474b77-222xc\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:06:51.289150 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.289082    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-ui-tls\") pod \"feast-simple-feast-setup-7cc9474b77-222xc\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:06:51.289150 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.289108    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-registry-tls\") pod \"feast-simple-feast-setup-7cc9474b77-222xc\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:06:51.289150 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.289116    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-offline-tls\") pod \"feast-simple-feast-setup-7cc9474b77-222xc\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:06:51.289402 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.289150    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-online-tls\") pod \"feast-simple-feast-setup-7cc9474b77-222xc\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:06:51.294606 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.294575    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2km5r\" (UniqueName: \"kubernetes.io/projected/37da795c-bad2-44e6-a446-5e1ee5466cf2-kube-api-access-2km5r\") pod \"feast-simple-feast-setup-7cc9474b77-222xc\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") " pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:06:51.353767 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.353732    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:06:51.631351 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.631325    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"]
Sep 07 14:06:51.633226 ip-10-0-139-134 kubenswrapper[2581]: W0907 14:06:51.633200    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37da795c_bad2_44e6_a446_5e1ee5466cf2.slice/crio-32a4fc8eebae528363ccd76d635088d70b646063f23aa55dd6fb4e7cae35025a WatchSource:0}: Error finding container 32a4fc8eebae528363ccd76d635088d70b646063f23aa55dd6fb4e7cae35025a: Status 404 returned error can't find the container with id 32a4fc8eebae528363ccd76d635088d70b646063f23aa55dd6fb4e7cae35025a
Sep 07 14:06:51.780131 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.780095    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" event={"ID":"37da795c-bad2-44e6-a446-5e1ee5466cf2","Type":"ContainerStarted","Data":"bc03667284a2a429ac8dc4d818b566c52c2589983884aa1eb27ed91f16d25a38"}
Sep 07 14:06:51.780595 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.780148    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" event={"ID":"37da795c-bad2-44e6-a446-5e1ee5466cf2","Type":"ContainerStarted","Data":"32a4fc8eebae528363ccd76d635088d70b646063f23aa55dd6fb4e7cae35025a"}
Sep 07 14:06:51.783251 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.783225    2581 generic.go:356] "Generic (PLEG): container finished" podID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerID="7340493aea0d4f7d2577c876c22eb3241ac93acec6efcad0839ce5788c61dc53" exitCode=0
Sep 07 14:06:51.783251 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.783246    2581 generic.go:356] "Generic (PLEG): container finished" podID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerID="c232567d3719d05093241b0fa3e4c748537fc548beb07384610561306caf7304" exitCode=0
Sep 07 14:06:51.783423 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.783309    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" event={"ID":"ffae56e1-7806-4619-89e6-4011a134fc5c","Type":"ContainerDied","Data":"7340493aea0d4f7d2577c876c22eb3241ac93acec6efcad0839ce5788c61dc53"}
Sep 07 14:06:51.783423 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:51.783347    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" event={"ID":"ffae56e1-7806-4619-89e6-4011a134fc5c","Type":"ContainerDied","Data":"c232567d3719d05093241b0fa3e4c748537fc548beb07384610561306caf7304"}
Sep 07 14:06:56.805854 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:56.805769    2581 generic.go:356] "Generic (PLEG): container finished" podID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerID="bc03667284a2a429ac8dc4d818b566c52c2589983884aa1eb27ed91f16d25a38" exitCode=0
Sep 07 14:06:56.805854 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:56.805844    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" event={"ID":"37da795c-bad2-44e6-a446-5e1ee5466cf2","Type":"ContainerDied","Data":"bc03667284a2a429ac8dc4d818b566c52c2589983884aa1eb27ed91f16d25a38"}
Sep 07 14:06:57.811590 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:57.811559    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" event={"ID":"37da795c-bad2-44e6-a446-5e1ee5466cf2","Type":"ContainerStarted","Data":"a09b2fefcd0fea6e6c28e0788098dc58bb696f18cb2808effafa2530836196f6"}
Sep 07 14:06:57.872162 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:57.872115    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused"
Sep 07 14:06:58.529736 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:06:58.529698    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
Sep 07 14:07:02.833785 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:02.833750    2581 generic.go:356] "Generic (PLEG): container finished" podID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerID="a09b2fefcd0fea6e6c28e0788098dc58bb696f18cb2808effafa2530836196f6" exitCode=0
Sep 07 14:07:02.834156 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:02.833825    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" event={"ID":"37da795c-bad2-44e6-a446-5e1ee5466cf2","Type":"ContainerDied","Data":"a09b2fefcd0fea6e6c28e0788098dc58bb696f18cb2808effafa2530836196f6"}
Sep 07 14:07:03.844125 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:03.844082    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" event={"ID":"37da795c-bad2-44e6-a446-5e1ee5466cf2","Type":"ContainerStarted","Data":"735b40ba30aa38092ad8da83f6a75a315f21d7e5ea475d46b7c2ca5eb6a64a78"}
Sep 07 14:07:03.844615 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:03.844146    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" event={"ID":"37da795c-bad2-44e6-a446-5e1ee5466cf2","Type":"ContainerStarted","Data":"39624833f4a148580ab66bba0f28f0860cbb60da53fb04a52dac9130f3f7c75a"}
Sep 07 14:07:03.844615 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:03.844168    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" event={"ID":"37da795c-bad2-44e6-a446-5e1ee5466cf2","Type":"ContainerStarted","Data":"d371d936f006f5a729dccc8008667d03e984ed5c1d2ff36958b20bd8bf3dc217"}
Sep 07 14:07:03.844615 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:03.844188    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" event={"ID":"37da795c-bad2-44e6-a446-5e1ee5466cf2","Type":"ContainerStarted","Data":"15c80dcac59da06fb6aaac405adc787063860fa4068262621ba75064c06fc73d"}
Sep 07 14:07:03.877070 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:03.877002    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" podStartSLOduration=12.876981091 podStartE2EDuration="12.876981091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 14:06:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 14:07:03.876776847 +0000 UTC m=+564.877205241" watchObservedRunningTime="2026-09-07 14:07:03.876981091 +0000 UTC m=+564.877409485"
Sep 07 14:07:06.354992 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:06.354953    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:07:06.355507 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:06.355015    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:07:06.355507 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:06.355034    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:07:06.355507 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:06.355050    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:07:06.357307 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:06.357244    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
Sep 07 14:07:06.357554 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:06.357281    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Sep 07 14:07:06.357663 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:06.357330    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused"
Sep 07 14:07:06.357663 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:06.357394    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused"
Sep 07 14:07:07.872449 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:07.872402    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused"
Sep 07 14:07:08.528939 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:08.528881    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
Sep 07 14:07:09.355109 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:09.355040    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Sep 07 14:07:09.355109 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:09.355055    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
Sep 07 14:07:09.355109 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:09.355103    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused"
Sep 07 14:07:09.355724 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:09.355049    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused"
Sep 07 14:07:11.354349 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:11.354307    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:07:11.354846 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:11.354374    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:07:11.354846 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:11.354393    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:07:11.354846 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:11.354410    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:07:12.355113 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:12.355080    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:07:12.355559 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:12.355256    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:07:12.355559 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:12.355496    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:07:12.356019 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:12.355993    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:07:12.356120 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:12.356052    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:07:12.356120 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:12.356083    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:07:12.360462 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:12.360439    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:07:12.898618 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:12.898588    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:07:17.872582 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:17.872538    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused"
Sep 07 14:07:17.873132 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:17.872679    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:07:18.529197 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:18.529150    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
Sep 07 14:07:18.529467 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:18.529311    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:07:20.928864 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:20.928771    2581 generic.go:356] "Generic (PLEG): container finished" podID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerID="e5b1c4a38b6d46910aa34bae61e8b3555a4867759efc610ca33c13fac13a7380" exitCode=137
Sep 07 14:07:20.928864 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:20.928799    2581 generic.go:356] "Generic (PLEG): container finished" podID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerID="1903bc8aa0798ce49592f33b18ccfc0e01478ffedc4cbf6d6a43764e64dcd37c" exitCode=137
Sep 07 14:07:20.928864 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:20.928839    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" event={"ID":"ffae56e1-7806-4619-89e6-4011a134fc5c","Type":"ContainerDied","Data":"e5b1c4a38b6d46910aa34bae61e8b3555a4867759efc610ca33c13fac13a7380"}
Sep 07 14:07:20.929303 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:20.928881    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" event={"ID":"ffae56e1-7806-4619-89e6-4011a134fc5c","Type":"ContainerDied","Data":"1903bc8aa0798ce49592f33b18ccfc0e01478ffedc4cbf6d6a43764e64dcd37c"}
Sep 07 14:07:21.319672 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.319646    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:07:21.442087 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.441998    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-ui-tls\") pod \"ffae56e1-7806-4619-89e6-4011a134fc5c\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") "
Sep 07 14:07:21.442087 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.442062    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-offline-tls\") pod \"ffae56e1-7806-4619-89e6-4011a134fc5c\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") "
Sep 07 14:07:21.442334 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.442099    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ffae56e1-7806-4619-89e6-4011a134fc5c-feast-data\") pod \"ffae56e1-7806-4619-89e6-4011a134fc5c\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") "
Sep 07 14:07:21.442334 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.442134    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-registry-tls\") pod \"ffae56e1-7806-4619-89e6-4011a134fc5c\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") "
Sep 07 14:07:21.442334 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.442162    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-online-tls\") pod \"ffae56e1-7806-4619-89e6-4011a134fc5c\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") "
Sep 07 14:07:21.442334 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.442194    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnc9q\" (UniqueName: \"kubernetes.io/projected/ffae56e1-7806-4619-89e6-4011a134fc5c-kube-api-access-vnc9q\") pod \"ffae56e1-7806-4619-89e6-4011a134fc5c\" (UID: \"ffae56e1-7806-4619-89e6-4011a134fc5c\") "
Sep 07 14:07:21.442720 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.442691    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffae56e1-7806-4619-89e6-4011a134fc5c-feast-data" (OuterVolumeSpecName: "feast-data") pod "ffae56e1-7806-4619-89e6-4011a134fc5c" (UID: "ffae56e1-7806-4619-89e6-4011a134fc5c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 14:07:21.444562 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.444531    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "ffae56e1-7806-4619-89e6-4011a134fc5c" (UID: "ffae56e1-7806-4619-89e6-4011a134fc5c"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:07:21.444562 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.444543    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ffae56e1-7806-4619-89e6-4011a134fc5c" (UID: "ffae56e1-7806-4619-89e6-4011a134fc5c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:07:21.444722 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.444598    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffae56e1-7806-4619-89e6-4011a134fc5c-kube-api-access-vnc9q" (OuterVolumeSpecName: "kube-api-access-vnc9q") pod "ffae56e1-7806-4619-89e6-4011a134fc5c" (UID: "ffae56e1-7806-4619-89e6-4011a134fc5c"). InnerVolumeSpecName "kube-api-access-vnc9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 14:07:21.444817 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.444796    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "ffae56e1-7806-4619-89e6-4011a134fc5c" (UID: "ffae56e1-7806-4619-89e6-4011a134fc5c"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:07:21.444916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.444851    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-online-tls" (OuterVolumeSpecName: "online-tls") pod "ffae56e1-7806-4619-89e6-4011a134fc5c" (UID: "ffae56e1-7806-4619-89e6-4011a134fc5c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:07:21.543702 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.543666    2581 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-ui-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:07:21.543702 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.543696    2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-offline-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:07:21.543702 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.543706    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ffae56e1-7806-4619-89e6-4011a134fc5c-feast-data\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:07:21.543923 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.543714    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-registry-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:07:21.543923 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.543721    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ffae56e1-7806-4619-89e6-4011a134fc5c-online-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:07:21.543923 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.543729    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnc9q\" (UniqueName: \"kubernetes.io/projected/ffae56e1-7806-4619-89e6-4011a134fc5c-kube-api-access-vnc9q\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:07:21.936394 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.936356    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl" event={"ID":"ffae56e1-7806-4619-89e6-4011a134fc5c","Type":"ContainerDied","Data":"4b6af588dda714477baa73f0acae012bcf839a07e50dac438803b1089c56dba5"}
Sep 07 14:07:21.936778 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.936412    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"
Sep 07 14:07:21.936778 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.936415    2581 scope.go:117] "RemoveContainer" containerID="7340493aea0d4f7d2577c876c22eb3241ac93acec6efcad0839ce5788c61dc53"
Sep 07 14:07:21.944783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.944763    2581 scope.go:117] "RemoveContainer" containerID="e5b1c4a38b6d46910aa34bae61e8b3555a4867759efc610ca33c13fac13a7380"
Sep 07 14:07:21.952504 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.952484    2581 scope.go:117] "RemoveContainer" containerID="c232567d3719d05093241b0fa3e4c748537fc548beb07384610561306caf7304"
Sep 07 14:07:21.957117 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.957094    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"]
Sep 07 14:07:21.959399 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.959375    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cc9474b77-fwrvl"]
Sep 07 14:07:21.960516 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.960502    2581 scope.go:117] "RemoveContainer" containerID="1903bc8aa0798ce49592f33b18ccfc0e01478ffedc4cbf6d6a43764e64dcd37c"
Sep 07 14:07:21.967970 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.967952    2581 scope.go:117] "RemoveContainer" containerID="00d7785d055bf7669a545b79d6c3b7591a40ec1504f7072116482a291ac00009"
Sep 07 14:07:21.975015 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:21.974999    2581 scope.go:117] "RemoveContainer" containerID="7487ab4a4ff2df04de5f154e9712978f857ba45f57e25813015554552fedd664"
Sep 07 14:07:23.519946 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:07:23.519910    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" path="/var/lib/kubelet/pods/ffae56e1-7806-4619-89e6-4011a134fc5c/volumes"
Sep 07 14:08:16.161133 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.161050    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"]
Sep 07 14:08:16.163634 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.161359    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="offline"
Sep 07 14:08:16.163634 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.161372    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="offline"
Sep 07 14:08:16.163634 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.161381    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="feast-init"
Sep 07 14:08:16.163634 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.161387    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="feast-init"
Sep 07 14:08:16.163634 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.161399    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="feast-apply"
Sep 07 14:08:16.163634 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.161405    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="feast-apply"
Sep 07 14:08:16.163634 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.161415    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="online"
Sep 07 14:08:16.163634 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.161420    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="online"
Sep 07 14:08:16.163634 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.161426    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="registry"
Sep 07 14:08:16.163634 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.161431    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="registry"
Sep 07 14:08:16.163634 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.161439    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="ui"
Sep 07 14:08:16.163634 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.161444    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="ui"
Sep 07 14:08:16.163634 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.161486    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="ui"
Sep 07 14:08:16.163634 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.161493    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="registry"
Sep 07 14:08:16.163634 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.161499    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="offline"
Sep 07 14:08:16.163634 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.161507    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffae56e1-7806-4619-89e6-4011a134fc5c" containerName="online"
Sep 07 14:08:16.164720 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.164704    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:16.167170 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.167143    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 07 14:08:16.167322 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.167301    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 07 14:08:16.167424 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.167408    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 07 14:08:16.168045 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.168021    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 07 14:08:16.168045 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.168041    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-lw52h\""
Sep 07 14:08:16.168193 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.168076    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 07 14:08:16.168193 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.168040    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 07 14:08:16.168193 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.168040    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Sep 07 14:08:16.178723 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.178699    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"]
Sep 07 14:08:16.262913 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.262871    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/99706394-be8c-4791-9618-351492d0ced3-offline-tls\") pod \"feast-simple-feast-remote-setup-987946c98-77bzw\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:16.263108 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.262924    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxmlf\" (UniqueName: \"kubernetes.io/projected/99706394-be8c-4791-9618-351492d0ced3-kube-api-access-lxmlf\") pod \"feast-simple-feast-remote-setup-987946c98-77bzw\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:16.263108 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.262977    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/99706394-be8c-4791-9618-351492d0ced3-online-tls\") pod \"feast-simple-feast-remote-setup-987946c98-77bzw\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:16.263108 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.263025    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/99706394-be8c-4791-9618-351492d0ced3-registry-tls\") pod \"feast-simple-feast-remote-setup-987946c98-77bzw\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:16.263108 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.263050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/99706394-be8c-4791-9618-351492d0ced3-ui-tls\") pod \"feast-simple-feast-remote-setup-987946c98-77bzw\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:16.263274 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.263123    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/99706394-be8c-4791-9618-351492d0ced3-feast-data\") pod \"feast-simple-feast-remote-setup-987946c98-77bzw\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:16.364194 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.364156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/99706394-be8c-4791-9618-351492d0ced3-offline-tls\") pod \"feast-simple-feast-remote-setup-987946c98-77bzw\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:16.364415 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.364203    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxmlf\" (UniqueName: \"kubernetes.io/projected/99706394-be8c-4791-9618-351492d0ced3-kube-api-access-lxmlf\") pod \"feast-simple-feast-remote-setup-987946c98-77bzw\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:16.364415 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.364236    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/99706394-be8c-4791-9618-351492d0ced3-online-tls\") pod \"feast-simple-feast-remote-setup-987946c98-77bzw\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:16.364415 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.364283    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/99706394-be8c-4791-9618-351492d0ced3-registry-tls\") pod \"feast-simple-feast-remote-setup-987946c98-77bzw\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:16.364582 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.364423    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/99706394-be8c-4791-9618-351492d0ced3-ui-tls\") pod \"feast-simple-feast-remote-setup-987946c98-77bzw\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:16.364582 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.364477    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/99706394-be8c-4791-9618-351492d0ced3-feast-data\") pod \"feast-simple-feast-remote-setup-987946c98-77bzw\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:16.364582 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:08:16.364551    2581 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 07 14:08:16.364734 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:08:16.364629    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99706394-be8c-4791-9618-351492d0ced3-ui-tls podName:99706394-be8c-4791-9618-351492d0ced3 nodeName:}" failed. No retries permitted until 2026-09-07 14:08:16.864607231 +0000 UTC m=+637.865035602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/99706394-be8c-4791-9618-351492d0ced3-ui-tls") pod "feast-simple-feast-remote-setup-987946c98-77bzw" (UID: "99706394-be8c-4791-9618-351492d0ced3") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 07 14:08:16.364832 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.364810    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/99706394-be8c-4791-9618-351492d0ced3-feast-data\") pod \"feast-simple-feast-remote-setup-987946c98-77bzw\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:16.365034 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.365015    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/99706394-be8c-4791-9618-351492d0ced3-registry-tls\") pod \"feast-simple-feast-remote-setup-987946c98-77bzw\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:16.366721 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.366692    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/99706394-be8c-4791-9618-351492d0ced3-online-tls\") pod \"feast-simple-feast-remote-setup-987946c98-77bzw\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:16.367046 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.367023    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/99706394-be8c-4791-9618-351492d0ced3-offline-tls\") pod \"feast-simple-feast-remote-setup-987946c98-77bzw\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:16.373362 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.373341    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxmlf\" (UniqueName: \"kubernetes.io/projected/99706394-be8c-4791-9618-351492d0ced3-kube-api-access-lxmlf\") pod \"feast-simple-feast-remote-setup-987946c98-77bzw\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:16.869490 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.869416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/99706394-be8c-4791-9618-351492d0ced3-ui-tls\") pod \"feast-simple-feast-remote-setup-987946c98-77bzw\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:16.875857 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:16.875827    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/99706394-be8c-4791-9618-351492d0ced3-ui-tls\") pod \"feast-simple-feast-remote-setup-987946c98-77bzw\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:17.073995 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:17.073953    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:17.356268 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:17.356241    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"]
Sep 07 14:08:17.358221 ip-10-0-139-134 kubenswrapper[2581]: W0907 14:08:17.358192    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99706394_be8c_4791_9618_351492d0ced3.slice/crio-df849c8b3f05963624dd4afe7d4d357f0c0ab230151ccf1aa623bb1af45d214b WatchSource:0}: Error finding container df849c8b3f05963624dd4afe7d4d357f0c0ab230151ccf1aa623bb1af45d214b: Status 404 returned error can't find the container with id df849c8b3f05963624dd4afe7d4d357f0c0ab230151ccf1aa623bb1af45d214b
Sep 07 14:08:18.152079 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:18.152040    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" event={"ID":"99706394-be8c-4791-9618-351492d0ced3","Type":"ContainerStarted","Data":"29185e70dfb27e33d4fedf396dd2baaac5ff5a74ae3c85c1688f1e454429d40c"}
Sep 07 14:08:18.152255 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:18.152096    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" event={"ID":"99706394-be8c-4791-9618-351492d0ced3","Type":"ContainerStarted","Data":"df849c8b3f05963624dd4afe7d4d357f0c0ab230151ccf1aa623bb1af45d214b"}
Sep 07 14:08:23.175533 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:23.175499    2581 generic.go:356] "Generic (PLEG): container finished" podID="99706394-be8c-4791-9618-351492d0ced3" containerID="29185e70dfb27e33d4fedf396dd2baaac5ff5a74ae3c85c1688f1e454429d40c" exitCode=0
Sep 07 14:08:23.176010 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:23.175547    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" event={"ID":"99706394-be8c-4791-9618-351492d0ced3","Type":"ContainerDied","Data":"29185e70dfb27e33d4fedf396dd2baaac5ff5a74ae3c85c1688f1e454429d40c"}
Sep 07 14:08:24.181572 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:24.181537    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" event={"ID":"99706394-be8c-4791-9618-351492d0ced3","Type":"ContainerStarted","Data":"a71fc1fcff85988e9962ef6f2d9bc7e3581f9503e02361841f4b56ddce0d191f"}
Sep 07 14:08:45.271300 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:45.271264    2581 generic.go:356] "Generic (PLEG): container finished" podID="99706394-be8c-4791-9618-351492d0ced3" containerID="a71fc1fcff85988e9962ef6f2d9bc7e3581f9503e02361841f4b56ddce0d191f" exitCode=0
Sep 07 14:08:45.271776 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:45.271341    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" event={"ID":"99706394-be8c-4791-9618-351492d0ced3","Type":"ContainerDied","Data":"a71fc1fcff85988e9962ef6f2d9bc7e3581f9503e02361841f4b56ddce0d191f"}
Sep 07 14:08:45.274984 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:45.274964    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Sep 07 14:08:46.280470 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:46.280423    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" event={"ID":"99706394-be8c-4791-9618-351492d0ced3","Type":"ContainerStarted","Data":"37e5dc9c03c3a88660c452c52d0028faa0dcad17c397ee3b840dc7779128bc8e"}
Sep 07 14:08:46.280989 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:46.280477    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" event={"ID":"99706394-be8c-4791-9618-351492d0ced3","Type":"ContainerStarted","Data":"cc0481ada3c1242d4423edbd8b614f3eac771d3b9156313074698e19e4010c1c"}
Sep 07 14:08:46.280989 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:46.280497    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" event={"ID":"99706394-be8c-4791-9618-351492d0ced3","Type":"ContainerStarted","Data":"2418deff2b31f4368a374278c36491866270aa90745b42d023cf182787929f08"}
Sep 07 14:08:46.305097 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:46.305026    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" podStartSLOduration=30.305001473 podStartE2EDuration="30.305001473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 14:08:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 14:08:46.304706071 +0000 UTC m=+667.305134465" watchObservedRunningTime="2026-09-07 14:08:46.305001473 +0000 UTC m=+667.305429868"
Sep 07 14:08:47.074916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:47.074737    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:47.074916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:47.074810    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:47.074916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:47.074832    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:47.074916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:47.074850    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:47.074916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:47.074869    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:47.074916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:47.074886    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:47.076237 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:47.076201    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused"
Sep 07 14:08:47.076397 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:47.076234    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Sep 07 14:08:47.076397 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:47.076254    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Sep 07 14:08:50.074661 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:50.074616    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Sep 07 14:08:50.075169 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:50.074618    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused"
Sep 07 14:08:50.075169 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:50.074619    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Sep 07 14:08:53.074912 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:53.074868    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Sep 07 14:08:53.075389 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:53.074867    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Sep 07 14:08:53.075574 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:53.075557    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:53.076391 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:53.076370    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:56.075534 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:56.075501    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:56.076434 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:56.076412    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:56.097021 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:56.096992    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:08:56.348490 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:08:56.348414    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:09:58.251833 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:09:58.251795    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"]
Sep 07 14:09:58.252404 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:09:58.252094    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="online" containerID="cri-o://2418deff2b31f4368a374278c36491866270aa90745b42d023cf182787929f08" gracePeriod=30
Sep 07 14:09:58.252404 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:09:58.252154    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="ui" containerID="cri-o://37e5dc9c03c3a88660c452c52d0028faa0dcad17c397ee3b840dc7779128bc8e" gracePeriod=30
Sep 07 14:09:58.252404 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:09:58.252178    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="offline" containerID="cri-o://cc0481ada3c1242d4423edbd8b614f3eac771d3b9156313074698e19e4010c1c" gracePeriod=30
Sep 07 14:09:58.354860 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:09:58.354817    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"]
Sep 07 14:09:58.355093 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:09:58.355052    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="registry" containerID="cri-o://15c80dcac59da06fb6aaac405adc787063860fa4068262621ba75064c06fc73d" gracePeriod=30
Sep 07 14:09:58.355241 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:09:58.355139    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="offline" containerID="cri-o://39624833f4a148580ab66bba0f28f0860cbb60da53fb04a52dac9130f3f7c75a" gracePeriod=30
Sep 07 14:09:58.355241 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:09:58.355198    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="online" containerID="cri-o://d371d936f006f5a729dccc8008667d03e984ed5c1d2ff36958b20bd8bf3dc217" gracePeriod=30
Sep 07 14:09:58.355400 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:09:58.355283    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="ui" containerID="cri-o://735b40ba30aa38092ad8da83f6a75a315f21d7e5ea475d46b7c2ca5eb6a64a78" gracePeriod=30
Sep 07 14:09:59.592468 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:09:59.592435    2581 generic.go:356] "Generic (PLEG): container finished" podID="99706394-be8c-4791-9618-351492d0ced3" containerID="37e5dc9c03c3a88660c452c52d0028faa0dcad17c397ee3b840dc7779128bc8e" exitCode=0
Sep 07 14:09:59.592468 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:09:59.592462    2581 generic.go:356] "Generic (PLEG): container finished" podID="99706394-be8c-4791-9618-351492d0ced3" containerID="2418deff2b31f4368a374278c36491866270aa90745b42d023cf182787929f08" exitCode=0
Sep 07 14:09:59.592950 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:09:59.592504    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" event={"ID":"99706394-be8c-4791-9618-351492d0ced3","Type":"ContainerDied","Data":"37e5dc9c03c3a88660c452c52d0028faa0dcad17c397ee3b840dc7779128bc8e"}
Sep 07 14:09:59.592950 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:09:59.592548    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" event={"ID":"99706394-be8c-4791-9618-351492d0ced3","Type":"ContainerDied","Data":"2418deff2b31f4368a374278c36491866270aa90745b42d023cf182787929f08"}
Sep 07 14:09:59.595371 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:09:59.595347    2581 generic.go:356] "Generic (PLEG): container finished" podID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerID="735b40ba30aa38092ad8da83f6a75a315f21d7e5ea475d46b7c2ca5eb6a64a78" exitCode=0
Sep 07 14:09:59.595371 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:09:59.595367    2581 generic.go:356] "Generic (PLEG): container finished" podID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerID="d371d936f006f5a729dccc8008667d03e984ed5c1d2ff36958b20bd8bf3dc217" exitCode=0
Sep 07 14:09:59.595515 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:09:59.595415    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" event={"ID":"37da795c-bad2-44e6-a446-5e1ee5466cf2","Type":"ContainerDied","Data":"735b40ba30aa38092ad8da83f6a75a315f21d7e5ea475d46b7c2ca5eb6a64a78"}
Sep 07 14:09:59.595515 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:09:59.595449    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" event={"ID":"37da795c-bad2-44e6-a446-5e1ee5466cf2","Type":"ContainerDied","Data":"d371d936f006f5a729dccc8008667d03e984ed5c1d2ff36958b20bd8bf3dc217"}
Sep 07 14:10:02.356713 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:02.356661    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
Sep 07 14:10:02.895738 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:02.895696    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Sep 07 14:10:06.076647 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:06.076599    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Sep 07 14:10:06.330700 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:06.330604    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Sep 07 14:10:12.356760 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:12.356710    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
Sep 07 14:10:12.896128 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:12.896086    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Sep 07 14:10:16.076565 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:16.076515    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Sep 07 14:10:16.330691 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:16.330599    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Sep 07 14:10:22.356157 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:22.356108    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
Sep 07 14:10:22.356662 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:22.356265    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:10:22.895873 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:22.895827    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Sep 07 14:10:22.896038 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:22.895986    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:10:26.076263 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:26.076207    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Sep 07 14:10:26.076671 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:26.076381    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:10:26.329767 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:26.329669    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Sep 07 14:10:26.329922 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:26.329784    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:10:28.711145 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:28.711113    2581 generic.go:356] "Generic (PLEG): container finished" podID="99706394-be8c-4791-9618-351492d0ced3" containerID="cc0481ada3c1242d4423edbd8b614f3eac771d3b9156313074698e19e4010c1c" exitCode=137
Sep 07 14:10:28.711571 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:28.711184    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" event={"ID":"99706394-be8c-4791-9618-351492d0ced3","Type":"ContainerDied","Data":"cc0481ada3c1242d4423edbd8b614f3eac771d3b9156313074698e19e4010c1c"}
Sep 07 14:10:28.714169 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:28.714143    2581 generic.go:356] "Generic (PLEG): container finished" podID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerID="39624833f4a148580ab66bba0f28f0860cbb60da53fb04a52dac9130f3f7c75a" exitCode=137
Sep 07 14:10:28.714169 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:28.714168    2581 generic.go:356] "Generic (PLEG): container finished" podID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerID="15c80dcac59da06fb6aaac405adc787063860fa4068262621ba75064c06fc73d" exitCode=137
Sep 07 14:10:28.714346 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:28.714209    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" event={"ID":"37da795c-bad2-44e6-a446-5e1ee5466cf2","Type":"ContainerDied","Data":"39624833f4a148580ab66bba0f28f0860cbb60da53fb04a52dac9130f3f7c75a"}
Sep 07 14:10:28.714346 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:28.714242    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" event={"ID":"37da795c-bad2-44e6-a446-5e1ee5466cf2","Type":"ContainerDied","Data":"15c80dcac59da06fb6aaac405adc787063860fa4068262621ba75064c06fc73d"}
Sep 07 14:10:28.899123 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:28.899091    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:10:28.940632 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:28.940593    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/99706394-be8c-4791-9618-351492d0ced3-registry-tls\") pod \"99706394-be8c-4791-9618-351492d0ced3\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") "
Sep 07 14:10:28.940777 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:28.940660    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/99706394-be8c-4791-9618-351492d0ced3-feast-data\") pod \"99706394-be8c-4791-9618-351492d0ced3\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") "
Sep 07 14:10:28.940777 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:28.940697    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/99706394-be8c-4791-9618-351492d0ced3-online-tls\") pod \"99706394-be8c-4791-9618-351492d0ced3\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") "
Sep 07 14:10:28.940777 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:28.940735    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/99706394-be8c-4791-9618-351492d0ced3-ui-tls\") pod \"99706394-be8c-4791-9618-351492d0ced3\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") "
Sep 07 14:10:28.940949 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:28.940784    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/99706394-be8c-4791-9618-351492d0ced3-offline-tls\") pod \"99706394-be8c-4791-9618-351492d0ced3\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") "
Sep 07 14:10:28.940949 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:28.940813    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxmlf\" (UniqueName: \"kubernetes.io/projected/99706394-be8c-4791-9618-351492d0ced3-kube-api-access-lxmlf\") pod \"99706394-be8c-4791-9618-351492d0ced3\" (UID: \"99706394-be8c-4791-9618-351492d0ced3\") "
Sep 07 14:10:28.941056 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:28.940998    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99706394-be8c-4791-9618-351492d0ced3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "99706394-be8c-4791-9618-351492d0ced3" (UID: "99706394-be8c-4791-9618-351492d0ced3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 14:10:28.941214 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:28.941179    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99706394-be8c-4791-9618-351492d0ced3-feast-data" (OuterVolumeSpecName: "feast-data") pod "99706394-be8c-4791-9618-351492d0ced3" (UID: "99706394-be8c-4791-9618-351492d0ced3"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 14:10:28.943098 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:28.943072    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99706394-be8c-4791-9618-351492d0ced3-online-tls" (OuterVolumeSpecName: "online-tls") pod "99706394-be8c-4791-9618-351492d0ced3" (UID: "99706394-be8c-4791-9618-351492d0ced3"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:10:28.943195 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:28.943166    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99706394-be8c-4791-9618-351492d0ced3-kube-api-access-lxmlf" (OuterVolumeSpecName: "kube-api-access-lxmlf") pod "99706394-be8c-4791-9618-351492d0ced3" (UID: "99706394-be8c-4791-9618-351492d0ced3"). InnerVolumeSpecName "kube-api-access-lxmlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 14:10:28.943416 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:28.943388    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99706394-be8c-4791-9618-351492d0ced3-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "99706394-be8c-4791-9618-351492d0ced3" (UID: "99706394-be8c-4791-9618-351492d0ced3"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:10:28.943416 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:28.943399    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99706394-be8c-4791-9618-351492d0ced3-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "99706394-be8c-4791-9618-351492d0ced3" (UID: "99706394-be8c-4791-9618-351492d0ced3"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:10:28.998109 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:28.998080    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:10:29.041345 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.041316    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-ui-tls\") pod \"37da795c-bad2-44e6-a446-5e1ee5466cf2\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") "
Sep 07 14:10:29.041504 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.041365    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-offline-tls\") pod \"37da795c-bad2-44e6-a446-5e1ee5466cf2\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") "
Sep 07 14:10:29.041504 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.041384    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2km5r\" (UniqueName: \"kubernetes.io/projected/37da795c-bad2-44e6-a446-5e1ee5466cf2-kube-api-access-2km5r\") pod \"37da795c-bad2-44e6-a446-5e1ee5466cf2\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") "
Sep 07 14:10:29.041504 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.041401    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/37da795c-bad2-44e6-a446-5e1ee5466cf2-feast-data\") pod \"37da795c-bad2-44e6-a446-5e1ee5466cf2\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") "
Sep 07 14:10:29.041644 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.041586    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-online-tls\") pod \"37da795c-bad2-44e6-a446-5e1ee5466cf2\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") "
Sep 07 14:10:29.041644 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.041624    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-registry-tls\") pod \"37da795c-bad2-44e6-a446-5e1ee5466cf2\" (UID: \"37da795c-bad2-44e6-a446-5e1ee5466cf2\") "
Sep 07 14:10:29.042341 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.042274    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37da795c-bad2-44e6-a446-5e1ee5466cf2-feast-data" (OuterVolumeSpecName: "feast-data") pod "37da795c-bad2-44e6-a446-5e1ee5466cf2" (UID: "37da795c-bad2-44e6-a446-5e1ee5466cf2"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 14:10:29.042999 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.042978    2581 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/99706394-be8c-4791-9618-351492d0ced3-ui-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:10:29.043156 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.043140    2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/99706394-be8c-4791-9618-351492d0ced3-offline-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:10:29.043452 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.043271    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxmlf\" (UniqueName: \"kubernetes.io/projected/99706394-be8c-4791-9618-351492d0ced3-kube-api-access-lxmlf\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:10:29.043614 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.043598    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/99706394-be8c-4791-9618-351492d0ced3-registry-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:10:29.043740 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.043727    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/99706394-be8c-4791-9618-351492d0ced3-feast-data\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:10:29.043858 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.043846    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/99706394-be8c-4791-9618-351492d0ced3-online-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:10:29.043964 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.043907    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37da795c-bad2-44e6-a446-5e1ee5466cf2-kube-api-access-2km5r" (OuterVolumeSpecName: "kube-api-access-2km5r") pod "37da795c-bad2-44e6-a446-5e1ee5466cf2" (UID: "37da795c-bad2-44e6-a446-5e1ee5466cf2"). InnerVolumeSpecName "kube-api-access-2km5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 14:10:29.044076 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.043947    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "37da795c-bad2-44e6-a446-5e1ee5466cf2" (UID: "37da795c-bad2-44e6-a446-5e1ee5466cf2"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:10:29.044194 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.043971    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "37da795c-bad2-44e6-a446-5e1ee5466cf2" (UID: "37da795c-bad2-44e6-a446-5e1ee5466cf2"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:10:29.044574 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.044543    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "37da795c-bad2-44e6-a446-5e1ee5466cf2" (UID: "37da795c-bad2-44e6-a446-5e1ee5466cf2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:10:29.044574 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.044555    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-online-tls" (OuterVolumeSpecName: "online-tls") pod "37da795c-bad2-44e6-a446-5e1ee5466cf2" (UID: "37da795c-bad2-44e6-a446-5e1ee5466cf2"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:10:29.145273 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.145233    2581 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-ui-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:10:29.145273 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.145265    2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-offline-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:10:29.145273 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.145277    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2km5r\" (UniqueName: \"kubernetes.io/projected/37da795c-bad2-44e6-a446-5e1ee5466cf2-kube-api-access-2km5r\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:10:29.145533 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.145285    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/37da795c-bad2-44e6-a446-5e1ee5466cf2-feast-data\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:10:29.145533 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.145318    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-online-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:10:29.145533 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.145326    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/37da795c-bad2-44e6-a446-5e1ee5466cf2-registry-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:10:29.721103 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.721060    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw" event={"ID":"99706394-be8c-4791-9618-351492d0ced3","Type":"ContainerDied","Data":"df849c8b3f05963624dd4afe7d4d357f0c0ab230151ccf1aa623bb1af45d214b"}
Sep 07 14:10:29.721576 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.721084    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"
Sep 07 14:10:29.721576 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.721126    2581 scope.go:117] "RemoveContainer" containerID="37e5dc9c03c3a88660c452c52d0028faa0dcad17c397ee3b840dc7779128bc8e"
Sep 07 14:10:29.724385 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.724354    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc" event={"ID":"37da795c-bad2-44e6-a446-5e1ee5466cf2","Type":"ContainerDied","Data":"32a4fc8eebae528363ccd76d635088d70b646063f23aa55dd6fb4e7cae35025a"}
Sep 07 14:10:29.724468 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.724410    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"
Sep 07 14:10:29.730367 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.730336    2581 scope.go:117] "RemoveContainer" containerID="cc0481ada3c1242d4423edbd8b614f3eac771d3b9156313074698e19e4010c1c"
Sep 07 14:10:29.737941 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.737920    2581 scope.go:117] "RemoveContainer" containerID="2418deff2b31f4368a374278c36491866270aa90745b42d023cf182787929f08"
Sep 07 14:10:29.741133 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.741109    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"]
Sep 07 14:10:29.744115 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.744089    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-987946c98-77bzw"]
Sep 07 14:10:29.746691 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.746674    2581 scope.go:117] "RemoveContainer" containerID="a71fc1fcff85988e9962ef6f2d9bc7e3581f9503e02361841f4b56ddce0d191f"
Sep 07 14:10:29.754382 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.754365    2581 scope.go:117] "RemoveContainer" containerID="29185e70dfb27e33d4fedf396dd2baaac5ff5a74ae3c85c1688f1e454429d40c"
Sep 07 14:10:29.759492 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.759469    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"]
Sep 07 14:10:29.762357 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.762318    2581 scope.go:117] "RemoveContainer" containerID="735b40ba30aa38092ad8da83f6a75a315f21d7e5ea475d46b7c2ca5eb6a64a78"
Sep 07 14:10:29.763880 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.763863    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cc9474b77-222xc"]
Sep 07 14:10:29.769889 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.769867    2581 scope.go:117] "RemoveContainer" containerID="39624833f4a148580ab66bba0f28f0860cbb60da53fb04a52dac9130f3f7c75a"
Sep 07 14:10:29.777086 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.777069    2581 scope.go:117] "RemoveContainer" containerID="d371d936f006f5a729dccc8008667d03e984ed5c1d2ff36958b20bd8bf3dc217"
Sep 07 14:10:29.784144 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.784127    2581 scope.go:117] "RemoveContainer" containerID="15c80dcac59da06fb6aaac405adc787063860fa4068262621ba75064c06fc73d"
Sep 07 14:10:29.791423 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.791406    2581 scope.go:117] "RemoveContainer" containerID="a09b2fefcd0fea6e6c28e0788098dc58bb696f18cb2808effafa2530836196f6"
Sep 07 14:10:29.798470 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:29.798448    2581 scope.go:117] "RemoveContainer" containerID="bc03667284a2a429ac8dc4d818b566c52c2589983884aa1eb27ed91f16d25a38"
Sep 07 14:10:31.519196 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:31.519157    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" path="/var/lib/kubelet/pods/37da795c-bad2-44e6-a446-5e1ee5466cf2/volumes"
Sep 07 14:10:31.519787 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:31.519771    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99706394-be8c-4791-9618-351492d0ced3" path="/var/lib/kubelet/pods/99706394-be8c-4791-9618-351492d0ced3/volumes"
Sep 07 14:10:41.455609 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.455570    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-psqq6"]
Sep 07 14:10:41.456007 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.455990    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="online"
Sep 07 14:10:41.456055 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456011    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="online"
Sep 07 14:10:41.456055 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456026    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="online"
Sep 07 14:10:41.456055 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456036    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="online"
Sep 07 14:10:41.456055 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456047    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="offline"
Sep 07 14:10:41.456173 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456056    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="offline"
Sep 07 14:10:41.456173 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456070    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="feast-init"
Sep 07 14:10:41.456173 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456078    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="feast-init"
Sep 07 14:10:41.456173 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456087    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="offline"
Sep 07 14:10:41.456173 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456095    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="offline"
Sep 07 14:10:41.456173 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456110    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="ui"
Sep 07 14:10:41.456173 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456119    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="ui"
Sep 07 14:10:41.456173 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456130    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="feast-init"
Sep 07 14:10:41.456173 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456139    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="feast-init"
Sep 07 14:10:41.456173 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456151    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="registry"
Sep 07 14:10:41.456173 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456159    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="registry"
Sep 07 14:10:41.456173 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456170    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="feast-apply"
Sep 07 14:10:41.456527 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456178    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="feast-apply"
Sep 07 14:10:41.456527 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456189    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="feast-apply"
Sep 07 14:10:41.456527 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456197    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="feast-apply"
Sep 07 14:10:41.456527 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456211    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="ui"
Sep 07 14:10:41.456527 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456219    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="ui"
Sep 07 14:10:41.456527 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456284    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="online"
Sep 07 14:10:41.456527 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456327    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="registry"
Sep 07 14:10:41.456527 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456336    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="offline"
Sep 07 14:10:41.456527 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456344    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="offline"
Sep 07 14:10:41.456527 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456354    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="ui"
Sep 07 14:10:41.456527 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456364    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="37da795c-bad2-44e6-a446-5e1ee5466cf2" containerName="online"
Sep 07 14:10:41.456527 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.456374    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="99706394-be8c-4791-9618-351492d0ced3" containerName="ui"
Sep 07 14:10:41.460919 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.460900    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-psqq6"
Sep 07 14:10:41.463182 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.463155    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Sep 07 14:10:41.463182 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.463162    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-f24v7\""
Sep 07 14:10:41.464506 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.464472    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 07 14:10:41.464682 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.464541    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 07 14:10:41.466585 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.466556    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-psqq6"]
Sep 07 14:10:41.481639 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.481609    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-47tln"]
Sep 07 14:10:41.484733 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.484708    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-47tln"
Sep 07 14:10:41.491942 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.491912    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-47tln"]
Sep 07 14:10:41.541238 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.541206    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a-postgresdata\") pod \"postgres-864846d4f5-psqq6\" (UID: \"23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a\") " pod="test-ns-feast/postgres-864846d4f5-psqq6"
Sep 07 14:10:41.541238 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.541239    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqcpg\" (UniqueName: \"kubernetes.io/projected/23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a-kube-api-access-vqcpg\") pod \"postgres-864846d4f5-psqq6\" (UID: \"23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a\") " pod="test-ns-feast/postgres-864846d4f5-psqq6"
Sep 07 14:10:41.541516 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.541388    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj8wq\" (UniqueName: \"kubernetes.io/projected/e4dff82d-29cc-4678-9771-19edab0bbd3f-kube-api-access-cj8wq\") pod \"redis-69bbd798b6-47tln\" (UID: \"e4dff82d-29cc-4678-9771-19edab0bbd3f\") " pod="test-ns-feast/redis-69bbd798b6-47tln"
Sep 07 14:10:41.642301 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.642262    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj8wq\" (UniqueName: \"kubernetes.io/projected/e4dff82d-29cc-4678-9771-19edab0bbd3f-kube-api-access-cj8wq\") pod \"redis-69bbd798b6-47tln\" (UID: \"e4dff82d-29cc-4678-9771-19edab0bbd3f\") " pod="test-ns-feast/redis-69bbd798b6-47tln"
Sep 07 14:10:41.642487 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.642327    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a-postgresdata\") pod \"postgres-864846d4f5-psqq6\" (UID: \"23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a\") " pod="test-ns-feast/postgres-864846d4f5-psqq6"
Sep 07 14:10:41.642487 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.642344    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqcpg\" (UniqueName: \"kubernetes.io/projected/23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a-kube-api-access-vqcpg\") pod \"postgres-864846d4f5-psqq6\" (UID: \"23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a\") " pod="test-ns-feast/postgres-864846d4f5-psqq6"
Sep 07 14:10:41.642783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.642760    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a-postgresdata\") pod \"postgres-864846d4f5-psqq6\" (UID: \"23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a\") " pod="test-ns-feast/postgres-864846d4f5-psqq6"
Sep 07 14:10:41.650936 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.650899    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqcpg\" (UniqueName: \"kubernetes.io/projected/23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a-kube-api-access-vqcpg\") pod \"postgres-864846d4f5-psqq6\" (UID: \"23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a\") " pod="test-ns-feast/postgres-864846d4f5-psqq6"
Sep 07 14:10:41.650936 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.650930    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj8wq\" (UniqueName: \"kubernetes.io/projected/e4dff82d-29cc-4678-9771-19edab0bbd3f-kube-api-access-cj8wq\") pod \"redis-69bbd798b6-47tln\" (UID: \"e4dff82d-29cc-4678-9771-19edab0bbd3f\") " pod="test-ns-feast/redis-69bbd798b6-47tln"
Sep 07 14:10:41.776915 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.776834    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-psqq6"
Sep 07 14:10:41.795856 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:41.795824    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-47tln"
Sep 07 14:10:42.049237 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:42.049212    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-psqq6"]
Sep 07 14:10:42.051590 ip-10-0-139-134 kubenswrapper[2581]: W0907 14:10:42.051560    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23c8bad8_0b46_4fbc_96a2_a5d4a9b5dd1a.slice/crio-cc461eeb4cda515b3e98750fac710e76ee017eb6a66ec96e3adc4397d62749ae WatchSource:0}: Error finding container cc461eeb4cda515b3e98750fac710e76ee017eb6a66ec96e3adc4397d62749ae: Status 404 returned error can't find the container with id cc461eeb4cda515b3e98750fac710e76ee017eb6a66ec96e3adc4397d62749ae
Sep 07 14:10:42.053437 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:42.053421    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 14:10:42.075061 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:42.075026    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-47tln"]
Sep 07 14:10:42.077882 ip-10-0-139-134 kubenswrapper[2581]: W0907 14:10:42.077856    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4dff82d_29cc_4678_9771_19edab0bbd3f.slice/crio-287eeb7909ef699774b52c8b9eed753dbaec53c5f04ffd2249b76fb5f5d325c0 WatchSource:0}: Error finding container 287eeb7909ef699774b52c8b9eed753dbaec53c5f04ffd2249b76fb5f5d325c0: Status 404 returned error can't find the container with id 287eeb7909ef699774b52c8b9eed753dbaec53c5f04ffd2249b76fb5f5d325c0
Sep 07 14:10:42.773636 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:42.773605    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-47tln" event={"ID":"e4dff82d-29cc-4678-9771-19edab0bbd3f","Type":"ContainerStarted","Data":"287eeb7909ef699774b52c8b9eed753dbaec53c5f04ffd2249b76fb5f5d325c0"}
Sep 07 14:10:42.775116 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:42.775084    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-psqq6" event={"ID":"23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a","Type":"ContainerStarted","Data":"cc461eeb4cda515b3e98750fac710e76ee017eb6a66ec96e3adc4397d62749ae"}
Sep 07 14:10:44.785879 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:44.785840    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-47tln" event={"ID":"e4dff82d-29cc-4678-9771-19edab0bbd3f","Type":"ContainerStarted","Data":"8193da19762bb0b22f4bb89e8049c2c40120b2442ab1e6cc726a48e5b0a15088"}
Sep 07 14:10:44.813384 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:44.813322    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-47tln" podStartSLOduration=2.147282652 podStartE2EDuration="3.813282469s" totalImagesPullingTime="1.665999817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 14:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 14:10:44.811837502 +0000 UTC m=+785.812265898" watchObservedRunningTime="2026-09-07 14:10:44.813282469 +0000 UTC m=+785.813710862"
Sep 07 14:10:47.799698 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:47.799664    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-psqq6" event={"ID":"23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a","Type":"ContainerStarted","Data":"edda75ac07f29dae086f863afaf03706a850f0a49ed1b79b817f9d913d36d1ca"}
Sep 07 14:10:47.820493 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:47.820441    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-psqq6" podStartSLOduration=1.8205157170000001 podStartE2EDuration="6.820423008s" totalImagesPullingTime="4.999907291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 14:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 14:10:47.819387346 +0000 UTC m=+788.819815743" watchObservedRunningTime="2026-09-07 14:10:47.820423008 +0000 UTC m=+788.820851402"
Sep 07 14:10:52.320076 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.320038    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-776f6db575-l7t68"]
Sep 07 14:10:52.326962 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.326942    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:10:52.329193 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.329160    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Sep 07 14:10:52.329365 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.329249    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-xtgq5\""
Sep 07 14:10:52.329456 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.329396    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Sep 07 14:10:52.329516 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.329477    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Sep 07 14:10:52.329568 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.329530    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Sep 07 14:10:52.333194 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.333171    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-776f6db575-l7t68"]
Sep 07 14:10:52.435214 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.435174    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/27d399c9-dbb9-4234-8622-d55f8f649e02-offline-tls\") pod \"feast-credit-scoring-776f6db575-l7t68\" (UID: \"27d399c9-dbb9-4234-8622-d55f8f649e02\") " pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:10:52.435214 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.435215    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/27d399c9-dbb9-4234-8622-d55f8f649e02-online-tls\") pod \"feast-credit-scoring-776f6db575-l7t68\" (UID: \"27d399c9-dbb9-4234-8622-d55f8f649e02\") " pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:10:52.435457 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.435234    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgd78\" (UniqueName: \"kubernetes.io/projected/27d399c9-dbb9-4234-8622-d55f8f649e02-kube-api-access-cgd78\") pod \"feast-credit-scoring-776f6db575-l7t68\" (UID: \"27d399c9-dbb9-4234-8622-d55f8f649e02\") " pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:10:52.435457 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.435317    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/27d399c9-dbb9-4234-8622-d55f8f649e02-feast-data\") pod \"feast-credit-scoring-776f6db575-l7t68\" (UID: \"27d399c9-dbb9-4234-8622-d55f8f649e02\") " pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:10:52.435457 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.435341    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/27d399c9-dbb9-4234-8622-d55f8f649e02-registry-tls\") pod \"feast-credit-scoring-776f6db575-l7t68\" (UID: \"27d399c9-dbb9-4234-8622-d55f8f649e02\") " pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:10:52.536015 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.535982    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/27d399c9-dbb9-4234-8622-d55f8f649e02-feast-data\") pod \"feast-credit-scoring-776f6db575-l7t68\" (UID: \"27d399c9-dbb9-4234-8622-d55f8f649e02\") " pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:10:52.536183 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.536025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/27d399c9-dbb9-4234-8622-d55f8f649e02-registry-tls\") pod \"feast-credit-scoring-776f6db575-l7t68\" (UID: \"27d399c9-dbb9-4234-8622-d55f8f649e02\") " pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:10:52.536183 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.536156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/27d399c9-dbb9-4234-8622-d55f8f649e02-offline-tls\") pod \"feast-credit-scoring-776f6db575-l7t68\" (UID: \"27d399c9-dbb9-4234-8622-d55f8f649e02\") " pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:10:52.536422 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.536200    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/27d399c9-dbb9-4234-8622-d55f8f649e02-online-tls\") pod \"feast-credit-scoring-776f6db575-l7t68\" (UID: \"27d399c9-dbb9-4234-8622-d55f8f649e02\") " pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:10:52.536422 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.536224    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgd78\" (UniqueName: \"kubernetes.io/projected/27d399c9-dbb9-4234-8622-d55f8f649e02-kube-api-access-cgd78\") pod \"feast-credit-scoring-776f6db575-l7t68\" (UID: \"27d399c9-dbb9-4234-8622-d55f8f649e02\") " pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:10:52.536422 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:10:52.536283    2581 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-offline-tls: secret "feast-credit-scoring-offline-tls" not found
Sep 07 14:10:52.536422 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:10:52.536414    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d399c9-dbb9-4234-8622-d55f8f649e02-offline-tls podName:27d399c9-dbb9-4234-8622-d55f8f649e02 nodeName:}" failed. No retries permitted until 2026-09-07 14:10:53.036391443 +0000 UTC m=+794.036819834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/27d399c9-dbb9-4234-8622-d55f8f649e02-offline-tls") pod "feast-credit-scoring-776f6db575-l7t68" (UID: "27d399c9-dbb9-4234-8622-d55f8f649e02") : secret "feast-credit-scoring-offline-tls" not found
Sep 07 14:10:52.536665 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.536494    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/27d399c9-dbb9-4234-8622-d55f8f649e02-feast-data\") pod \"feast-credit-scoring-776f6db575-l7t68\" (UID: \"27d399c9-dbb9-4234-8622-d55f8f649e02\") " pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:10:52.538592 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.538574    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/27d399c9-dbb9-4234-8622-d55f8f649e02-online-tls\") pod \"feast-credit-scoring-776f6db575-l7t68\" (UID: \"27d399c9-dbb9-4234-8622-d55f8f649e02\") " pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:10:52.538692 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.538676    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/27d399c9-dbb9-4234-8622-d55f8f649e02-registry-tls\") pod \"feast-credit-scoring-776f6db575-l7t68\" (UID: \"27d399c9-dbb9-4234-8622-d55f8f649e02\") " pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:10:52.546458 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:52.546433    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgd78\" (UniqueName: \"kubernetes.io/projected/27d399c9-dbb9-4234-8622-d55f8f649e02-kube-api-access-cgd78\") pod \"feast-credit-scoring-776f6db575-l7t68\" (UID: \"27d399c9-dbb9-4234-8622-d55f8f649e02\") " pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:10:53.039682 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:53.039642    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/27d399c9-dbb9-4234-8622-d55f8f649e02-offline-tls\") pod \"feast-credit-scoring-776f6db575-l7t68\" (UID: \"27d399c9-dbb9-4234-8622-d55f8f649e02\") " pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:10:53.042143 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:53.042116    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/27d399c9-dbb9-4234-8622-d55f8f649e02-offline-tls\") pod \"feast-credit-scoring-776f6db575-l7t68\" (UID: \"27d399c9-dbb9-4234-8622-d55f8f649e02\") " pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:10:53.237913 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:53.237853    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:10:53.520498 ip-10-0-139-134 kubenswrapper[2581]: W0907 14:10:53.520469    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d399c9_dbb9_4234_8622_d55f8f649e02.slice/crio-8aa6d9967913ba12bf8b850a165c412a1fec8df6a16ed898fdea377149517ec4 WatchSource:0}: Error finding container 8aa6d9967913ba12bf8b850a165c412a1fec8df6a16ed898fdea377149517ec4: Status 404 returned error can't find the container with id 8aa6d9967913ba12bf8b850a165c412a1fec8df6a16ed898fdea377149517ec4
Sep 07 14:10:53.520835 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:53.520498    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-776f6db575-l7t68"]
Sep 07 14:10:53.828916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:53.828883    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" event={"ID":"27d399c9-dbb9-4234-8622-d55f8f649e02","Type":"ContainerStarted","Data":"62ebdc19f793eff4e0e34bc3a514d76f9bec44cff897c8f9b42ff66c19ca068c"}
Sep 07 14:10:53.829082 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:53.828936    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" event={"ID":"27d399c9-dbb9-4234-8622-d55f8f649e02","Type":"ContainerStarted","Data":"8aa6d9967913ba12bf8b850a165c412a1fec8df6a16ed898fdea377149517ec4"}
Sep 07 14:10:55.837861 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:55.837822    2581 generic.go:356] "Generic (PLEG): container finished" podID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerID="62ebdc19f793eff4e0e34bc3a514d76f9bec44cff897c8f9b42ff66c19ca068c" exitCode=0
Sep 07 14:10:55.838340 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:55.837899    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" event={"ID":"27d399c9-dbb9-4234-8622-d55f8f649e02","Type":"ContainerDied","Data":"62ebdc19f793eff4e0e34bc3a514d76f9bec44cff897c8f9b42ff66c19ca068c"}
Sep 07 14:10:56.845134 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:10:56.845102    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" event={"ID":"27d399c9-dbb9-4234-8622-d55f8f649e02","Type":"ContainerStarted","Data":"617afcd3746c24f609073de536ad04c5074540b56da62fcef7103a2049629640"}
Sep 07 14:11:02.871907 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:02.871817    2581 generic.go:356] "Generic (PLEG): container finished" podID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerID="617afcd3746c24f609073de536ad04c5074540b56da62fcef7103a2049629640" exitCode=0
Sep 07 14:11:02.872235 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:02.871898    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" event={"ID":"27d399c9-dbb9-4234-8622-d55f8f649e02","Type":"ContainerDied","Data":"617afcd3746c24f609073de536ad04c5074540b56da62fcef7103a2049629640"}
Sep 07 14:11:03.880982 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:03.880942    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" event={"ID":"27d399c9-dbb9-4234-8622-d55f8f649e02","Type":"ContainerStarted","Data":"dae506f6b1850a3a3409609ea7ae5c60b89edbffed4f9ded40921847ed3e8e91"}
Sep 07 14:11:03.881371 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:03.881020    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" event={"ID":"27d399c9-dbb9-4234-8622-d55f8f649e02","Type":"ContainerStarted","Data":"a3b0e3d9a35b76fb896aee4b82763c67bf37a074adb357697cd9b55aaad7ae68"}
Sep 07 14:11:03.881371 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:03.881049    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" event={"ID":"27d399c9-dbb9-4234-8622-d55f8f649e02","Type":"ContainerStarted","Data":"0a210452f15effbb21430395835e27fa71f75d32c37eb6d898477ed05a4b3533"}
Sep 07 14:11:03.909100 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:03.909037    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" podStartSLOduration=11.909013955 podStartE2EDuration="11.909013955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 14:10:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 14:11:03.907815283 +0000 UTC m=+804.908243676" watchObservedRunningTime="2026-09-07 14:11:03.909013955 +0000 UTC m=+804.909442349"
Sep 07 14:11:05.238528 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:05.238479    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:11:05.239015 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:05.238600    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:11:05.239015 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:05.238621    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:11:05.240618 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:05.240581    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.30:8816: connect: connection refused"
Sep 07 14:11:05.240857 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:05.240599    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
Sep 07 14:11:05.240966 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:05.240621    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Sep 07 14:11:08.238423 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:08.238376    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.30:8816: connect: connection refused"
Sep 07 14:11:08.238830 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:08.238375    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
Sep 07 14:11:08.238830 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:08.238468    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Sep 07 14:11:11.238780 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:11.238729    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.30:8816: connect: connection refused"
Sep 07 14:11:11.239272 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:11.238749    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Sep 07 14:11:11.239272 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:11.239206    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
Sep 07 14:11:13.239003 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:13.238961    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:11:13.239393 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:13.239094    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:11:13.239393 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:13.239123    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:11:14.238495 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:14.238446    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
Sep 07 14:11:14.239484 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:14.239456    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:11:14.240380 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:14.240356    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:11:14.245061 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:14.245038    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:11:14.938663 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:14.938630    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:11:17.239453 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:17.239418    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:11:17.950152 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:11:17.950127    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:12:27.024506 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.024471    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-776f6db575-l7t68"]
Sep 07 14:12:27.025161 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.024792    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="registry" containerID="cri-o://0a210452f15effbb21430395835e27fa71f75d32c37eb6d898477ed05a4b3533" gracePeriod=30
Sep 07 14:12:27.025161 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.024877    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="offline" containerID="cri-o://dae506f6b1850a3a3409609ea7ae5c60b89edbffed4f9ded40921847ed3e8e91" gracePeriod=30
Sep 07 14:12:27.025161 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.024871    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="online" containerID="cri-o://a3b0e3d9a35b76fb896aee4b82763c67bf37a074adb357697cd9b55aaad7ae68" gracePeriod=30
Sep 07 14:12:27.042096 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.042061    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-psqq6"]
Sep 07 14:12:27.042263 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.042229    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-psqq6" podUID="23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a" containerName="postgres" containerID="cri-o://edda75ac07f29dae086f863afaf03706a850f0a49ed1b79b817f9d913d36d1ca" gracePeriod=30
Sep 07 14:12:27.046632 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.046606    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-47tln"]
Sep 07 14:12:27.046770 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.046751    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-47tln" podUID="e4dff82d-29cc-4678-9771-19edab0bbd3f" containerName="redis" containerID="cri-o://8193da19762bb0b22f4bb89e8049c2c40120b2442ab1e6cc726a48e5b0a15088" gracePeriod=30
Sep 07 14:12:27.236035 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.235957    2581 generic.go:356] "Generic (PLEG): container finished" podID="e4dff82d-29cc-4678-9771-19edab0bbd3f" containerID="8193da19762bb0b22f4bb89e8049c2c40120b2442ab1e6cc726a48e5b0a15088" exitCode=0
Sep 07 14:12:27.236199 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.236035    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-47tln" event={"ID":"e4dff82d-29cc-4678-9771-19edab0bbd3f","Type":"ContainerDied","Data":"8193da19762bb0b22f4bb89e8049c2c40120b2442ab1e6cc726a48e5b0a15088"}
Sep 07 14:12:27.238049 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.238021    2581 generic.go:356] "Generic (PLEG): container finished" podID="23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a" containerID="edda75ac07f29dae086f863afaf03706a850f0a49ed1b79b817f9d913d36d1ca" exitCode=0
Sep 07 14:12:27.238171 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.238073    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-psqq6" event={"ID":"23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a","Type":"ContainerDied","Data":"edda75ac07f29dae086f863afaf03706a850f0a49ed1b79b817f9d913d36d1ca"}
Sep 07 14:12:27.297421 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.297392    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-psqq6"
Sep 07 14:12:27.317722 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.317691    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-47tln"
Sep 07 14:12:27.329817 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.329789    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqcpg\" (UniqueName: \"kubernetes.io/projected/23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a-kube-api-access-vqcpg\") pod \"23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a\" (UID: \"23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a\") "
Sep 07 14:12:27.329957 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.329845    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cj8wq\" (UniqueName: \"kubernetes.io/projected/e4dff82d-29cc-4678-9771-19edab0bbd3f-kube-api-access-cj8wq\") pod \"e4dff82d-29cc-4678-9771-19edab0bbd3f\" (UID: \"e4dff82d-29cc-4678-9771-19edab0bbd3f\") "
Sep 07 14:12:27.329957 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.329878    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a-postgresdata\") pod \"23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a\" (UID: \"23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a\") "
Sep 07 14:12:27.332111 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.332076    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a-kube-api-access-vqcpg" (OuterVolumeSpecName: "kube-api-access-vqcpg") pod "23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a" (UID: "23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a"). InnerVolumeSpecName "kube-api-access-vqcpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 14:12:27.332336 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.332318    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4dff82d-29cc-4678-9771-19edab0bbd3f-kube-api-access-cj8wq" (OuterVolumeSpecName: "kube-api-access-cj8wq") pod "e4dff82d-29cc-4678-9771-19edab0bbd3f" (UID: "e4dff82d-29cc-4678-9771-19edab0bbd3f"). InnerVolumeSpecName "kube-api-access-cj8wq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 14:12:27.363714 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.363675    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a" (UID: "23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 14:12:27.430927 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.430898    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqcpg\" (UniqueName: \"kubernetes.io/projected/23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a-kube-api-access-vqcpg\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:12:27.430927 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.430924    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj8wq\" (UniqueName: \"kubernetes.io/projected/e4dff82d-29cc-4678-9771-19edab0bbd3f-kube-api-access-cj8wq\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:12:27.430927 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:27.430934    2581 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a-postgresdata\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:12:28.243615 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:28.243583    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-47tln"
Sep 07 14:12:28.244087 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:28.243581    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-47tln" event={"ID":"e4dff82d-29cc-4678-9771-19edab0bbd3f","Type":"ContainerDied","Data":"287eeb7909ef699774b52c8b9eed753dbaec53c5f04ffd2249b76fb5f5d325c0"}
Sep 07 14:12:28.244087 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:28.243715    2581 scope.go:117] "RemoveContainer" containerID="8193da19762bb0b22f4bb89e8049c2c40120b2442ab1e6cc726a48e5b0a15088"
Sep 07 14:12:28.246890 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:28.246867    2581 generic.go:356] "Generic (PLEG): container finished" podID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerID="a3b0e3d9a35b76fb896aee4b82763c67bf37a074adb357697cd9b55aaad7ae68" exitCode=0
Sep 07 14:12:28.247001 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:28.246946    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" event={"ID":"27d399c9-dbb9-4234-8622-d55f8f649e02","Type":"ContainerDied","Data":"a3b0e3d9a35b76fb896aee4b82763c67bf37a074adb357697cd9b55aaad7ae68"}
Sep 07 14:12:28.248327 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:28.248300    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-psqq6" event={"ID":"23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a","Type":"ContainerDied","Data":"cc461eeb4cda515b3e98750fac710e76ee017eb6a66ec96e3adc4397d62749ae"}
Sep 07 14:12:28.248431 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:28.248345    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-psqq6"
Sep 07 14:12:28.252302 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:28.252268    2581 scope.go:117] "RemoveContainer" containerID="edda75ac07f29dae086f863afaf03706a850f0a49ed1b79b817f9d913d36d1ca"
Sep 07 14:12:28.260461 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:28.260440    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-47tln"]
Sep 07 14:12:28.262894 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:28.262875    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-47tln"]
Sep 07 14:12:28.274835 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:28.274776    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-psqq6"]
Sep 07 14:12:28.277889 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:28.277867    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-psqq6"]
Sep 07 14:12:29.519807 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:29.519776    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a" path="/var/lib/kubelet/pods/23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a/volumes"
Sep 07 14:12:29.520177 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:29.520085    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4dff82d-29cc-4678-9771-19edab0bbd3f" path="/var/lib/kubelet/pods/e4dff82d-29cc-4678-9771-19edab0bbd3f/volumes"
Sep 07 14:12:34.936040 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:34.935951    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Sep 07 14:12:44.935548 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:44.935501    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Sep 07 14:12:54.935701 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:54.935656    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Sep 07 14:12:54.936080 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:54.935782    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:12:57.366111 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:57.366079    2581 generic.go:356] "Generic (PLEG): container finished" podID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerID="dae506f6b1850a3a3409609ea7ae5c60b89edbffed4f9ded40921847ed3e8e91" exitCode=137
Sep 07 14:12:57.366111 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:57.366105    2581 generic.go:356] "Generic (PLEG): container finished" podID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerID="0a210452f15effbb21430395835e27fa71f75d32c37eb6d898477ed05a4b3533" exitCode=137
Sep 07 14:12:57.366550 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:57.366159    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" event={"ID":"27d399c9-dbb9-4234-8622-d55f8f649e02","Type":"ContainerDied","Data":"dae506f6b1850a3a3409609ea7ae5c60b89edbffed4f9ded40921847ed3e8e91"}
Sep 07 14:12:57.366550 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:57.366214    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" event={"ID":"27d399c9-dbb9-4234-8622-d55f8f649e02","Type":"ContainerDied","Data":"0a210452f15effbb21430395835e27fa71f75d32c37eb6d898477ed05a4b3533"}
Sep 07 14:12:57.677702 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:57.677675    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:12:57.761261 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:57.761227    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/27d399c9-dbb9-4234-8622-d55f8f649e02-registry-tls\") pod \"27d399c9-dbb9-4234-8622-d55f8f649e02\" (UID: \"27d399c9-dbb9-4234-8622-d55f8f649e02\") "
Sep 07 14:12:57.761261 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:57.761268    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgd78\" (UniqueName: \"kubernetes.io/projected/27d399c9-dbb9-4234-8622-d55f8f649e02-kube-api-access-cgd78\") pod \"27d399c9-dbb9-4234-8622-d55f8f649e02\" (UID: \"27d399c9-dbb9-4234-8622-d55f8f649e02\") "
Sep 07 14:12:57.761539 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:57.761336    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/27d399c9-dbb9-4234-8622-d55f8f649e02-online-tls\") pod \"27d399c9-dbb9-4234-8622-d55f8f649e02\" (UID: \"27d399c9-dbb9-4234-8622-d55f8f649e02\") "
Sep 07 14:12:57.761539 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:57.761355    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/27d399c9-dbb9-4234-8622-d55f8f649e02-feast-data\") pod \"27d399c9-dbb9-4234-8622-d55f8f649e02\" (UID: \"27d399c9-dbb9-4234-8622-d55f8f649e02\") "
Sep 07 14:12:57.761539 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:57.761381    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/27d399c9-dbb9-4234-8622-d55f8f649e02-offline-tls\") pod \"27d399c9-dbb9-4234-8622-d55f8f649e02\" (UID: \"27d399c9-dbb9-4234-8622-d55f8f649e02\") "
Sep 07 14:12:57.763578 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:57.763536    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27d399c9-dbb9-4234-8622-d55f8f649e02-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "27d399c9-dbb9-4234-8622-d55f8f649e02" (UID: "27d399c9-dbb9-4234-8622-d55f8f649e02"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:12:57.763578 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:57.763568    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27d399c9-dbb9-4234-8622-d55f8f649e02-online-tls" (OuterVolumeSpecName: "online-tls") pod "27d399c9-dbb9-4234-8622-d55f8f649e02" (UID: "27d399c9-dbb9-4234-8622-d55f8f649e02"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:12:57.763756 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:57.763617    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27d399c9-dbb9-4234-8622-d55f8f649e02-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "27d399c9-dbb9-4234-8622-d55f8f649e02" (UID: "27d399c9-dbb9-4234-8622-d55f8f649e02"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:12:57.763756 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:57.763739    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27d399c9-dbb9-4234-8622-d55f8f649e02-kube-api-access-cgd78" (OuterVolumeSpecName: "kube-api-access-cgd78") pod "27d399c9-dbb9-4234-8622-d55f8f649e02" (UID: "27d399c9-dbb9-4234-8622-d55f8f649e02"). InnerVolumeSpecName "kube-api-access-cgd78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 14:12:57.769617 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:57.769594    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27d399c9-dbb9-4234-8622-d55f8f649e02-feast-data" (OuterVolumeSpecName: "feast-data") pod "27d399c9-dbb9-4234-8622-d55f8f649e02" (UID: "27d399c9-dbb9-4234-8622-d55f8f649e02"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 14:12:57.862502 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:57.862466    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/27d399c9-dbb9-4234-8622-d55f8f649e02-online-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:12:57.862502 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:57.862497    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/27d399c9-dbb9-4234-8622-d55f8f649e02-feast-data\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:12:57.862502 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:57.862507    2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/27d399c9-dbb9-4234-8622-d55f8f649e02-offline-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:12:57.862730 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:57.862515    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/27d399c9-dbb9-4234-8622-d55f8f649e02-registry-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:12:57.862730 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:57.862525    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgd78\" (UniqueName: \"kubernetes.io/projected/27d399c9-dbb9-4234-8622-d55f8f649e02-kube-api-access-cgd78\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:12:58.372625 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:58.372586    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68" event={"ID":"27d399c9-dbb9-4234-8622-d55f8f649e02","Type":"ContainerDied","Data":"8aa6d9967913ba12bf8b850a165c412a1fec8df6a16ed898fdea377149517ec4"}
Sep 07 14:12:58.373150 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:58.372679    2581 scope.go:117] "RemoveContainer" containerID="dae506f6b1850a3a3409609ea7ae5c60b89edbffed4f9ded40921847ed3e8e91"
Sep 07 14:12:58.373150 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:58.372604    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-776f6db575-l7t68"
Sep 07 14:12:58.382214 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:58.382192    2581 scope.go:117] "RemoveContainer" containerID="a3b0e3d9a35b76fb896aee4b82763c67bf37a074adb357697cd9b55aaad7ae68"
Sep 07 14:12:58.390076 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:58.390056    2581 scope.go:117] "RemoveContainer" containerID="0a210452f15effbb21430395835e27fa71f75d32c37eb6d898477ed05a4b3533"
Sep 07 14:12:58.396644 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:58.396615    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-776f6db575-l7t68"]
Sep 07 14:12:58.398010 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:58.397966    2581 scope.go:117] "RemoveContainer" containerID="617afcd3746c24f609073de536ad04c5074540b56da62fcef7103a2049629640"
Sep 07 14:12:58.403338 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:58.403313    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-776f6db575-l7t68"]
Sep 07 14:12:58.406466 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:58.406449    2581 scope.go:117] "RemoveContainer" containerID="62ebdc19f793eff4e0e34bc3a514d76f9bec44cff897c8f9b42ff66c19ca068c"
Sep 07 14:12:59.519251 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:12:59.519213    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" path="/var/lib/kubelet/pods/27d399c9-dbb9-4234-8622-d55f8f649e02/volumes"
Sep 07 14:17:21.371324 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.371231    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-6ms8v"]
Sep 07 14:17:21.371783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.371581    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="feast-apply"
Sep 07 14:17:21.371783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.371595    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="feast-apply"
Sep 07 14:17:21.371783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.371604    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="online"
Sep 07 14:17:21.371783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.371610    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="online"
Sep 07 14:17:21.371783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.371622    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a" containerName="postgres"
Sep 07 14:17:21.371783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.371627    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a" containerName="postgres"
Sep 07 14:17:21.371783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.371635    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4dff82d-29cc-4678-9771-19edab0bbd3f" containerName="redis"
Sep 07 14:17:21.371783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.371640    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4dff82d-29cc-4678-9771-19edab0bbd3f" containerName="redis"
Sep 07 14:17:21.371783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.371646    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="registry"
Sep 07 14:17:21.371783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.371651    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="registry"
Sep 07 14:17:21.371783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.371657    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="feast-init"
Sep 07 14:17:21.371783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.371662    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="feast-init"
Sep 07 14:17:21.371783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.371669    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="offline"
Sep 07 14:17:21.371783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.371675    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="offline"
Sep 07 14:17:21.371783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.371720    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="23c8bad8-0b46-4fbc-96a2-a5d4a9b5dd1a" containerName="postgres"
Sep 07 14:17:21.371783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.371728    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="offline"
Sep 07 14:17:21.371783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.371735    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4dff82d-29cc-4678-9771-19edab0bbd3f" containerName="redis"
Sep 07 14:17:21.371783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.371741    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="online"
Sep 07 14:17:21.371783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.371754    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="27d399c9-dbb9-4234-8622-d55f8f649e02" containerName="registry"
Sep 07 14:17:21.374562 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.374543    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-6ms8v"
Sep 07 14:17:21.376976 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.376944    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-jrx7c\""
Sep 07 14:17:21.377108 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.377061    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Sep 07 14:17:21.377908 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.377888    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Sep 07 14:17:21.388209 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.388185    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-6ms8v"]
Sep 07 14:17:21.483055 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.483013    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjbgc\" (UniqueName: \"kubernetes.io/projected/c978bb8e-82de-4819-8cda-d3cddaa61112-kube-api-access-pjbgc\") pod \"redis-69bbd798b6-6ms8v\" (UID: \"c978bb8e-82de-4819-8cda-d3cddaa61112\") " pod="test-ns-feast-rest/redis-69bbd798b6-6ms8v"
Sep 07 14:17:21.583731 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.583674    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjbgc\" (UniqueName: \"kubernetes.io/projected/c978bb8e-82de-4819-8cda-d3cddaa61112-kube-api-access-pjbgc\") pod \"redis-69bbd798b6-6ms8v\" (UID: \"c978bb8e-82de-4819-8cda-d3cddaa61112\") " pod="test-ns-feast-rest/redis-69bbd798b6-6ms8v"
Sep 07 14:17:21.592538 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.592511    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjbgc\" (UniqueName: \"kubernetes.io/projected/c978bb8e-82de-4819-8cda-d3cddaa61112-kube-api-access-pjbgc\") pod \"redis-69bbd798b6-6ms8v\" (UID: \"c978bb8e-82de-4819-8cda-d3cddaa61112\") " pod="test-ns-feast-rest/redis-69bbd798b6-6ms8v"
Sep 07 14:17:21.699527 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.699438    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-6ms8v"
Sep 07 14:17:21.968399 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:21.968236    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-6ms8v"]
Sep 07 14:17:21.971189 ip-10-0-139-134 kubenswrapper[2581]: W0907 14:17:21.971169    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc978bb8e_82de_4819_8cda_d3cddaa61112.slice/crio-a947b20229193bdfaaa6be1489173c4c5bf623d2a8aafda7416ea6daba5b598c WatchSource:0}: Error finding container a947b20229193bdfaaa6be1489173c4c5bf623d2a8aafda7416ea6daba5b598c: Status 404 returned error can't find the container with id a947b20229193bdfaaa6be1489173c4c5bf623d2a8aafda7416ea6daba5b598c
Sep 07 14:17:22.351738 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:22.351702    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-6ms8v" event={"ID":"c978bb8e-82de-4819-8cda-d3cddaa61112","Type":"ContainerStarted","Data":"db486bae2ee66728a1b30324c97098c8243c94dcb067279c8fdbabbf73c0d711"}
Sep 07 14:17:22.351933 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:22.351747    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-6ms8v" event={"ID":"c978bb8e-82de-4819-8cda-d3cddaa61112","Type":"ContainerStarted","Data":"a947b20229193bdfaaa6be1489173c4c5bf623d2a8aafda7416ea6daba5b598c"}
Sep 07 14:17:22.367596 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:22.367548    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-6ms8v" podStartSLOduration=1.36753192 podStartE2EDuration="1.36753192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 14:17:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 14:17:22.366688955 +0000 UTC m=+1183.367117349" watchObservedRunningTime="2026-09-07 14:17:22.36753192 +0000 UTC m=+1183.367960312"
Sep 07 14:17:26.801926 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:26.801888    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-h7j6k"]
Sep 07 14:17:26.805125 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:26.805105    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-h7j6k"
Sep 07 14:17:26.807751 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:26.807729    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Sep 07 14:17:26.812521 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:26.812492    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-h7j6k"]
Sep 07 14:17:26.930971 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:26.930928    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvnc9\" (UniqueName: \"kubernetes.io/projected/a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d-kube-api-access-lvnc9\") pod \"postgres-864846d4f5-h7j6k\" (UID: \"a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d\") " pod="test-ns-feast-rest/postgres-864846d4f5-h7j6k"
Sep 07 14:17:26.930971 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:26.930967    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d-postgresdata\") pod \"postgres-864846d4f5-h7j6k\" (UID: \"a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d\") " pod="test-ns-feast-rest/postgres-864846d4f5-h7j6k"
Sep 07 14:17:27.032000 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:27.031967    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvnc9\" (UniqueName: \"kubernetes.io/projected/a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d-kube-api-access-lvnc9\") pod \"postgres-864846d4f5-h7j6k\" (UID: \"a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d\") " pod="test-ns-feast-rest/postgres-864846d4f5-h7j6k"
Sep 07 14:17:27.032169 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:27.032009    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d-postgresdata\") pod \"postgres-864846d4f5-h7j6k\" (UID: \"a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d\") " pod="test-ns-feast-rest/postgres-864846d4f5-h7j6k"
Sep 07 14:17:27.032526 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:27.032506    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d-postgresdata\") pod \"postgres-864846d4f5-h7j6k\" (UID: \"a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d\") " pod="test-ns-feast-rest/postgres-864846d4f5-h7j6k"
Sep 07 14:17:27.042197 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:27.042166    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvnc9\" (UniqueName: \"kubernetes.io/projected/a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d-kube-api-access-lvnc9\") pod \"postgres-864846d4f5-h7j6k\" (UID: \"a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d\") " pod="test-ns-feast-rest/postgres-864846d4f5-h7j6k"
Sep 07 14:17:27.115029 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:27.114999    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-h7j6k"
Sep 07 14:17:27.386158 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:27.386107    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-h7j6k"]
Sep 07 14:17:27.388339 ip-10-0-139-134 kubenswrapper[2581]: W0907 14:17:27.388306    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0c10d4e_8397_421f_8fe9_c58a9f4d1e3d.slice/crio-38cae6f29a1143b249c62c69826e07d6522517b391a2346f4568d98398a93dfb WatchSource:0}: Error finding container 38cae6f29a1143b249c62c69826e07d6522517b391a2346f4568d98398a93dfb: Status 404 returned error can't find the container with id 38cae6f29a1143b249c62c69826e07d6522517b391a2346f4568d98398a93dfb
Sep 07 14:17:28.377078 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:28.377036    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-h7j6k" event={"ID":"a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d","Type":"ContainerStarted","Data":"e59571539483e32f1636df4304578b002e0e10a5cf4cb8eb2e19fb0c1d2690c3"}
Sep 07 14:17:28.377078 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:28.377085    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-h7j6k" event={"ID":"a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d","Type":"ContainerStarted","Data":"38cae6f29a1143b249c62c69826e07d6522517b391a2346f4568d98398a93dfb"}
Sep 07 14:17:32.486729 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:32.486675    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-h7j6k" podStartSLOduration=6.486654653 podStartE2EDuration="6.486654653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 14:17:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 14:17:28.392737801 +0000 UTC m=+1189.393166195" watchObservedRunningTime="2026-09-07 14:17:32.486654653 +0000 UTC m=+1193.487083047"
Sep 07 14:17:32.487601 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:32.487582    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"]
Sep 07 14:17:32.490968 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:32.490951    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:32.493593 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:32.493528    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Sep 07 14:17:32.493714 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:32.493642    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Sep 07 14:17:32.493806 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:32.493789    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-2jf2x\""
Sep 07 14:17:32.494425 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:32.494406    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Sep 07 14:17:32.502819 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:32.502793    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"]
Sep 07 14:17:32.574051 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:32.574018    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-registry-tls\") pod \"feast-credit-scoring-69dc88fd85-xnj7n\" (UID: \"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12\") " pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:32.574232 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:32.574078    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-feast-data\") pod \"feast-credit-scoring-69dc88fd85-xnj7n\" (UID: \"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12\") " pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:32.574232 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:32.574100    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtn94\" (UniqueName: \"kubernetes.io/projected/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-kube-api-access-mtn94\") pod \"feast-credit-scoring-69dc88fd85-xnj7n\" (UID: \"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12\") " pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:32.574232 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:32.574184    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-online-tls\") pod \"feast-credit-scoring-69dc88fd85-xnj7n\" (UID: \"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12\") " pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:32.680976 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:32.675845    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-feast-data\") pod \"feast-credit-scoring-69dc88fd85-xnj7n\" (UID: \"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12\") " pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:32.680976 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:32.675910    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtn94\" (UniqueName: \"kubernetes.io/projected/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-kube-api-access-mtn94\") pod \"feast-credit-scoring-69dc88fd85-xnj7n\" (UID: \"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12\") " pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:32.680976 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:32.675974    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-online-tls\") pod \"feast-credit-scoring-69dc88fd85-xnj7n\" (UID: \"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12\") " pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:32.680976 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:32.676046    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-registry-tls\") pod \"feast-credit-scoring-69dc88fd85-xnj7n\" (UID: \"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12\") " pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:32.680976 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:32.676845    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-feast-data\") pod \"feast-credit-scoring-69dc88fd85-xnj7n\" (UID: \"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12\") " pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:32.680976 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:32.679239    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-registry-tls\") pod \"feast-credit-scoring-69dc88fd85-xnj7n\" (UID: \"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12\") " pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:32.682943 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:32.682912    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-online-tls\") pod \"feast-credit-scoring-69dc88fd85-xnj7n\" (UID: \"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12\") " pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:32.689794 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:32.689769    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtn94\" (UniqueName: \"kubernetes.io/projected/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-kube-api-access-mtn94\") pod \"feast-credit-scoring-69dc88fd85-xnj7n\" (UID: \"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12\") " pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:32.802136 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:32.802051    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:33.100025 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:33.099987    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"]
Sep 07 14:17:33.103580 ip-10-0-139-134 kubenswrapper[2581]: W0907 14:17:33.103551    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58ed4e59_a6bf_4d8a_b4ff_cba03ece8b12.slice/crio-93ec3c9b767b4ea9cfd422b314c1651d6f5899dfdf9da5bd06bf42b3ce1b1f9c WatchSource:0}: Error finding container 93ec3c9b767b4ea9cfd422b314c1651d6f5899dfdf9da5bd06bf42b3ce1b1f9c: Status 404 returned error can't find the container with id 93ec3c9b767b4ea9cfd422b314c1651d6f5899dfdf9da5bd06bf42b3ce1b1f9c
Sep 07 14:17:33.396643 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:33.396550    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" event={"ID":"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12","Type":"ContainerStarted","Data":"ecf0527f0deebebc8c6eff8c5e197613046f87d8a5d4440c6e498afb3db4676e"}
Sep 07 14:17:33.396643 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:33.396601    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" event={"ID":"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12","Type":"ContainerStarted","Data":"93ec3c9b767b4ea9cfd422b314c1651d6f5899dfdf9da5bd06bf42b3ce1b1f9c"}
Sep 07 14:17:35.405215 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:35.405182    2581 generic.go:356] "Generic (PLEG): container finished" podID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerID="ecf0527f0deebebc8c6eff8c5e197613046f87d8a5d4440c6e498afb3db4676e" exitCode=0
Sep 07 14:17:35.405634 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:35.405255    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" event={"ID":"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12","Type":"ContainerDied","Data":"ecf0527f0deebebc8c6eff8c5e197613046f87d8a5d4440c6e498afb3db4676e"}
Sep 07 14:17:36.411908 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:36.411876    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" event={"ID":"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12","Type":"ContainerStarted","Data":"c32f06e6952f1d0b3c8941bc7fc63bb5db01916aa9376a061a8335fb8b0c0667"}
Sep 07 14:17:43.444397 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:43.444360    2581 generic.go:356] "Generic (PLEG): container finished" podID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerID="c32f06e6952f1d0b3c8941bc7fc63bb5db01916aa9376a061a8335fb8b0c0667" exitCode=0
Sep 07 14:17:43.444784 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:43.444431    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" event={"ID":"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12","Type":"ContainerDied","Data":"c32f06e6952f1d0b3c8941bc7fc63bb5db01916aa9376a061a8335fb8b0c0667"}
Sep 07 14:17:43.447742 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:43.447722    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Sep 07 14:17:44.453712 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:44.453670    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" event={"ID":"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12","Type":"ContainerStarted","Data":"051a0d7ca0fcd180985b9cd84c2fdcbc3e560af8cff55a438f9deebf26ed2851"}
Sep 07 14:17:44.454226 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:44.453745    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" event={"ID":"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12","Type":"ContainerStarted","Data":"3d3c29098209b9dbe7e6f46b6c3df676fb948570b6225bbe0ea636244f9f34e2"}
Sep 07 14:17:44.480419 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:44.480358    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" podStartSLOduration=12.480337218 podStartE2EDuration="12.480337218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 14:17:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 14:17:44.478103962 +0000 UTC m=+1205.478532355" watchObservedRunningTime="2026-09-07 14:17:44.480337218 +0000 UTC m=+1205.480765611"
Sep 07 14:17:44.803208 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:44.803107    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:44.803208 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:44.803184    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:44.804840 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:44.804794    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.33:6571: connect: connection refused"
Sep 07 14:17:44.805001 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:44.804842    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 07 14:17:47.803380 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:47.803320    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.33:6571: connect: connection refused"
Sep 07 14:17:47.803779 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:47.803342    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 07 14:17:50.803016 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:50.802974    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.33:6571: connect: connection refused"
Sep 07 14:17:50.809196 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:50.809161    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:50.809729 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:50.809708    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:50.812702 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:50.812675    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:52.802840 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:52.802801    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:53.803146 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:53.803097    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.33:6571: connect: connection refused"
Sep 07 14:17:56.803165 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:56.803126    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:56.803955 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:56.803936    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:17:58.197006 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:58.196968    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"]
Sep 07 14:17:58.201692 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:58.201672    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:17:58.203970 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:58.203944    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Sep 07 14:17:58.204090 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:58.203985    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Sep 07 14:17:58.204199 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:58.204184    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Sep 07 14:17:58.204249 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:58.204206    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-qz5hf\""
Sep 07 14:17:58.210194 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:58.210170    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"]
Sep 07 14:17:58.285882 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:58.285840    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4d174c73-1434-4906-a92c-7db4b9cf0bdf-feast-data\") pod \"feast-driver-ranking-5f6c998ccd-vwpxp\" (UID: \"4d174c73-1434-4906-a92c-7db4b9cf0bdf\") " pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:17:58.285882 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:58.285884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghsmg\" (UniqueName: \"kubernetes.io/projected/4d174c73-1434-4906-a92c-7db4b9cf0bdf-kube-api-access-ghsmg\") pod \"feast-driver-ranking-5f6c998ccd-vwpxp\" (UID: \"4d174c73-1434-4906-a92c-7db4b9cf0bdf\") " pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:17:58.286089 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:58.285959    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4d174c73-1434-4906-a92c-7db4b9cf0bdf-registry-tls\") pod \"feast-driver-ranking-5f6c998ccd-vwpxp\" (UID: \"4d174c73-1434-4906-a92c-7db4b9cf0bdf\") " pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:17:58.286089 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:58.286063    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4d174c73-1434-4906-a92c-7db4b9cf0bdf-online-tls\") pod \"feast-driver-ranking-5f6c998ccd-vwpxp\" (UID: \"4d174c73-1434-4906-a92c-7db4b9cf0bdf\") " pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:17:58.387133 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:58.387095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4d174c73-1434-4906-a92c-7db4b9cf0bdf-registry-tls\") pod \"feast-driver-ranking-5f6c998ccd-vwpxp\" (UID: \"4d174c73-1434-4906-a92c-7db4b9cf0bdf\") " pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:17:58.387349 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:58.387185    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4d174c73-1434-4906-a92c-7db4b9cf0bdf-online-tls\") pod \"feast-driver-ranking-5f6c998ccd-vwpxp\" (UID: \"4d174c73-1434-4906-a92c-7db4b9cf0bdf\") " pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:17:58.387349 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:58.387207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4d174c73-1434-4906-a92c-7db4b9cf0bdf-feast-data\") pod \"feast-driver-ranking-5f6c998ccd-vwpxp\" (UID: \"4d174c73-1434-4906-a92c-7db4b9cf0bdf\") " pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:17:58.387349 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:58.387225    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghsmg\" (UniqueName: \"kubernetes.io/projected/4d174c73-1434-4906-a92c-7db4b9cf0bdf-kube-api-access-ghsmg\") pod \"feast-driver-ranking-5f6c998ccd-vwpxp\" (UID: \"4d174c73-1434-4906-a92c-7db4b9cf0bdf\") " pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:17:58.387679 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:58.387646    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4d174c73-1434-4906-a92c-7db4b9cf0bdf-feast-data\") pod \"feast-driver-ranking-5f6c998ccd-vwpxp\" (UID: \"4d174c73-1434-4906-a92c-7db4b9cf0bdf\") " pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:17:58.389767 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:58.389738    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4d174c73-1434-4906-a92c-7db4b9cf0bdf-online-tls\") pod \"feast-driver-ranking-5f6c998ccd-vwpxp\" (UID: \"4d174c73-1434-4906-a92c-7db4b9cf0bdf\") " pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:17:58.389861 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:58.389774    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4d174c73-1434-4906-a92c-7db4b9cf0bdf-registry-tls\") pod \"feast-driver-ranking-5f6c998ccd-vwpxp\" (UID: \"4d174c73-1434-4906-a92c-7db4b9cf0bdf\") " pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:17:58.395915 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:58.395890    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghsmg\" (UniqueName: \"kubernetes.io/projected/4d174c73-1434-4906-a92c-7db4b9cf0bdf-kube-api-access-ghsmg\") pod \"feast-driver-ranking-5f6c998ccd-vwpxp\" (UID: \"4d174c73-1434-4906-a92c-7db4b9cf0bdf\") " pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:17:58.511034 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:58.510933    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:17:58.786559 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:58.786507    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"]
Sep 07 14:17:58.789435 ip-10-0-139-134 kubenswrapper[2581]: W0907 14:17:58.789408    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d174c73_1434_4906_a92c_7db4b9cf0bdf.slice/crio-9011bc6d1b1a2ded90ca5b96f81ce6569aaf2d2ba36ec2248d79c2c8504b83f9 WatchSource:0}: Error finding container 9011bc6d1b1a2ded90ca5b96f81ce6569aaf2d2ba36ec2248d79c2c8504b83f9: Status 404 returned error can't find the container with id 9011bc6d1b1a2ded90ca5b96f81ce6569aaf2d2ba36ec2248d79c2c8504b83f9
Sep 07 14:17:59.533131 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:59.533094    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp" event={"ID":"4d174c73-1434-4906-a92c-7db4b9cf0bdf","Type":"ContainerStarted","Data":"dc9176a3232078939beb5c2bd6cf05a9d6e1be1fd9bb7bd09e49594aac4fa3b0"}
Sep 07 14:17:59.533547 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:17:59.533146    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp" event={"ID":"4d174c73-1434-4906-a92c-7db4b9cf0bdf","Type":"ContainerStarted","Data":"9011bc6d1b1a2ded90ca5b96f81ce6569aaf2d2ba36ec2248d79c2c8504b83f9"}
Sep 07 14:18:04.554577 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:18:04.554544    2581 generic.go:356] "Generic (PLEG): container finished" podID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerID="dc9176a3232078939beb5c2bd6cf05a9d6e1be1fd9bb7bd09e49594aac4fa3b0" exitCode=0
Sep 07 14:18:04.554947 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:18:04.554599    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp" event={"ID":"4d174c73-1434-4906-a92c-7db4b9cf0bdf","Type":"ContainerDied","Data":"dc9176a3232078939beb5c2bd6cf05a9d6e1be1fd9bb7bd09e49594aac4fa3b0"}
Sep 07 14:18:05.560799 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:18:05.560763    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp" event={"ID":"4d174c73-1434-4906-a92c-7db4b9cf0bdf","Type":"ContainerStarted","Data":"827543bd9e667991a6803d48048f1001fc30225658354a7d0b0da9dcf23e1299"}
Sep 07 14:18:12.591603 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:18:12.591562    2581 generic.go:356] "Generic (PLEG): container finished" podID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerID="827543bd9e667991a6803d48048f1001fc30225658354a7d0b0da9dcf23e1299" exitCode=0
Sep 07 14:18:12.591979 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:18:12.591633    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp" event={"ID":"4d174c73-1434-4906-a92c-7db4b9cf0bdf","Type":"ContainerDied","Data":"827543bd9e667991a6803d48048f1001fc30225658354a7d0b0da9dcf23e1299"}
Sep 07 14:18:13.598364 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:18:13.598321    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp" event={"ID":"4d174c73-1434-4906-a92c-7db4b9cf0bdf","Type":"ContainerStarted","Data":"51c01b8d5c81c5e3a41f60c27669ea1db2e1aeab138b3ac3d87e16c09352bd1e"}
Sep 07 14:18:13.598741 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:18:13.598400    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp" event={"ID":"4d174c73-1434-4906-a92c-7db4b9cf0bdf","Type":"ContainerStarted","Data":"52d1a8f3024f15c72d08e9b1d3325971c196b99eac320d4af7a382dd64348b73"}
Sep 07 14:18:13.628249 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:18:13.628193    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp" podStartSLOduration=15.628176555 podStartE2EDuration="15.628176555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 14:17:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 14:18:13.624922567 +0000 UTC m=+1234.625350974" watchObservedRunningTime="2026-09-07 14:18:13.628176555 +0000 UTC m=+1234.628604947"
Sep 07 14:18:16.511969 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:18:16.511928    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:18:16.512388 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:18:16.511995    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:18:16.513500 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:18:16.513469    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp" podUID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Sep 07 14:18:16.513638 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:18:16.513473    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp" podUID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Sep 07 14:18:18.511808 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:18:18.511760    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:18:18.512189 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:18:18.511852    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:18:19.511754 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:18:19.511706    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp" podUID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Sep 07 14:18:19.526953 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:18:19.526096    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:18:19.532144 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:18:19.532117    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:18:22.512064 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:18:22.512009    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp" podUID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Sep 07 14:18:25.511940 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:18:25.511907    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:18:25.512653 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:18:25.512634    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:19:47.161911 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:47.161876    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-695d6b979d-b75z5"]
Sep 07 14:19:47.162422 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:47.162076    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-695d6b979d-b75z5" podUID="f7e6fcdd-a98e-4637-990c-1f82d694eeb0" containerName="manager" containerID="cri-o://abf2cde22d515884d76eabe8e982c610aa345849a02288526a3a5547cea78b55" gracePeriod=10
Sep 07 14:19:47.414893 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:47.414829    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-695d6b979d-b75z5"
Sep 07 14:19:47.504144 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:47.504109    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7b45\" (UniqueName: \"kubernetes.io/projected/f7e6fcdd-a98e-4637-990c-1f82d694eeb0-kube-api-access-r7b45\") pod \"f7e6fcdd-a98e-4637-990c-1f82d694eeb0\" (UID: \"f7e6fcdd-a98e-4637-990c-1f82d694eeb0\") "
Sep 07 14:19:47.507955 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:47.507923    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7e6fcdd-a98e-4637-990c-1f82d694eeb0-kube-api-access-r7b45" (OuterVolumeSpecName: "kube-api-access-r7b45") pod "f7e6fcdd-a98e-4637-990c-1f82d694eeb0" (UID: "f7e6fcdd-a98e-4637-990c-1f82d694eeb0"). InnerVolumeSpecName "kube-api-access-r7b45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 14:19:47.605414 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:47.605380    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7b45\" (UniqueName: \"kubernetes.io/projected/f7e6fcdd-a98e-4637-990c-1f82d694eeb0-kube-api-access-r7b45\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:19:47.665101 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:47.665013    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"]
Sep 07 14:19:47.665255 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:47.665220    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerName="registry" containerID="cri-o://3d3c29098209b9dbe7e6f46b6c3df676fb948570b6225bbe0ea636244f9f34e2" gracePeriod=30
Sep 07 14:19:47.665336 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:47.665274    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerName="online" containerID="cri-o://051a0d7ca0fcd180985b9cd84c2fdcbc3e560af8cff55a438f9deebf26ed2851" gracePeriod=30
Sep 07 14:19:47.678010 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:47.677975    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"]
Sep 07 14:19:47.678206 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:47.678183    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp" podUID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerName="registry" containerID="cri-o://52d1a8f3024f15c72d08e9b1d3325971c196b99eac320d4af7a382dd64348b73" gracePeriod=30
Sep 07 14:19:47.678266 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:47.678225    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp" podUID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerName="online" containerID="cri-o://51c01b8d5c81c5e3a41f60c27669ea1db2e1aeab138b3ac3d87e16c09352bd1e" gracePeriod=30
Sep 07 14:19:48.011050 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:48.010958    2581 generic.go:356] "Generic (PLEG): container finished" podID="f7e6fcdd-a98e-4637-990c-1f82d694eeb0" containerID="abf2cde22d515884d76eabe8e982c610aa345849a02288526a3a5547cea78b55" exitCode=0
Sep 07 14:19:48.011050 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:48.011016    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-695d6b979d-b75z5"
Sep 07 14:19:48.011236 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:48.011056    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-695d6b979d-b75z5" event={"ID":"f7e6fcdd-a98e-4637-990c-1f82d694eeb0","Type":"ContainerDied","Data":"abf2cde22d515884d76eabe8e982c610aa345849a02288526a3a5547cea78b55"}
Sep 07 14:19:48.011236 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:48.011126    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-695d6b979d-b75z5" event={"ID":"f7e6fcdd-a98e-4637-990c-1f82d694eeb0","Type":"ContainerDied","Data":"575387d549655fe763512524f8c5a163db7e8fa0bf6bee7db0ecd1f4b78f978b"}
Sep 07 14:19:48.011236 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:48.011160    2581 scope.go:117] "RemoveContainer" containerID="abf2cde22d515884d76eabe8e982c610aa345849a02288526a3a5547cea78b55"
Sep 07 14:19:48.020903 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:48.020879    2581 scope.go:117] "RemoveContainer" containerID="abf2cde22d515884d76eabe8e982c610aa345849a02288526a3a5547cea78b55"
Sep 07 14:19:48.021263 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:19:48.021236    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abf2cde22d515884d76eabe8e982c610aa345849a02288526a3a5547cea78b55\": container with ID starting with abf2cde22d515884d76eabe8e982c610aa345849a02288526a3a5547cea78b55 not found: ID does not exist" containerID="abf2cde22d515884d76eabe8e982c610aa345849a02288526a3a5547cea78b55"
Sep 07 14:19:48.021378 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:48.021275    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abf2cde22d515884d76eabe8e982c610aa345849a02288526a3a5547cea78b55"} err="failed to get container status \"abf2cde22d515884d76eabe8e982c610aa345849a02288526a3a5547cea78b55\": rpc error: code = NotFound desc = could not find container \"abf2cde22d515884d76eabe8e982c610aa345849a02288526a3a5547cea78b55\": container with ID starting with abf2cde22d515884d76eabe8e982c610aa345849a02288526a3a5547cea78b55 not found: ID does not exist"
Sep 07 14:19:48.040220 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:48.040185    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-695d6b979d-b75z5"]
Sep 07 14:19:48.052138 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:48.052108    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-695d6b979d-b75z5"]
Sep 07 14:19:49.018919 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:49.018885    2581 generic.go:356] "Generic (PLEG): container finished" podID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerID="51c01b8d5c81c5e3a41f60c27669ea1db2e1aeab138b3ac3d87e16c09352bd1e" exitCode=0
Sep 07 14:19:49.019345 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:49.018955    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp" event={"ID":"4d174c73-1434-4906-a92c-7db4b9cf0bdf","Type":"ContainerDied","Data":"51c01b8d5c81c5e3a41f60c27669ea1db2e1aeab138b3ac3d87e16c09352bd1e"}
Sep 07 14:19:49.022136 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:49.022112    2581 generic.go:356] "Generic (PLEG): container finished" podID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerID="051a0d7ca0fcd180985b9cd84c2fdcbc3e560af8cff55a438f9deebf26ed2851" exitCode=0
Sep 07 14:19:49.022249 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:49.022151    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" event={"ID":"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12","Type":"ContainerDied","Data":"051a0d7ca0fcd180985b9cd84c2fdcbc3e560af8cff55a438f9deebf26ed2851"}
Sep 07 14:19:49.523858 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:49.523825    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7e6fcdd-a98e-4637-990c-1f82d694eeb0" path="/var/lib/kubelet/pods/f7e6fcdd-a98e-4637-990c-1f82d694eeb0/volumes"
Sep 07 14:19:49.527419 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:49.527385    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp" podUID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Sep 07 14:19:49.550470 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:49.550439    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-h7j6k"]
Sep 07 14:19:49.550627 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:49.550607    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-h7j6k" podUID="a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d" containerName="postgres" containerID="cri-o://e59571539483e32f1636df4304578b002e0e10a5cf4cb8eb2e19fb0c1d2690c3" gracePeriod=30
Sep 07 14:19:49.558948 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:49.558914    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-6ms8v"]
Sep 07 14:19:49.559267 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:49.559114    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-6ms8v" podUID="c978bb8e-82de-4819-8cda-d3cddaa61112" containerName="redis" containerID="cri-o://db486bae2ee66728a1b30324c97098c8243c94dcb067279c8fdbabbf73c0d711" gracePeriod=30
Sep 07 14:19:49.792298 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:49.792253    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-h7j6k"
Sep 07 14:19:49.820172 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:49.820141    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-6ms8v"
Sep 07 14:19:49.924617 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:49.924588    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjbgc\" (UniqueName: \"kubernetes.io/projected/c978bb8e-82de-4819-8cda-d3cddaa61112-kube-api-access-pjbgc\") pod \"c978bb8e-82de-4819-8cda-d3cddaa61112\" (UID: \"c978bb8e-82de-4819-8cda-d3cddaa61112\") "
Sep 07 14:19:49.924813 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:49.924625    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvnc9\" (UniqueName: \"kubernetes.io/projected/a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d-kube-api-access-lvnc9\") pod \"a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d\" (UID: \"a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d\") "
Sep 07 14:19:49.924813 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:49.924732    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d-postgresdata\") pod \"a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d\" (UID: \"a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d\") "
Sep 07 14:19:49.926792 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:49.926763    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d-kube-api-access-lvnc9" (OuterVolumeSpecName: "kube-api-access-lvnc9") pod "a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d" (UID: "a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d"). InnerVolumeSpecName "kube-api-access-lvnc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 14:19:49.926899 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:49.926784    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c978bb8e-82de-4819-8cda-d3cddaa61112-kube-api-access-pjbgc" (OuterVolumeSpecName: "kube-api-access-pjbgc") pod "c978bb8e-82de-4819-8cda-d3cddaa61112" (UID: "c978bb8e-82de-4819-8cda-d3cddaa61112"). InnerVolumeSpecName "kube-api-access-pjbgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 14:19:49.955345 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:49.955304    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d" (UID: "a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 14:19:50.025334 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.025234    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjbgc\" (UniqueName: \"kubernetes.io/projected/c978bb8e-82de-4819-8cda-d3cddaa61112-kube-api-access-pjbgc\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:19:50.025334 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.025262    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvnc9\" (UniqueName: \"kubernetes.io/projected/a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d-kube-api-access-lvnc9\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:19:50.025334 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.025271    2581 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d-postgresdata\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:19:50.027138 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.027109    2581 generic.go:356] "Generic (PLEG): container finished" podID="c978bb8e-82de-4819-8cda-d3cddaa61112" containerID="db486bae2ee66728a1b30324c97098c8243c94dcb067279c8fdbabbf73c0d711" exitCode=0
Sep 07 14:19:50.027218 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.027152    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-6ms8v"
Sep 07 14:19:50.027218 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.027201    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-6ms8v" event={"ID":"c978bb8e-82de-4819-8cda-d3cddaa61112","Type":"ContainerDied","Data":"db486bae2ee66728a1b30324c97098c8243c94dcb067279c8fdbabbf73c0d711"}
Sep 07 14:19:50.027320 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.027244    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-6ms8v" event={"ID":"c978bb8e-82de-4819-8cda-d3cddaa61112","Type":"ContainerDied","Data":"a947b20229193bdfaaa6be1489173c4c5bf623d2a8aafda7416ea6daba5b598c"}
Sep 07 14:19:50.027320 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.027262    2581 scope.go:117] "RemoveContainer" containerID="db486bae2ee66728a1b30324c97098c8243c94dcb067279c8fdbabbf73c0d711"
Sep 07 14:19:50.028448 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.028428    2581 generic.go:356] "Generic (PLEG): container finished" podID="a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d" containerID="e59571539483e32f1636df4304578b002e0e10a5cf4cb8eb2e19fb0c1d2690c3" exitCode=0
Sep 07 14:19:50.028519 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.028456    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-h7j6k"
Sep 07 14:19:50.028519 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.028498    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-h7j6k" event={"ID":"a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d","Type":"ContainerDied","Data":"e59571539483e32f1636df4304578b002e0e10a5cf4cb8eb2e19fb0c1d2690c3"}
Sep 07 14:19:50.028630 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.028526    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-h7j6k" event={"ID":"a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d","Type":"ContainerDied","Data":"38cae6f29a1143b249c62c69826e07d6522517b391a2346f4568d98398a93dfb"}
Sep 07 14:19:50.035913 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.035894    2581 scope.go:117] "RemoveContainer" containerID="db486bae2ee66728a1b30324c97098c8243c94dcb067279c8fdbabbf73c0d711"
Sep 07 14:19:50.036211 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:19:50.036192    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db486bae2ee66728a1b30324c97098c8243c94dcb067279c8fdbabbf73c0d711\": container with ID starting with db486bae2ee66728a1b30324c97098c8243c94dcb067279c8fdbabbf73c0d711 not found: ID does not exist" containerID="db486bae2ee66728a1b30324c97098c8243c94dcb067279c8fdbabbf73c0d711"
Sep 07 14:19:50.036274 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.036222    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db486bae2ee66728a1b30324c97098c8243c94dcb067279c8fdbabbf73c0d711"} err="failed to get container status \"db486bae2ee66728a1b30324c97098c8243c94dcb067279c8fdbabbf73c0d711\": rpc error: code = NotFound desc = could not find container \"db486bae2ee66728a1b30324c97098c8243c94dcb067279c8fdbabbf73c0d711\": container with ID starting with db486bae2ee66728a1b30324c97098c8243c94dcb067279c8fdbabbf73c0d711 not found: ID does not exist"
Sep 07 14:19:50.036274 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.036246    2581 scope.go:117] "RemoveContainer" containerID="e59571539483e32f1636df4304578b002e0e10a5cf4cb8eb2e19fb0c1d2690c3"
Sep 07 14:19:50.043723 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.043700    2581 scope.go:117] "RemoveContainer" containerID="e59571539483e32f1636df4304578b002e0e10a5cf4cb8eb2e19fb0c1d2690c3"
Sep 07 14:19:50.043965 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:19:50.043944    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e59571539483e32f1636df4304578b002e0e10a5cf4cb8eb2e19fb0c1d2690c3\": container with ID starting with e59571539483e32f1636df4304578b002e0e10a5cf4cb8eb2e19fb0c1d2690c3 not found: ID does not exist" containerID="e59571539483e32f1636df4304578b002e0e10a5cf4cb8eb2e19fb0c1d2690c3"
Sep 07 14:19:50.044020 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.043972    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e59571539483e32f1636df4304578b002e0e10a5cf4cb8eb2e19fb0c1d2690c3"} err="failed to get container status \"e59571539483e32f1636df4304578b002e0e10a5cf4cb8eb2e19fb0c1d2690c3\": rpc error: code = NotFound desc = could not find container \"e59571539483e32f1636df4304578b002e0e10a5cf4cb8eb2e19fb0c1d2690c3\": container with ID starting with e59571539483e32f1636df4304578b002e0e10a5cf4cb8eb2e19fb0c1d2690c3 not found: ID does not exist"
Sep 07 14:19:50.053906 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.053874    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-h7j6k"]
Sep 07 14:19:50.061273 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.061244    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-h7j6k"]
Sep 07 14:19:50.076038 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.076011    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-6ms8v"]
Sep 07 14:19:50.083940 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.083911    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-6ms8v"]
Sep 07 14:19:50.810276 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:50.810230    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 07 14:19:51.520073 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:51.520038    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d" path="/var/lib/kubelet/pods/a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d/volumes"
Sep 07 14:19:51.520476 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:51.520382    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c978bb8e-82de-4819-8cda-d3cddaa61112" path="/var/lib/kubelet/pods/c978bb8e-82de-4819-8cda-d3cddaa61112/volumes"
Sep 07 14:19:59.528169 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:19:59.528131    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp" podUID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Sep 07 14:20:00.810637 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:00.810590    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 07 14:20:09.527833 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:09.527747    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp" podUID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Sep 07 14:20:09.528180 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:09.527879    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:20:10.810513 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:10.810466    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 07 14:20:10.811072 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:10.810619    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:20:18.146814 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.146779    2581 generic.go:356] "Generic (PLEG): container finished" podID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerID="3d3c29098209b9dbe7e6f46b6c3df676fb948570b6225bbe0ea636244f9f34e2" exitCode=137
Sep 07 14:20:18.147305 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.146852    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" event={"ID":"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12","Type":"ContainerDied","Data":"3d3c29098209b9dbe7e6f46b6c3df676fb948570b6225bbe0ea636244f9f34e2"}
Sep 07 14:20:18.149179 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.149151    2581 generic.go:356] "Generic (PLEG): container finished" podID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerID="52d1a8f3024f15c72d08e9b1d3325971c196b99eac320d4af7a382dd64348b73" exitCode=137
Sep 07 14:20:18.149320 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.149185    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp" event={"ID":"4d174c73-1434-4906-a92c-7db4b9cf0bdf","Type":"ContainerDied","Data":"52d1a8f3024f15c72d08e9b1d3325971c196b99eac320d4af7a382dd64348b73"}
Sep 07 14:20:18.339099 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.339073    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:20:18.341630 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.341613    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:20:18.433505 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.433418    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4d174c73-1434-4906-a92c-7db4b9cf0bdf-online-tls\") pod \"4d174c73-1434-4906-a92c-7db4b9cf0bdf\" (UID: \"4d174c73-1434-4906-a92c-7db4b9cf0bdf\") "
Sep 07 14:20:18.433505 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.433460    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4d174c73-1434-4906-a92c-7db4b9cf0bdf-registry-tls\") pod \"4d174c73-1434-4906-a92c-7db4b9cf0bdf\" (UID: \"4d174c73-1434-4906-a92c-7db4b9cf0bdf\") "
Sep 07 14:20:18.433505 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.433485    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-feast-data\") pod \"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12\" (UID: \"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12\") "
Sep 07 14:20:18.433771 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.433520    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4d174c73-1434-4906-a92c-7db4b9cf0bdf-feast-data\") pod \"4d174c73-1434-4906-a92c-7db4b9cf0bdf\" (UID: \"4d174c73-1434-4906-a92c-7db4b9cf0bdf\") "
Sep 07 14:20:18.433771 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.433553    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-registry-tls\") pod \"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12\" (UID: \"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12\") "
Sep 07 14:20:18.433771 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.433580    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-online-tls\") pod \"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12\" (UID: \"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12\") "
Sep 07 14:20:18.433771 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.433608    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghsmg\" (UniqueName: \"kubernetes.io/projected/4d174c73-1434-4906-a92c-7db4b9cf0bdf-kube-api-access-ghsmg\") pod \"4d174c73-1434-4906-a92c-7db4b9cf0bdf\" (UID: \"4d174c73-1434-4906-a92c-7db4b9cf0bdf\") "
Sep 07 14:20:18.434053 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.433782    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtn94\" (UniqueName: \"kubernetes.io/projected/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-kube-api-access-mtn94\") pod \"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12\" (UID: \"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12\") "
Sep 07 14:20:18.434111 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.434047    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d174c73-1434-4906-a92c-7db4b9cf0bdf-feast-data" (OuterVolumeSpecName: "feast-data") pod "4d174c73-1434-4906-a92c-7db4b9cf0bdf" (UID: "4d174c73-1434-4906-a92c-7db4b9cf0bdf"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 14:20:18.436007 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.435977    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-online-tls" (OuterVolumeSpecName: "online-tls") pod "58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" (UID: "58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:20:18.436244 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.436181    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d174c73-1434-4906-a92c-7db4b9cf0bdf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4d174c73-1434-4906-a92c-7db4b9cf0bdf" (UID: "4d174c73-1434-4906-a92c-7db4b9cf0bdf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:20:18.436244 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.436220    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" (UID: "58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:20:18.436436 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.436304    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d174c73-1434-4906-a92c-7db4b9cf0bdf-online-tls" (OuterVolumeSpecName: "online-tls") pod "4d174c73-1434-4906-a92c-7db4b9cf0bdf" (UID: "4d174c73-1434-4906-a92c-7db4b9cf0bdf"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:20:18.436436 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.436330    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d174c73-1434-4906-a92c-7db4b9cf0bdf-kube-api-access-ghsmg" (OuterVolumeSpecName: "kube-api-access-ghsmg") pod "4d174c73-1434-4906-a92c-7db4b9cf0bdf" (UID: "4d174c73-1434-4906-a92c-7db4b9cf0bdf"). InnerVolumeSpecName "kube-api-access-ghsmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 14:20:18.436613 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.436595    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-kube-api-access-mtn94" (OuterVolumeSpecName: "kube-api-access-mtn94") pod "58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" (UID: "58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12"). InnerVolumeSpecName "kube-api-access-mtn94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 14:20:18.443500 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.443473    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-feast-data" (OuterVolumeSpecName: "feast-data") pod "58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" (UID: "58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 14:20:18.535349 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.535280    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-registry-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:20:18.535349 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.535342    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-online-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:20:18.535349 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.535351    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghsmg\" (UniqueName: \"kubernetes.io/projected/4d174c73-1434-4906-a92c-7db4b9cf0bdf-kube-api-access-ghsmg\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:20:18.535349 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.535359    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtn94\" (UniqueName: \"kubernetes.io/projected/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-kube-api-access-mtn94\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:20:18.535612 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.535369    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4d174c73-1434-4906-a92c-7db4b9cf0bdf-online-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:20:18.535612 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.535377    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4d174c73-1434-4906-a92c-7db4b9cf0bdf-registry-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:20:18.535612 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.535385    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12-feast-data\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:20:18.535612 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:18.535392    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4d174c73-1434-4906-a92c-7db4b9cf0bdf-feast-data\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:20:19.155009 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:19.154977    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"
Sep 07 14:20:19.155009 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:19.154993    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n" event={"ID":"58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12","Type":"ContainerDied","Data":"93ec3c9b767b4ea9cfd422b314c1651d6f5899dfdf9da5bd06bf42b3ce1b1f9c"}
Sep 07 14:20:19.155546 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:19.155055    2581 scope.go:117] "RemoveContainer" containerID="051a0d7ca0fcd180985b9cd84c2fdcbc3e560af8cff55a438f9deebf26ed2851"
Sep 07 14:20:19.157558 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:19.157535    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp" event={"ID":"4d174c73-1434-4906-a92c-7db4b9cf0bdf","Type":"ContainerDied","Data":"9011bc6d1b1a2ded90ca5b96f81ce6569aaf2d2ba36ec2248d79c2c8504b83f9"}
Sep 07 14:20:19.157667 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:19.157565    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"
Sep 07 14:20:19.164605 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:19.164436    2581 scope.go:117] "RemoveContainer" containerID="3d3c29098209b9dbe7e6f46b6c3df676fb948570b6225bbe0ea636244f9f34e2"
Sep 07 14:20:19.176541 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:19.176519    2581 scope.go:117] "RemoveContainer" containerID="c32f06e6952f1d0b3c8941bc7fc63bb5db01916aa9376a061a8335fb8b0c0667"
Sep 07 14:20:19.183960 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:19.183941    2581 scope.go:117] "RemoveContainer" containerID="ecf0527f0deebebc8c6eff8c5e197613046f87d8a5d4440c6e498afb3db4676e"
Sep 07 14:20:19.188744 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:19.188721    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"]
Sep 07 14:20:19.191490 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:19.191460    2581 scope.go:117] "RemoveContainer" containerID="51c01b8d5c81c5e3a41f60c27669ea1db2e1aeab138b3ac3d87e16c09352bd1e"
Sep 07 14:20:19.195874 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:19.195852    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69dc88fd85-xnj7n"]
Sep 07 14:20:19.198952 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:19.198933    2581 scope.go:117] "RemoveContainer" containerID="52d1a8f3024f15c72d08e9b1d3325971c196b99eac320d4af7a382dd64348b73"
Sep 07 14:20:19.206187 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:19.206171    2581 scope.go:117] "RemoveContainer" containerID="827543bd9e667991a6803d48048f1001fc30225658354a7d0b0da9dcf23e1299"
Sep 07 14:20:19.211084 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:19.211062    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"]
Sep 07 14:20:19.213795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:19.213777    2581 scope.go:117] "RemoveContainer" containerID="dc9176a3232078939beb5c2bd6cf05a9d6e1be1fd9bb7bd09e49594aac4fa3b0"
Sep 07 14:20:19.216521 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:19.216501    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5f6c998ccd-vwpxp"]
Sep 07 14:20:19.518693 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:19.518615    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" path="/var/lib/kubelet/pods/4d174c73-1434-4906-a92c-7db4b9cf0bdf/volumes"
Sep 07 14:20:19.519100 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:19.519087    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" path="/var/lib/kubelet/pods/58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12/volumes"
Sep 07 14:20:57.036265 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036228    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"]
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036525    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerName="online"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036537    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerName="online"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036548    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7e6fcdd-a98e-4637-990c-1f82d694eeb0" containerName="manager"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036553    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7e6fcdd-a98e-4637-990c-1f82d694eeb0" containerName="manager"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036562    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d" containerName="postgres"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036568    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d" containerName="postgres"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036577    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerName="feast-init"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036582    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerName="feast-init"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036588    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerName="feast-apply"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036593    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerName="feast-apply"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036598    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerName="registry"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036603    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerName="registry"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036609    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c978bb8e-82de-4819-8cda-d3cddaa61112" containerName="redis"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036614    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c978bb8e-82de-4819-8cda-d3cddaa61112" containerName="redis"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036619    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerName="online"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036623    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerName="online"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036630    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerName="feast-init"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036635    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerName="feast-init"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036646    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerName="feast-apply"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036651    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerName="feast-apply"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036658    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerName="registry"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036664    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerName="registry"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036708    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerName="registry"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036716    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0c10d4e-8397-421f-8fe9-c58a9f4d1e3d" containerName="postgres"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036722    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerName="registry"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036729    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7e6fcdd-a98e-4637-990c-1f82d694eeb0" containerName="manager"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036734    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d174c73-1434-4906-a92c-7db4b9cf0bdf" containerName="online"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036739    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="58ed4e59-a6bf-4d8a-b4ff-cba03ece8b12" containerName="online"
Sep 07 14:20:57.036795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.036744    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c978bb8e-82de-4819-8cda-d3cddaa61112" containerName="redis"
Sep 07 14:20:57.041489 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.041471    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:20:57.043950 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.043921    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 07 14:20:57.044150 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.044138    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 07 14:20:57.044913 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.044891    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 07 14:20:57.045010 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.044914    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 07 14:20:57.045010 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.044933    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 07 14:20:57.045010 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.044898    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 07 14:20:57.045010 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.044894    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-d5pj5\""
Sep 07 14:20:57.058765 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.058742    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"]
Sep 07 14:20:57.138552 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.138518    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlvqk\" (UniqueName: \"kubernetes.io/projected/9bab10d3-6194-4932-8988-ad40fcc5a3a5-kube-api-access-jlvqk\") pod \"feast-simple-feast-setup-57576b8fcf-xvjxs\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:20:57.138707 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.138556    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xvjxs\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:20:57.138707 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.138620    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xvjxs\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:20:57.138707 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.138659    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xvjxs\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:20:57.138707 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.138687    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xvjxs\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:20:57.138847 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.138787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9bab10d3-6194-4932-8988-ad40fcc5a3a5-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-xvjxs\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:20:57.239911 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.239874    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xvjxs\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:20:57.239911 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.239913    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xvjxs\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:20:57.240136 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.239944    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xvjxs\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:20:57.240136 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.240005    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9bab10d3-6194-4932-8988-ad40fcc5a3a5-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-xvjxs\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:20:57.240136 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:20:57.240021    2581 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Sep 07 14:20:57.240136 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.240044    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlvqk\" (UniqueName: \"kubernetes.io/projected/9bab10d3-6194-4932-8988-ad40fcc5a3a5-kube-api-access-jlvqk\") pod \"feast-simple-feast-setup-57576b8fcf-xvjxs\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:20:57.240136 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.240077    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xvjxs\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:20:57.240136 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:20:57.240092    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-offline-tls podName:9bab10d3-6194-4932-8988-ad40fcc5a3a5 nodeName:}" failed. No retries permitted until 2026-09-07 14:20:57.740074876 +0000 UTC m=+1398.740503247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-offline-tls") pod "feast-simple-feast-setup-57576b8fcf-xvjxs" (UID: "9bab10d3-6194-4932-8988-ad40fcc5a3a5") : secret "feast-simple-feast-setup-offline-tls" not found
Sep 07 14:20:57.240503 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.240481    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9bab10d3-6194-4932-8988-ad40fcc5a3a5-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-xvjxs\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:20:57.242533 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.242511    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xvjxs\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:20:57.242675 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.242655    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xvjxs\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:20:57.242727 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.242673    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xvjxs\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:20:57.263888 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.263864    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlvqk\" (UniqueName: \"kubernetes.io/projected/9bab10d3-6194-4932-8988-ad40fcc5a3a5-kube-api-access-jlvqk\") pod \"feast-simple-feast-setup-57576b8fcf-xvjxs\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:20:57.744669 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.744634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xvjxs\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:20:57.747104 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.747078    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xvjxs\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:20:57.966947 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:57.966906    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:20:58.251309 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:58.251237    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"]
Sep 07 14:20:58.253488 ip-10-0-139-134 kubenswrapper[2581]: W0907 14:20:58.253457    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bab10d3_6194_4932_8988_ad40fcc5a3a5.slice/crio-9bcd3c797ff710e7bbe7baa25ddb48df5669ac46fb73528af83007c4ca21aded WatchSource:0}: Error finding container 9bcd3c797ff710e7bbe7baa25ddb48df5669ac46fb73528af83007c4ca21aded: Status 404 returned error can't find the container with id 9bcd3c797ff710e7bbe7baa25ddb48df5669ac46fb73528af83007c4ca21aded
Sep 07 14:20:58.255361 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:58.255341    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 14:20:58.313440 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:20:58.313363    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" event={"ID":"9bab10d3-6194-4932-8988-ad40fcc5a3a5","Type":"ContainerStarted","Data":"9bcd3c797ff710e7bbe7baa25ddb48df5669ac46fb73528af83007c4ca21aded"}
Sep 07 14:21:11.383067 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:11.383030    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" event={"ID":"9bab10d3-6194-4932-8988-ad40fcc5a3a5","Type":"ContainerStarted","Data":"827e586677501eb30884bcea16e1765ef85a0f6dc721df0216d80d2626196eda"}
Sep 07 14:21:16.403523 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:16.403485    2581 generic.go:356] "Generic (PLEG): container finished" podID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerID="827e586677501eb30884bcea16e1765ef85a0f6dc721df0216d80d2626196eda" exitCode=0
Sep 07 14:21:16.403955 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:16.403558    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" event={"ID":"9bab10d3-6194-4932-8988-ad40fcc5a3a5","Type":"ContainerDied","Data":"827e586677501eb30884bcea16e1765ef85a0f6dc721df0216d80d2626196eda"}
Sep 07 14:21:17.410170 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:17.410124    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" event={"ID":"9bab10d3-6194-4932-8988-ad40fcc5a3a5","Type":"ContainerStarted","Data":"3c0d994c17e1d76a3d5b6570ad29e2a03f236a9bb19ba33dc3c7ae6296894352"}
Sep 07 14:21:23.435975 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:23.435937    2581 generic.go:356] "Generic (PLEG): container finished" podID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerID="3c0d994c17e1d76a3d5b6570ad29e2a03f236a9bb19ba33dc3c7ae6296894352" exitCode=0
Sep 07 14:21:23.436483 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:23.436016    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" event={"ID":"9bab10d3-6194-4932-8988-ad40fcc5a3a5","Type":"ContainerDied","Data":"3c0d994c17e1d76a3d5b6570ad29e2a03f236a9bb19ba33dc3c7ae6296894352"}
Sep 07 14:21:24.446276 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:24.446232    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" event={"ID":"9bab10d3-6194-4932-8988-ad40fcc5a3a5","Type":"ContainerStarted","Data":"fd80946f4c7279f551083f404f334ea94a8344a1f09d0608ee0578680538d0bd"}
Sep 07 14:21:24.446774 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:24.446318    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" event={"ID":"9bab10d3-6194-4932-8988-ad40fcc5a3a5","Type":"ContainerStarted","Data":"2f3e3096e94f4f83c353815d69dee456979ed903cd295e502e5850f615b1fee4"}
Sep 07 14:21:24.446774 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:24.446340    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" event={"ID":"9bab10d3-6194-4932-8988-ad40fcc5a3a5","Type":"ContainerStarted","Data":"27a116e6cb3de0dd2f7fb4f7b82649a964b2ea2420dfbffc43bb9181dc261b7b"}
Sep 07 14:21:24.446774 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:24.446360    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" event={"ID":"9bab10d3-6194-4932-8988-ad40fcc5a3a5","Type":"ContainerStarted","Data":"5e3b2d6906b9aa99e92c7cb5f2d72c5455c42225f4a28841c537982301539dc1"}
Sep 07 14:21:24.473028 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:24.472955    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podStartSLOduration=14.587017243 podStartE2EDuration="27.472933834s" totalImagesPullingTime="12.885916591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 14:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 14:21:24.472500122 +0000 UTC m=+1425.472928531" watchObservedRunningTime="2026-09-07 14:21:24.472933834 +0000 UTC m=+1425.473362228"
Sep 07 14:21:24.968076 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:24.968038    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:21:24.968272 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:24.968105    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:21:24.968272 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:24.968128    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:21:24.968272 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:24.968145    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:21:24.970427 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:24.970379    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.35:8816: connect: connection refused"
Sep 07 14:21:24.970582 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:24.970390    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Sep 07 14:21:24.970582 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:24.970378    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Sep 07 14:21:24.970789 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:24.970754    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused"
Sep 07 14:21:27.967084 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:27.967042    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:21:27.967728 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:27.967701    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:21:27.967815 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:27.967759    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:21:27.967815 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:27.967783    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:21:27.967815 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:27.967474    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.35:8816: connect: connection refused"
Sep 07 14:21:27.967815 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:27.967353    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Sep 07 14:21:27.968042 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:27.967338    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Sep 07 14:21:27.968201 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:27.967277    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused"
Sep 07 14:21:30.968161 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:30.968113    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused"
Sep 07 14:21:30.968901 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:30.968113    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.35:8816: connect: connection refused"
Sep 07 14:21:30.968901 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:30.968131    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Sep 07 14:21:30.969096 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:30.968344    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Sep 07 14:21:33.968486 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:33.968447    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:21:33.969084 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:33.968650    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:21:33.969084 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:33.969003    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:21:33.969432 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:33.969416    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:21:33.969506 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:33.969493    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:21:33.969548 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:33.969538    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:21:33.974429 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:33.974413    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:21:34.500450 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:21:34.500423    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:22:36.831237 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:36.831204    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"]
Sep 07 14:22:36.832492 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:36.832442    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="ui" containerID="cri-o://fd80946f4c7279f551083f404f334ea94a8344a1f09d0608ee0578680538d0bd" gracePeriod=30
Sep 07 14:22:36.832881 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:36.832834    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="registry" containerID="cri-o://5e3b2d6906b9aa99e92c7cb5f2d72c5455c42225f4a28841c537982301539dc1" gracePeriod=30
Sep 07 14:22:36.833650 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:36.832893    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="offline" containerID="cri-o://2f3e3096e94f4f83c353815d69dee456979ed903cd295e502e5850f615b1fee4" gracePeriod=30
Sep 07 14:22:36.833848 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:36.833814    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="online" containerID="cri-o://27a116e6cb3de0dd2f7fb4f7b82649a964b2ea2420dfbffc43bb9181dc261b7b" gracePeriod=30
Sep 07 14:22:37.323585 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.323536    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"]
Sep 07 14:22:37.328312 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.328256    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:37.330807 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.330777    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-29w4z\""
Sep 07 14:22:37.338916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.338890    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"]
Sep 07 14:22:37.440932 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.440891    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t4d58\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:37.441130 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.440936    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6vqn\" (UniqueName: \"kubernetes.io/projected/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-kube-api-access-j6vqn\") pod \"feast-simple-feast-setup-57576b8fcf-t4d58\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:37.441130 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.441016    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-t4d58\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:37.441130 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.441122    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t4d58\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:37.441331 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.441221    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t4d58\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:37.441331 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.441275    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t4d58\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:37.541968 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.541933    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t4d58\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:37.542116 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.541979    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t4d58\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:37.542116 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.542013    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t4d58\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:37.542116 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.542035    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6vqn\" (UniqueName: \"kubernetes.io/projected/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-kube-api-access-j6vqn\") pod \"feast-simple-feast-setup-57576b8fcf-t4d58\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:37.542116 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.542068    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-t4d58\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:37.542116 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.542108    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t4d58\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:37.542409 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:22:37.542132    2581 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Sep 07 14:22:37.542409 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:22:37.542203    2581 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Sep 07 14:22:37.542409 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:22:37.542207    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-registry-tls podName:acaa9cd0-bd39-4b66-8f47-3a485f2ad86d nodeName:}" failed. No retries permitted until 2026-09-07 14:22:38.042184558 +0000 UTC m=+1499.042612944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-t4d58" (UID: "acaa9cd0-bd39-4b66-8f47-3a485f2ad86d") : secret "feast-simple-feast-setup-registry-tls" not found
Sep 07 14:22:37.542409 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:22:37.542373    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-offline-tls podName:acaa9cd0-bd39-4b66-8f47-3a485f2ad86d nodeName:}" failed. No retries permitted until 2026-09-07 14:22:38.042343502 +0000 UTC m=+1499.042771880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-offline-tls") pod "feast-simple-feast-setup-57576b8fcf-t4d58" (UID: "acaa9cd0-bd39-4b66-8f47-3a485f2ad86d") : secret "feast-simple-feast-setup-offline-tls" not found
Sep 07 14:22:37.542609 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.542564    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-t4d58\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:37.544699 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.544667    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t4d58\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:37.544809 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.544749    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t4d58\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:37.555485 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.555457    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6vqn\" (UniqueName: \"kubernetes.io/projected/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-kube-api-access-j6vqn\") pod \"feast-simple-feast-setup-57576b8fcf-t4d58\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:37.742885 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.742853    2581 generic.go:356] "Generic (PLEG): container finished" podID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerID="fd80946f4c7279f551083f404f334ea94a8344a1f09d0608ee0578680538d0bd" exitCode=0
Sep 07 14:22:37.743087 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:37.742903    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" event={"ID":"9bab10d3-6194-4932-8988-ad40fcc5a3a5","Type":"ContainerDied","Data":"fd80946f4c7279f551083f404f334ea94a8344a1f09d0608ee0578680538d0bd"}
Sep 07 14:22:38.047719 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:38.047638    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t4d58\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:38.047719 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:38.047697    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t4d58\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:38.050086 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:38.050055    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t4d58\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:38.050195 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:38.050132    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t4d58\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:38.239033 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:38.238993    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:38.516790 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:38.516599    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"]
Sep 07 14:22:38.519384 ip-10-0-139-134 kubenswrapper[2581]: W0907 14:22:38.519354    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podacaa9cd0_bd39_4b66_8f47_3a485f2ad86d.slice/crio-021988457fd71ab6609f49fe5fcd564838759901245a60d7f8ef9993b2398058 WatchSource:0}: Error finding container 021988457fd71ab6609f49fe5fcd564838759901245a60d7f8ef9993b2398058: Status 404 returned error can't find the container with id 021988457fd71ab6609f49fe5fcd564838759901245a60d7f8ef9993b2398058
Sep 07 14:22:38.751008 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:38.750974    2581 generic.go:356] "Generic (PLEG): container finished" podID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerID="27a116e6cb3de0dd2f7fb4f7b82649a964b2ea2420dfbffc43bb9181dc261b7b" exitCode=0
Sep 07 14:22:38.751226 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:38.751053    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" event={"ID":"9bab10d3-6194-4932-8988-ad40fcc5a3a5","Type":"ContainerDied","Data":"27a116e6cb3de0dd2f7fb4f7b82649a964b2ea2420dfbffc43bb9181dc261b7b"}
Sep 07 14:22:38.752614 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:38.752586    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" event={"ID":"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d","Type":"ContainerStarted","Data":"f71060cc3aae3e08462ff30b1d3015fcdb9035736cf3bb621837f3a8f3714b33"}
Sep 07 14:22:38.752757 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:38.752625    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" event={"ID":"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d","Type":"ContainerStarted","Data":"021988457fd71ab6609f49fe5fcd564838759901245a60d7f8ef9993b2398058"}
Sep 07 14:22:43.775373 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:43.775264    2581 generic.go:356] "Generic (PLEG): container finished" podID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerID="f71060cc3aae3e08462ff30b1d3015fcdb9035736cf3bb621837f3a8f3714b33" exitCode=0
Sep 07 14:22:43.775373 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:43.775337    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" event={"ID":"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d","Type":"ContainerDied","Data":"f71060cc3aae3e08462ff30b1d3015fcdb9035736cf3bb621837f3a8f3714b33"}
Sep 07 14:22:43.969706 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:43.969659    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused"
Sep 07 14:22:44.498120 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:44.498077    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Sep 07 14:22:44.781148 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:44.781053    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" event={"ID":"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d","Type":"ContainerStarted","Data":"b8ca766eb84eb9d4f0ba1d53bb0a2c283f1f39818230e5ae310cb7a454aef825"}
Sep 07 14:22:49.802852 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:49.802817    2581 generic.go:356] "Generic (PLEG): container finished" podID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerID="b8ca766eb84eb9d4f0ba1d53bb0a2c283f1f39818230e5ae310cb7a454aef825" exitCode=0
Sep 07 14:22:49.803223 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:49.802890    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" event={"ID":"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d","Type":"ContainerDied","Data":"b8ca766eb84eb9d4f0ba1d53bb0a2c283f1f39818230e5ae310cb7a454aef825"}
Sep 07 14:22:50.812878 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:50.812826    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" event={"ID":"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d","Type":"ContainerStarted","Data":"ca574363d283a6647d0e9326050bf54c7b0444294b78ee01122e953bb7c14927"}
Sep 07 14:22:50.813388 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:50.812894    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" event={"ID":"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d","Type":"ContainerStarted","Data":"7796a05c0e16bdedbd8f327321fc1da82cb95be879dd93918d93492cee49051a"}
Sep 07 14:22:50.813388 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:50.812915    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" event={"ID":"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d","Type":"ContainerStarted","Data":"f12689ee024f9e2d9272baadc47fae0857c7ae506ce89faceb92c08b759de011"}
Sep 07 14:22:50.813388 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:50.812934    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" event={"ID":"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d","Type":"ContainerStarted","Data":"9e271665815704b3be8f916dc84a17bdf384fdefa9115ed287bedb050db7ac65"}
Sep 07 14:22:50.839135 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:50.839040    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" podStartSLOduration=13.839017509 podStartE2EDuration="13.839017509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 14:22:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 14:22:50.837207118 +0000 UTC m=+1511.837635533" watchObservedRunningTime="2026-09-07 14:22:50.839017509 +0000 UTC m=+1511.839445902"
Sep 07 14:22:53.241658 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:53.239305    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:53.241658 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:53.239364    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:53.241658 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:53.239384    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:53.241658 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:53.239401    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:53.242446 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:53.242335    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.36:6571: connect: connection refused"
Sep 07 14:22:53.242446 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:53.242414    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Sep 07 14:22:53.242591 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:53.242520    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Sep 07 14:22:53.242591 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:53.242574    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.36:8816: connect: connection refused"
Sep 07 14:22:53.969668 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:53.969207    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused"
Sep 07 14:22:54.497605 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:54.497541    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Sep 07 14:22:56.239814 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:56.239758    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Sep 07 14:22:56.239814 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:56.239811    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.36:6571: connect: connection refused"
Sep 07 14:22:56.240406 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:56.239910    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Sep 07 14:22:56.240406 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:56.239763    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.36:8816: connect: connection refused"
Sep 07 14:22:58.239893 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:58.239842    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:58.240253 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:58.239914    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:58.240253 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:58.239933    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:58.240253 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:58.239951    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:59.241311 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:59.241254    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:59.241686 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:59.241498    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:59.241686 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:59.241599    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:59.242201 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:59.242162    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:59.242337 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:59.242233    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:59.242451 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:59.242433    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:59.246460 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:59.246442    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:22:59.865451 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:22:59.865413    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:23:03.969813 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:03.969705    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused"
Sep 07 14:23:03.970348 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:03.969873    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:23:04.498263 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:04.498213    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Sep 07 14:23:04.498501 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:04.498389    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:23:06.895510 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:06.895480    2581 generic.go:356] "Generic (PLEG): container finished" podID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerID="2f3e3096e94f4f83c353815d69dee456979ed903cd295e502e5850f615b1fee4" exitCode=137
Sep 07 14:23:06.895510 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:06.895506    2581 generic.go:356] "Generic (PLEG): container finished" podID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerID="5e3b2d6906b9aa99e92c7cb5f2d72c5455c42225f4a28841c537982301539dc1" exitCode=137
Sep 07 14:23:06.895877 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:06.895548    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" event={"ID":"9bab10d3-6194-4932-8988-ad40fcc5a3a5","Type":"ContainerDied","Data":"2f3e3096e94f4f83c353815d69dee456979ed903cd295e502e5850f615b1fee4"}
Sep 07 14:23:06.895877 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:06.895587    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" event={"ID":"9bab10d3-6194-4932-8988-ad40fcc5a3a5","Type":"ContainerDied","Data":"5e3b2d6906b9aa99e92c7cb5f2d72c5455c42225f4a28841c537982301539dc1"}
Sep 07 14:23:07.482474 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.482448    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:23:07.610461 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.610369    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9bab10d3-6194-4932-8988-ad40fcc5a3a5-feast-data\") pod \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") "
Sep 07 14:23:07.610461 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.610423    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlvqk\" (UniqueName: \"kubernetes.io/projected/9bab10d3-6194-4932-8988-ad40fcc5a3a5-kube-api-access-jlvqk\") pod \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") "
Sep 07 14:23:07.610461 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.610448    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-offline-tls\") pod \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") "
Sep 07 14:23:07.610745 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.610476    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-registry-tls\") pod \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") "
Sep 07 14:23:07.610745 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.610494    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-ui-tls\") pod \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") "
Sep 07 14:23:07.610745 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.610560    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-online-tls\") pod \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\" (UID: \"9bab10d3-6194-4932-8988-ad40fcc5a3a5\") "
Sep 07 14:23:07.610963 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.610931    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bab10d3-6194-4932-8988-ad40fcc5a3a5-feast-data" (OuterVolumeSpecName: "feast-data") pod "9bab10d3-6194-4932-8988-ad40fcc5a3a5" (UID: "9bab10d3-6194-4932-8988-ad40fcc5a3a5"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 14:23:07.612912 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.612879    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "9bab10d3-6194-4932-8988-ad40fcc5a3a5" (UID: "9bab10d3-6194-4932-8988-ad40fcc5a3a5"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:23:07.612912 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.612899    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "9bab10d3-6194-4932-8988-ad40fcc5a3a5" (UID: "9bab10d3-6194-4932-8988-ad40fcc5a3a5"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:23:07.613096 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.612932    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-online-tls" (OuterVolumeSpecName: "online-tls") pod "9bab10d3-6194-4932-8988-ad40fcc5a3a5" (UID: "9bab10d3-6194-4932-8988-ad40fcc5a3a5"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:23:07.613096 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.613050    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bab10d3-6194-4932-8988-ad40fcc5a3a5-kube-api-access-jlvqk" (OuterVolumeSpecName: "kube-api-access-jlvqk") pod "9bab10d3-6194-4932-8988-ad40fcc5a3a5" (UID: "9bab10d3-6194-4932-8988-ad40fcc5a3a5"). InnerVolumeSpecName "kube-api-access-jlvqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 14:23:07.613096 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.613050    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9bab10d3-6194-4932-8988-ad40fcc5a3a5" (UID: "9bab10d3-6194-4932-8988-ad40fcc5a3a5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:23:07.711940 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.711906    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-online-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:23:07.711940 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.711938    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9bab10d3-6194-4932-8988-ad40fcc5a3a5-feast-data\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:23:07.711940 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.711950    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlvqk\" (UniqueName: \"kubernetes.io/projected/9bab10d3-6194-4932-8988-ad40fcc5a3a5-kube-api-access-jlvqk\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:23:07.712185 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.711963    2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-offline-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:23:07.712185 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.711976    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-registry-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:23:07.712185 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.711985    2581 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9bab10d3-6194-4932-8988-ad40fcc5a3a5-ui-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:23:07.902500 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.902410    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs" event={"ID":"9bab10d3-6194-4932-8988-ad40fcc5a3a5","Type":"ContainerDied","Data":"9bcd3c797ff710e7bbe7baa25ddb48df5669ac46fb73528af83007c4ca21aded"}
Sep 07 14:23:07.902500 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.902432    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"
Sep 07 14:23:07.902500 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.902472    2581 scope.go:117] "RemoveContainer" containerID="fd80946f4c7279f551083f404f334ea94a8344a1f09d0608ee0578680538d0bd"
Sep 07 14:23:07.911406 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.911386    2581 scope.go:117] "RemoveContainer" containerID="2f3e3096e94f4f83c353815d69dee456979ed903cd295e502e5850f615b1fee4"
Sep 07 14:23:07.918700 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.918682    2581 scope.go:117] "RemoveContainer" containerID="27a116e6cb3de0dd2f7fb4f7b82649a964b2ea2420dfbffc43bb9181dc261b7b"
Sep 07 14:23:07.924965 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.924943    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"]
Sep 07 14:23:07.926017 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.925995    2581 scope.go:117] "RemoveContainer" containerID="5e3b2d6906b9aa99e92c7cb5f2d72c5455c42225f4a28841c537982301539dc1"
Sep 07 14:23:07.931951 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.931929    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-xvjxs"]
Sep 07 14:23:07.933955 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.933936    2581 scope.go:117] "RemoveContainer" containerID="3c0d994c17e1d76a3d5b6570ad29e2a03f236a9bb19ba33dc3c7ae6296894352"
Sep 07 14:23:07.941007 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:07.940990    2581 scope.go:117] "RemoveContainer" containerID="827e586677501eb30884bcea16e1765ef85a0f6dc721df0216d80d2626196eda"
Sep 07 14:23:09.519213 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:23:09.519176    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" path="/var/lib/kubelet/pods/9bab10d3-6194-4932-8988-ad40fcc5a3a5/volumes"
Sep 07 14:24:02.036312 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.036262    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"]
Sep 07 14:24:02.038916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.036634    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="feast-init"
Sep 07 14:24:02.038916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.036648    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="feast-init"
Sep 07 14:24:02.038916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.036657    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="registry"
Sep 07 14:24:02.038916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.036663    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="registry"
Sep 07 14:24:02.038916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.036716    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="offline"
Sep 07 14:24:02.038916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.036726    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="offline"
Sep 07 14:24:02.038916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.036734    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="online"
Sep 07 14:24:02.038916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.036739    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="online"
Sep 07 14:24:02.038916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.036747    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="ui"
Sep 07 14:24:02.038916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.036752    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="ui"
Sep 07 14:24:02.038916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.036763    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="feast-apply"
Sep 07 14:24:02.038916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.036769    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="feast-apply"
Sep 07 14:24:02.038916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.036822    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="registry"
Sep 07 14:24:02.038916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.036829    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="online"
Sep 07 14:24:02.038916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.036839    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="offline"
Sep 07 14:24:02.038916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.036844    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bab10d3-6194-4932-8988-ad40fcc5a3a5" containerName="ui"
Sep 07 14:24:02.039814 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.039798    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:02.042354 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.042331    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 07 14:24:02.042498 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.042364    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 07 14:24:02.042498 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.042395    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 07 14:24:02.042498 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.042415    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-mq8gh\""
Sep 07 14:24:02.042498 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.042447    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 07 14:24:02.042700 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.042495    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 07 14:24:02.043245 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.043227    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 07 14:24:02.052642 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.052617    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"]
Sep 07 14:24:02.127100 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.127061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpd8r\" (UniqueName: \"kubernetes.io/projected/a3066ac9-cd05-4404-8862-d039a8271138-kube-api-access-tpd8r\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-9c69j\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:02.127100 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.127100    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a3066ac9-cd05-4404-8862-d039a8271138-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-9c69j\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:02.127375 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.127119    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-9c69j\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:02.127375 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.127135    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-9c69j\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:02.127375 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.127229    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a3066ac9-cd05-4404-8862-d039a8271138-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-9c69j\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:02.127375 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.127283    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-9c69j\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:02.228099 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.228062    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-9c69j\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:02.228273 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.228109    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpd8r\" (UniqueName: \"kubernetes.io/projected/a3066ac9-cd05-4404-8862-d039a8271138-kube-api-access-tpd8r\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-9c69j\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:02.228273 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.228227    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a3066ac9-cd05-4404-8862-d039a8271138-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-9c69j\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:02.228273 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.228261    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-9c69j\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:02.228490 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.228285    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-9c69j\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:02.228490 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.228369    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a3066ac9-cd05-4404-8862-d039a8271138-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-9c69j\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:02.228490 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:24:02.228405    2581 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
Sep 07 14:24:02.228490 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:24:02.228481    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-online-tls podName:a3066ac9-cd05-4404-8862-d039a8271138 nodeName:}" failed. No retries permitted until 2026-09-07 14:24:02.728465077 +0000 UTC m=+1583.728893448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-online-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-9c69j" (UID: "a3066ac9-cd05-4404-8862-d039a8271138") : secret "feast-simple-feast-remote-setup-online-tls" not found
Sep 07 14:24:02.228711 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:24:02.228496    2581 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 07 14:24:02.228711 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:24:02.228581    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-ui-tls podName:a3066ac9-cd05-4404-8862-d039a8271138 nodeName:}" failed. No retries permitted until 2026-09-07 14:24:02.728563338 +0000 UTC m=+1583.728991720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-ui-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-9c69j" (UID: "a3066ac9-cd05-4404-8862-d039a8271138") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 07 14:24:02.228830 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.228789    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a3066ac9-cd05-4404-8862-d039a8271138-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-9c69j\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:02.229047 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.229024    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a3066ac9-cd05-4404-8862-d039a8271138-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-9c69j\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:02.230450 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.230422    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-9c69j\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:02.236959 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.236938    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpd8r\" (UniqueName: \"kubernetes.io/projected/a3066ac9-cd05-4404-8862-d039a8271138-kube-api-access-tpd8r\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-9c69j\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:02.732914 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.732858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-9c69j\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:02.732914 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.732915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-9c69j\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:02.735351 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.735323    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-9c69j\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:02.735457 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.735374    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-9c69j\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:02.948629 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:02.948574    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:03.229992 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:03.229969    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"]
Sep 07 14:24:03.231946 ip-10-0-139-134 kubenswrapper[2581]: W0907 14:24:03.231912    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3066ac9_cd05_4404_8862_d039a8271138.slice/crio-a646af695514996b072c2cdb4df0287361fddb30eefc6436a4c0793d50623a71 WatchSource:0}: Error finding container a646af695514996b072c2cdb4df0287361fddb30eefc6436a4c0793d50623a71: Status 404 returned error can't find the container with id a646af695514996b072c2cdb4df0287361fddb30eefc6436a4c0793d50623a71
Sep 07 14:24:04.128916 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:04.128874    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" event={"ID":"a3066ac9-cd05-4404-8862-d039a8271138","Type":"ContainerStarted","Data":"fe3ed48064cc081fba72720c1e1107106126d9317f8f1476417dc6fe63b75ac1"}
Sep 07 14:24:04.129084 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:04.128926    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" event={"ID":"a3066ac9-cd05-4404-8862-d039a8271138","Type":"ContainerStarted","Data":"a646af695514996b072c2cdb4df0287361fddb30eefc6436a4c0793d50623a71"}
Sep 07 14:24:09.150895 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:09.150857    2581 generic.go:356] "Generic (PLEG): container finished" podID="a3066ac9-cd05-4404-8862-d039a8271138" containerID="fe3ed48064cc081fba72720c1e1107106126d9317f8f1476417dc6fe63b75ac1" exitCode=0
Sep 07 14:24:09.151284 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:09.150933    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" event={"ID":"a3066ac9-cd05-4404-8862-d039a8271138","Type":"ContainerDied","Data":"fe3ed48064cc081fba72720c1e1107106126d9317f8f1476417dc6fe63b75ac1"}
Sep 07 14:24:10.156065 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:10.156025    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" event={"ID":"a3066ac9-cd05-4404-8862-d039a8271138","Type":"ContainerStarted","Data":"0d9b9fb8fa63efa6e1e52509ce69a7e0037a3bd30429172293639025b6271799"}
Sep 07 14:24:31.247250 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:31.247214    2581 generic.go:356] "Generic (PLEG): container finished" podID="a3066ac9-cd05-4404-8862-d039a8271138" containerID="0d9b9fb8fa63efa6e1e52509ce69a7e0037a3bd30429172293639025b6271799" exitCode=0
Sep 07 14:24:31.247675 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:31.247284    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" event={"ID":"a3066ac9-cd05-4404-8862-d039a8271138","Type":"ContainerDied","Data":"0d9b9fb8fa63efa6e1e52509ce69a7e0037a3bd30429172293639025b6271799"}
Sep 07 14:24:32.256338 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:32.256274    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" event={"ID":"a3066ac9-cd05-4404-8862-d039a8271138","Type":"ContainerStarted","Data":"f70ac807f2a858e4da8678cac3114a6a5fa2715beb8100e0f415e7446bbaa9d6"}
Sep 07 14:24:32.256825 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:32.256349    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" event={"ID":"a3066ac9-cd05-4404-8862-d039a8271138","Type":"ContainerStarted","Data":"eac94bae08180a2af00b4551a39440a1993ebbd9fead35cbd5a288b070b181b6"}
Sep 07 14:24:32.256825 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:32.256365    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" event={"ID":"a3066ac9-cd05-4404-8862-d039a8271138","Type":"ContainerStarted","Data":"40869fed3731bb0a5333c4d085440b5eaa3ec5735bf3d07797055f1aa81e4ddc"}
Sep 07 14:24:32.283498 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:32.283426    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" podStartSLOduration=30.28340495 podStartE2EDuration="30.28340495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 14:24:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 14:24:32.281235466 +0000 UTC m=+1613.281663859" watchObservedRunningTime="2026-09-07 14:24:32.28340495 +0000 UTC m=+1613.283833343"
Sep 07 14:24:32.949232 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:32.949060    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:32.949232 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:32.949129    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:32.949232 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:32.949147    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:32.949232 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:32.949163    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:32.949232 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:32.949178    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:32.949232 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:32.949194    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:32.951068 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:32.951025    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.37:8816: connect: connection refused"
Sep 07 14:24:32.951215 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:32.951065    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Sep 07 14:24:32.951215 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:32.951018    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Sep 07 14:24:35.949213 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:35.949163    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.37:8816: connect: connection refused"
Sep 07 14:24:35.949729 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:35.949232    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Sep 07 14:24:35.949729 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:35.949166    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Sep 07 14:24:38.949379 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:38.949329    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Sep 07 14:24:38.949379 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:38.949346    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.37:8816: connect: connection refused"
Sep 07 14:24:38.949882 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:38.949352    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Sep 07 14:24:41.949564 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:41.949528    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:41.950088 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:41.949713    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:41.950465 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:41.950442    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:41.950597 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:41.950579    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:42.637249 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:42.637219    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:43.644096 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:43.644063    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:24:43.990492 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:43.990401    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 14:24:44.648438 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:24:44.648396    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 07 14:25:46.104991 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:46.104948    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"]
Sep 07 14:25:46.105997 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:46.105194    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="online" containerID="cri-o://40869fed3731bb0a5333c4d085440b5eaa3ec5735bf3d07797055f1aa81e4ddc" gracePeriod=30
Sep 07 14:25:46.105997 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:46.105235    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="offline" containerID="cri-o://eac94bae08180a2af00b4551a39440a1993ebbd9fead35cbd5a288b070b181b6" gracePeriod=30
Sep 07 14:25:46.105997 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:46.105242    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="ui" containerID="cri-o://f70ac807f2a858e4da8678cac3114a6a5fa2715beb8100e0f415e7446bbaa9d6" gracePeriod=30
Sep 07 14:25:46.332031 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:46.331992    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"]
Sep 07 14:25:46.332483 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:46.332270    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="registry" containerID="cri-o://9e271665815704b3be8f916dc84a17bdf384fdefa9115ed287bedb050db7ac65" gracePeriod=30
Sep 07 14:25:46.332483 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:46.332358    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="offline" containerID="cri-o://7796a05c0e16bdedbd8f327321fc1da82cb95be879dd93918d93492cee49051a" gracePeriod=30
Sep 07 14:25:46.332696 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:46.332340    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="ui" containerID="cri-o://ca574363d283a6647d0e9326050bf54c7b0444294b78ee01122e953bb7c14927" gracePeriod=30
Sep 07 14:25:46.332696 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:46.332364    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="online" containerID="cri-o://f12689ee024f9e2d9272baadc47fae0857c7ae506ce89faceb92c08b759de011" gracePeriod=30
Sep 07 14:25:47.564113 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:47.564074    2581 generic.go:356] "Generic (PLEG): container finished" podID="a3066ac9-cd05-4404-8862-d039a8271138" containerID="f70ac807f2a858e4da8678cac3114a6a5fa2715beb8100e0f415e7446bbaa9d6" exitCode=0
Sep 07 14:25:47.564113 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:47.564102    2581 generic.go:356] "Generic (PLEG): container finished" podID="a3066ac9-cd05-4404-8862-d039a8271138" containerID="40869fed3731bb0a5333c4d085440b5eaa3ec5735bf3d07797055f1aa81e4ddc" exitCode=0
Sep 07 14:25:47.564571 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:47.564145    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" event={"ID":"a3066ac9-cd05-4404-8862-d039a8271138","Type":"ContainerDied","Data":"f70ac807f2a858e4da8678cac3114a6a5fa2715beb8100e0f415e7446bbaa9d6"}
Sep 07 14:25:47.564571 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:47.564187    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" event={"ID":"a3066ac9-cd05-4404-8862-d039a8271138","Type":"ContainerDied","Data":"40869fed3731bb0a5333c4d085440b5eaa3ec5735bf3d07797055f1aa81e4ddc"}
Sep 07 14:25:47.566721 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:47.566700    2581 generic.go:356] "Generic (PLEG): container finished" podID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerID="ca574363d283a6647d0e9326050bf54c7b0444294b78ee01122e953bb7c14927" exitCode=0
Sep 07 14:25:47.566721 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:47.566717    2581 generic.go:356] "Generic (PLEG): container finished" podID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerID="f12689ee024f9e2d9272baadc47fae0857c7ae506ce89faceb92c08b759de011" exitCode=0
Sep 07 14:25:47.566867 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:47.566734    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" event={"ID":"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d","Type":"ContainerDied","Data":"ca574363d283a6647d0e9326050bf54c7b0444294b78ee01122e953bb7c14927"}
Sep 07 14:25:47.566867 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:47.566758    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" event={"ID":"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d","Type":"ContainerDied","Data":"f12689ee024f9e2d9272baadc47fae0857c7ae506ce89faceb92c08b759de011"}
Sep 07 14:25:49.242982 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:49.242929    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Sep 07 14:25:49.862610 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:49.862569    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Sep 07 14:25:51.950404 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:51.950357    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Sep 07 14:25:53.644694 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:53.644658    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Sep 07 14:25:59.242527 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:59.242475    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Sep 07 14:25:59.862833 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:25:59.862782    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Sep 07 14:26:01.951109 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:01.951015    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Sep 07 14:26:03.644703 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:03.644658    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Sep 07 14:26:09.242860 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:09.242816    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Sep 07 14:26:09.243326 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:09.242971    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:26:09.863010 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:09.862966    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Sep 07 14:26:09.863189 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:09.863093    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:26:11.950586 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:11.950539    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Sep 07 14:26:11.951014 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:11.950674    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:26:13.645061 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:13.645017    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Sep 07 14:26:13.645486 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:13.645138    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:26:16.685435 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.685401    2581 generic.go:356] "Generic (PLEG): container finished" podID="a3066ac9-cd05-4404-8862-d039a8271138" containerID="eac94bae08180a2af00b4551a39440a1993ebbd9fead35cbd5a288b070b181b6" exitCode=137
Sep 07 14:26:16.685791 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.685475    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" event={"ID":"a3066ac9-cd05-4404-8862-d039a8271138","Type":"ContainerDied","Data":"eac94bae08180a2af00b4551a39440a1993ebbd9fead35cbd5a288b070b181b6"}
Sep 07 14:26:16.690082 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.689934    2581 generic.go:356] "Generic (PLEG): container finished" podID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerID="7796a05c0e16bdedbd8f327321fc1da82cb95be879dd93918d93492cee49051a" exitCode=137
Sep 07 14:26:16.690082 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.689963    2581 generic.go:356] "Generic (PLEG): container finished" podID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerID="9e271665815704b3be8f916dc84a17bdf384fdefa9115ed287bedb050db7ac65" exitCode=137
Sep 07 14:26:16.690082 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.689987    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" event={"ID":"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d","Type":"ContainerDied","Data":"7796a05c0e16bdedbd8f327321fc1da82cb95be879dd93918d93492cee49051a"}
Sep 07 14:26:16.690082 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.690040    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" event={"ID":"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d","Type":"ContainerDied","Data":"9e271665815704b3be8f916dc84a17bdf384fdefa9115ed287bedb050db7ac65"}
Sep 07 14:26:16.750200 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.750173    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:26:16.837220 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.837186    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-online-tls\") pod \"a3066ac9-cd05-4404-8862-d039a8271138\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") "
Sep 07 14:26:16.837220 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.837229    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-ui-tls\") pod \"a3066ac9-cd05-4404-8862-d039a8271138\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") "
Sep 07 14:26:16.837469 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.837258    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-offline-tls\") pod \"a3066ac9-cd05-4404-8862-d039a8271138\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") "
Sep 07 14:26:16.837469 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.837317    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpd8r\" (UniqueName: \"kubernetes.io/projected/a3066ac9-cd05-4404-8862-d039a8271138-kube-api-access-tpd8r\") pod \"a3066ac9-cd05-4404-8862-d039a8271138\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") "
Sep 07 14:26:16.837469 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.837361    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a3066ac9-cd05-4404-8862-d039a8271138-feast-data\") pod \"a3066ac9-cd05-4404-8862-d039a8271138\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") "
Sep 07 14:26:16.837469 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.837411    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a3066ac9-cd05-4404-8862-d039a8271138-registry-tls\") pod \"a3066ac9-cd05-4404-8862-d039a8271138\" (UID: \"a3066ac9-cd05-4404-8862-d039a8271138\") "
Sep 07 14:26:16.837863 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.837819    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3066ac9-cd05-4404-8862-d039a8271138-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a3066ac9-cd05-4404-8862-d039a8271138" (UID: "a3066ac9-cd05-4404-8862-d039a8271138"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 14:26:16.837980 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.837945    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3066ac9-cd05-4404-8862-d039a8271138-feast-data" (OuterVolumeSpecName: "feast-data") pod "a3066ac9-cd05-4404-8862-d039a8271138" (UID: "a3066ac9-cd05-4404-8862-d039a8271138"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 14:26:16.839589 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.839567    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-online-tls" (OuterVolumeSpecName: "online-tls") pod "a3066ac9-cd05-4404-8862-d039a8271138" (UID: "a3066ac9-cd05-4404-8862-d039a8271138"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:26:16.839678 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.839624    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "a3066ac9-cd05-4404-8862-d039a8271138" (UID: "a3066ac9-cd05-4404-8862-d039a8271138"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:26:16.839822 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.839801    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a3066ac9-cd05-4404-8862-d039a8271138" (UID: "a3066ac9-cd05-4404-8862-d039a8271138"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:26:16.839822 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.839814    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3066ac9-cd05-4404-8862-d039a8271138-kube-api-access-tpd8r" (OuterVolumeSpecName: "kube-api-access-tpd8r") pod "a3066ac9-cd05-4404-8862-d039a8271138" (UID: "a3066ac9-cd05-4404-8862-d039a8271138"). InnerVolumeSpecName "kube-api-access-tpd8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 14:26:16.938813 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.938773    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-online-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:26:16.938813 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.938804    2581 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-ui-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:26:16.938813 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.938816    2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a3066ac9-cd05-4404-8862-d039a8271138-offline-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:26:16.939050 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.938827    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpd8r\" (UniqueName: \"kubernetes.io/projected/a3066ac9-cd05-4404-8862-d039a8271138-kube-api-access-tpd8r\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:26:16.939050 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.938842    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a3066ac9-cd05-4404-8862-d039a8271138-feast-data\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:26:16.939050 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.938853    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a3066ac9-cd05-4404-8862-d039a8271138-registry-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:26:16.973100 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:16.973074    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:26:17.140225 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.140195    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-ui-tls\") pod \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") "
Sep 07 14:26:17.140225 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.140236    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-feast-data\") pod \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") "
Sep 07 14:26:17.140450 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.140269    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-registry-tls\") pod \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") "
Sep 07 14:26:17.140450 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.140331    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6vqn\" (UniqueName: \"kubernetes.io/projected/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-kube-api-access-j6vqn\") pod \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") "
Sep 07 14:26:17.140450 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.140394    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-online-tls\") pod \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") "
Sep 07 14:26:17.140450 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.140446    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-offline-tls\") pod \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\" (UID: \"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d\") "
Sep 07 14:26:17.140847 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.140819    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-feast-data" (OuterVolumeSpecName: "feast-data") pod "acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" (UID: "acaa9cd0-bd39-4b66-8f47-3a485f2ad86d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 14:26:17.142661 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.142631    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" (UID: "acaa9cd0-bd39-4b66-8f47-3a485f2ad86d"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:26:17.142986 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.142876    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" (UID: "acaa9cd0-bd39-4b66-8f47-3a485f2ad86d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:26:17.142986 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.142886    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" (UID: "acaa9cd0-bd39-4b66-8f47-3a485f2ad86d"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:26:17.142986 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.142954    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-online-tls" (OuterVolumeSpecName: "online-tls") pod "acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" (UID: "acaa9cd0-bd39-4b66-8f47-3a485f2ad86d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 14:26:17.143274 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.143246    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-kube-api-access-j6vqn" (OuterVolumeSpecName: "kube-api-access-j6vqn") pod "acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" (UID: "acaa9cd0-bd39-4b66-8f47-3a485f2ad86d"). InnerVolumeSpecName "kube-api-access-j6vqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 14:26:17.241901 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.241865    2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-offline-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:26:17.241901 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.241896    2581 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-ui-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:26:17.241901 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.241905    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-feast-data\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:26:17.242144 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.241914    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-registry-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:26:17.242144 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.241923    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6vqn\" (UniqueName: \"kubernetes.io/projected/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-kube-api-access-j6vqn\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:26:17.242144 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.241932    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d-online-tls\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:26:17.696340 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.696282    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j" event={"ID":"a3066ac9-cd05-4404-8862-d039a8271138","Type":"ContainerDied","Data":"a646af695514996b072c2cdb4df0287361fddb30eefc6436a4c0793d50623a71"}
Sep 07 14:26:17.696774 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.696357    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"
Sep 07 14:26:17.696774 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.696364    2581 scope.go:117] "RemoveContainer" containerID="f70ac807f2a858e4da8678cac3114a6a5fa2715beb8100e0f415e7446bbaa9d6"
Sep 07 14:26:17.699777 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.699753    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58" event={"ID":"acaa9cd0-bd39-4b66-8f47-3a485f2ad86d","Type":"ContainerDied","Data":"021988457fd71ab6609f49fe5fcd564838759901245a60d7f8ef9993b2398058"}
Sep 07 14:26:17.699857 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.699778    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"
Sep 07 14:26:17.705878 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.705858    2581 scope.go:117] "RemoveContainer" containerID="eac94bae08180a2af00b4551a39440a1993ebbd9fead35cbd5a288b070b181b6"
Sep 07 14:26:17.713148 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.713099    2581 scope.go:117] "RemoveContainer" containerID="40869fed3731bb0a5333c4d085440b5eaa3ec5735bf3d07797055f1aa81e4ddc"
Sep 07 14:26:17.715460 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.715436    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"]
Sep 07 14:26:17.719834 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.719810    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-9c69j"]
Sep 07 14:26:17.722055 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.722033    2581 scope.go:117] "RemoveContainer" containerID="0d9b9fb8fa63efa6e1e52509ce69a7e0037a3bd30429172293639025b6271799"
Sep 07 14:26:17.729096 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.729077    2581 scope.go:117] "RemoveContainer" containerID="fe3ed48064cc081fba72720c1e1107106126d9317f8f1476417dc6fe63b75ac1"
Sep 07 14:26:17.735643 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.735619    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"]
Sep 07 14:26:17.736742 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.736721    2581 scope.go:117] "RemoveContainer" containerID="ca574363d283a6647d0e9326050bf54c7b0444294b78ee01122e953bb7c14927"
Sep 07 14:26:17.739515 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.739491    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-t4d58"]
Sep 07 14:26:17.743976 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.743960    2581 scope.go:117] "RemoveContainer" containerID="7796a05c0e16bdedbd8f327321fc1da82cb95be879dd93918d93492cee49051a"
Sep 07 14:26:17.750967 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.750951    2581 scope.go:117] "RemoveContainer" containerID="f12689ee024f9e2d9272baadc47fae0857c7ae506ce89faceb92c08b759de011"
Sep 07 14:26:17.757994 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.757975    2581 scope.go:117] "RemoveContainer" containerID="9e271665815704b3be8f916dc84a17bdf384fdefa9115ed287bedb050db7ac65"
Sep 07 14:26:17.764972 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.764945    2581 scope.go:117] "RemoveContainer" containerID="b8ca766eb84eb9d4f0ba1d53bb0a2c283f1f39818230e5ae310cb7a454aef825"
Sep 07 14:26:17.771783 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:17.771763    2581 scope.go:117] "RemoveContainer" containerID="f71060cc3aae3e08462ff30b1d3015fcdb9035736cf3bb621837f3a8f3714b33"
Sep 07 14:26:19.519423 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:19.519388    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3066ac9-cd05-4404-8862-d039a8271138" path="/var/lib/kubelet/pods/a3066ac9-cd05-4404-8862-d039a8271138/volumes"
Sep 07 14:26:19.519940 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:19.519926    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" path="/var/lib/kubelet/pods/acaa9cd0-bd39-4b66-8f47-3a485f2ad86d/volumes"
Sep 07 14:26:36.142276 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142243    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wgq9p/must-gather-n42lf"]
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142569    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="feast-init"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142592    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="feast-init"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142600    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="feast-apply"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142606    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="feast-apply"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142612    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="online"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142617    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="online"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142631    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="registry"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142636    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="registry"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142643    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="ui"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142649    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="ui"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142655    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="ui"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142660    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="ui"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142668    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="offline"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142673    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="offline"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142678    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="feast-apply"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142682    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="feast-apply"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142688    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="online"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142693    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="online"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142698    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="offline"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142703    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="offline"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142708    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="feast-init"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142713    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="feast-init"
Sep 07 14:26:36.142748 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142754    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="offline"
Sep 07 14:26:36.143455 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142762    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="ui"
Sep 07 14:26:36.143455 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142769    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="ui"
Sep 07 14:26:36.143455 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142775    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="registry"
Sep 07 14:26:36.143455 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142781    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3066ac9-cd05-4404-8862-d039a8271138" containerName="online"
Sep 07 14:26:36.143455 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142786    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="online"
Sep 07 14:26:36.143455 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.142791    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="acaa9cd0-bd39-4b66-8f47-3a485f2ad86d" containerName="offline"
Sep 07 14:26:36.147144 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.147122    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wgq9p/must-gather-n42lf"
Sep 07 14:26:36.149444 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.149422    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wgq9p\"/\"openshift-service-ca.crt\""
Sep 07 14:26:36.149567 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.149446    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wgq9p\"/\"default-dockercfg-vpg97\""
Sep 07 14:26:36.150407 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.150390    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wgq9p\"/\"kube-root-ca.crt\""
Sep 07 14:26:36.152744 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.152713    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wgq9p/must-gather-n42lf"]
Sep 07 14:26:36.180313 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.180265    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlfkw\" (UniqueName: \"kubernetes.io/projected/8c6e76fe-c6f5-453e-a97a-91d521bc8685-kube-api-access-jlfkw\") pod \"must-gather-n42lf\" (UID: \"8c6e76fe-c6f5-453e-a97a-91d521bc8685\") " pod="openshift-must-gather-wgq9p/must-gather-n42lf"
Sep 07 14:26:36.180458 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.180332    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8c6e76fe-c6f5-453e-a97a-91d521bc8685-must-gather-output\") pod \"must-gather-n42lf\" (UID: \"8c6e76fe-c6f5-453e-a97a-91d521bc8685\") " pod="openshift-must-gather-wgq9p/must-gather-n42lf"
Sep 07 14:26:36.280932 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.280897    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlfkw\" (UniqueName: \"kubernetes.io/projected/8c6e76fe-c6f5-453e-a97a-91d521bc8685-kube-api-access-jlfkw\") pod \"must-gather-n42lf\" (UID: \"8c6e76fe-c6f5-453e-a97a-91d521bc8685\") " pod="openshift-must-gather-wgq9p/must-gather-n42lf"
Sep 07 14:26:36.281098 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.280939    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8c6e76fe-c6f5-453e-a97a-91d521bc8685-must-gather-output\") pod \"must-gather-n42lf\" (UID: \"8c6e76fe-c6f5-453e-a97a-91d521bc8685\") " pod="openshift-must-gather-wgq9p/must-gather-n42lf"
Sep 07 14:26:36.281249 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.281229    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8c6e76fe-c6f5-453e-a97a-91d521bc8685-must-gather-output\") pod \"must-gather-n42lf\" (UID: \"8c6e76fe-c6f5-453e-a97a-91d521bc8685\") " pod="openshift-must-gather-wgq9p/must-gather-n42lf"
Sep 07 14:26:36.289713 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.289680    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlfkw\" (UniqueName: \"kubernetes.io/projected/8c6e76fe-c6f5-453e-a97a-91d521bc8685-kube-api-access-jlfkw\") pod \"must-gather-n42lf\" (UID: \"8c6e76fe-c6f5-453e-a97a-91d521bc8685\") " pod="openshift-must-gather-wgq9p/must-gather-n42lf"
Sep 07 14:26:36.466279 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.466189    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wgq9p/must-gather-n42lf"
Sep 07 14:26:36.735628 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.735605    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wgq9p/must-gather-n42lf"]
Sep 07 14:26:36.738009 ip-10-0-139-134 kubenswrapper[2581]: W0907 14:26:36.737980    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c6e76fe_c6f5_453e_a97a_91d521bc8685.slice/crio-5bf967e371334649545715bf76161d2793423124ffdcb2f8bb4948d5d033d602 WatchSource:0}: Error finding container 5bf967e371334649545715bf76161d2793423124ffdcb2f8bb4948d5d033d602: Status 404 returned error can't find the container with id 5bf967e371334649545715bf76161d2793423124ffdcb2f8bb4948d5d033d602
Sep 07 14:26:36.739738 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.739719    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 14:26:36.775980 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:36.775947    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wgq9p/must-gather-n42lf" event={"ID":"8c6e76fe-c6f5-453e-a97a-91d521bc8685","Type":"ContainerStarted","Data":"5bf967e371334649545715bf76161d2793423124ffdcb2f8bb4948d5d033d602"}
Sep 07 14:26:43.810548 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:43.810510    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wgq9p/must-gather-n42lf" event={"ID":"8c6e76fe-c6f5-453e-a97a-91d521bc8685","Type":"ContainerStarted","Data":"ce2ce4518837032f1de6cdfc1e98b50ddcd347d4475385b92bfeca060134d1a7"}
Sep 07 14:26:43.810990 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:43.810634    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wgq9p/must-gather-n42lf" event={"ID":"8c6e76fe-c6f5-453e-a97a-91d521bc8685","Type":"ContainerStarted","Data":"a035735152b0526bacec06fb4416980cb2b5e54d6bd675a895da11c51f0b56a5"}
Sep 07 14:26:43.828817 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:43.828762    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wgq9p/must-gather-n42lf" podStartSLOduration=1.670369875 podStartE2EDuration="7.828745717s" totalImagesPullingTime="6.158375842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 14:26:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 14:26:43.827595205 +0000 UTC m=+1744.828023599" watchObservedRunningTime="2026-09-07 14:26:43.828745717 +0000 UTC m=+1744.829174110"
Sep 07 14:26:52.847206 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:52.847167    2581 generic.go:356] "Generic (PLEG): container finished" podID="8c6e76fe-c6f5-453e-a97a-91d521bc8685" containerID="a035735152b0526bacec06fb4416980cb2b5e54d6bd675a895da11c51f0b56a5" exitCode=0
Sep 07 14:26:52.847652 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:52.847239    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wgq9p/must-gather-n42lf" event={"ID":"8c6e76fe-c6f5-453e-a97a-91d521bc8685","Type":"ContainerDied","Data":"a035735152b0526bacec06fb4416980cb2b5e54d6bd675a895da11c51f0b56a5"}
Sep 07 14:26:52.847652 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:52.847558    2581 scope.go:117] "RemoveContainer" containerID="a035735152b0526bacec06fb4416980cb2b5e54d6bd675a895da11c51f0b56a5"
Sep 07 14:26:53.533223 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:53.533190    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wgq9p_must-gather-n42lf_8c6e76fe-c6f5-453e-a97a-91d521bc8685/gather/0.log"
Sep 07 14:26:54.041132 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:54.041094    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4mhhv/must-gather-g7j57"]
Sep 07 14:26:54.044345 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:54.044324    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4mhhv/must-gather-g7j57"
Sep 07 14:26:54.047066 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:54.047042    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4mhhv\"/\"kube-root-ca.crt\""
Sep 07 14:26:54.047177 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:54.047128    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4mhhv\"/\"openshift-service-ca.crt\""
Sep 07 14:26:54.047251 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:54.047237    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4mhhv\"/\"default-dockercfg-9lzk4\""
Sep 07 14:26:54.052745 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:54.052722    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4mhhv/must-gather-g7j57"]
Sep 07 14:26:54.132415 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:54.132380    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f131e071-b948-4d0c-b052-d3902d846a44-must-gather-output\") pod \"must-gather-g7j57\" (UID: \"f131e071-b948-4d0c-b052-d3902d846a44\") " pod="openshift-must-gather-4mhhv/must-gather-g7j57"
Sep 07 14:26:54.132575 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:54.132431    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgtpf\" (UniqueName: \"kubernetes.io/projected/f131e071-b948-4d0c-b052-d3902d846a44-kube-api-access-lgtpf\") pod \"must-gather-g7j57\" (UID: \"f131e071-b948-4d0c-b052-d3902d846a44\") " pod="openshift-must-gather-4mhhv/must-gather-g7j57"
Sep 07 14:26:54.233687 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:54.233648    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f131e071-b948-4d0c-b052-d3902d846a44-must-gather-output\") pod \"must-gather-g7j57\" (UID: \"f131e071-b948-4d0c-b052-d3902d846a44\") " pod="openshift-must-gather-4mhhv/must-gather-g7j57"
Sep 07 14:26:54.233784 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:54.233712    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgtpf\" (UniqueName: \"kubernetes.io/projected/f131e071-b948-4d0c-b052-d3902d846a44-kube-api-access-lgtpf\") pod \"must-gather-g7j57\" (UID: \"f131e071-b948-4d0c-b052-d3902d846a44\") " pod="openshift-must-gather-4mhhv/must-gather-g7j57"
Sep 07 14:26:54.234027 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:54.234009    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f131e071-b948-4d0c-b052-d3902d846a44-must-gather-output\") pod \"must-gather-g7j57\" (UID: \"f131e071-b948-4d0c-b052-d3902d846a44\") " pod="openshift-must-gather-4mhhv/must-gather-g7j57"
Sep 07 14:26:54.241929 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:54.241910    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgtpf\" (UniqueName: \"kubernetes.io/projected/f131e071-b948-4d0c-b052-d3902d846a44-kube-api-access-lgtpf\") pod \"must-gather-g7j57\" (UID: \"f131e071-b948-4d0c-b052-d3902d846a44\") " pod="openshift-must-gather-4mhhv/must-gather-g7j57"
Sep 07 14:26:54.353474 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:54.353441    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4mhhv/must-gather-g7j57"
Sep 07 14:26:54.625914 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:54.625826    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4mhhv/must-gather-g7j57"]
Sep 07 14:26:54.628647 ip-10-0-139-134 kubenswrapper[2581]: W0907 14:26:54.628617    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf131e071_b948_4d0c_b052_d3902d846a44.slice/crio-2984224a9d97ef366a288fedb1a5e46bd710d9b2e45ba7afb5f1e4ca6736e706 WatchSource:0}: Error finding container 2984224a9d97ef366a288fedb1a5e46bd710d9b2e45ba7afb5f1e4ca6736e706: Status 404 returned error can't find the container with id 2984224a9d97ef366a288fedb1a5e46bd710d9b2e45ba7afb5f1e4ca6736e706
Sep 07 14:26:54.857488 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:54.857451    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4mhhv/must-gather-g7j57" event={"ID":"f131e071-b948-4d0c-b052-d3902d846a44","Type":"ContainerStarted","Data":"2984224a9d97ef366a288fedb1a5e46bd710d9b2e45ba7afb5f1e4ca6736e706"}
Sep 07 14:26:55.864690 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:55.864648    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4mhhv/must-gather-g7j57" event={"ID":"f131e071-b948-4d0c-b052-d3902d846a44","Type":"ContainerStarted","Data":"f305ad72af3785a99c4a602ab7604603a64207d9157343e7b90b11ff61bf8a3d"}
Sep 07 14:26:55.865114 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:55.864704    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4mhhv/must-gather-g7j57" event={"ID":"f131e071-b948-4d0c-b052-d3902d846a44","Type":"ContainerStarted","Data":"9b6153f6bd9daeeff73e049a04df5508a2739048f24c73272f9317a00af59259"}
Sep 07 14:26:55.881696 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:55.881633    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4mhhv/must-gather-g7j57" podStartSLOduration=0.957669171 podStartE2EDuration="1.881614727s" totalImagesPullingTime="923.945556ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 14:26:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 14:26:55.880586707 +0000 UTC m=+1756.881015100" watchObservedRunningTime="2026-09-07 14:26:55.881614727 +0000 UTC m=+1756.882043121"
Sep 07 14:26:56.926997 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:56.926963    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-l6ks2_73aad428-d904-4b67-aa24-363d9a75d104/global-pull-secret-syncer/0.log"
Sep 07 14:26:57.033261 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:57.033223    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mfkdb_eb770b10-368c-4e07-b98b-bb0dc4a12a27/konnectivity-agent/0.log"
Sep 07 14:26:57.101971 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:57.101930    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-134.ec2.internal_47cc00c1a8f55722dda32e7fd4a06975/haproxy/0.log"
Sep 07 14:26:58.873481 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:58.873408    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-wgq9p/must-gather-n42lf"]
Sep 07 14:26:58.876229 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:26:58.876180    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-n42lf\" is forbidden: User \"system:node:ip-10-0-139-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wgq9p\": no relationship found between node 'ip-10-0-139-134.ec2.internal' and this object" podUID="8c6e76fe-c6f5-453e-a97a-91d521bc8685" pod="openshift-must-gather-wgq9p/must-gather-n42lf"
Sep 07 14:26:58.877032 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:58.877001    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-wgq9p/must-gather-n42lf"]
Sep 07 14:26:58.877280 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:58.877252    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-wgq9p/must-gather-n42lf" podUID="8c6e76fe-c6f5-453e-a97a-91d521bc8685" containerName="copy" containerID="cri-o://ce2ce4518837032f1de6cdfc1e98b50ddcd347d4475385b92bfeca060134d1a7" gracePeriod=2
Sep 07 14:26:59.280410 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:59.279700    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wgq9p_must-gather-n42lf_8c6e76fe-c6f5-453e-a97a-91d521bc8685/copy/0.log"
Sep 07 14:26:59.284551 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:59.284335    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wgq9p/must-gather-n42lf"
Sep 07 14:26:59.288314 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:26:59.287477    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-n42lf\" is forbidden: User \"system:node:ip-10-0-139-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wgq9p\": no relationship found between node 'ip-10-0-139-134.ec2.internal' and this object" podUID="8c6e76fe-c6f5-453e-a97a-91d521bc8685" pod="openshift-must-gather-wgq9p/must-gather-n42lf"
Sep 07 14:26:59.375683 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:59.375641    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8c6e76fe-c6f5-453e-a97a-91d521bc8685-must-gather-output\") pod \"8c6e76fe-c6f5-453e-a97a-91d521bc8685\" (UID: \"8c6e76fe-c6f5-453e-a97a-91d521bc8685\") "
Sep 07 14:26:59.375870 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:59.375732    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlfkw\" (UniqueName: \"kubernetes.io/projected/8c6e76fe-c6f5-453e-a97a-91d521bc8685-kube-api-access-jlfkw\") pod \"8c6e76fe-c6f5-453e-a97a-91d521bc8685\" (UID: \"8c6e76fe-c6f5-453e-a97a-91d521bc8685\") "
Sep 07 14:26:59.376581 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:59.376551    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c6e76fe-c6f5-453e-a97a-91d521bc8685-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "8c6e76fe-c6f5-453e-a97a-91d521bc8685" (UID: "8c6e76fe-c6f5-453e-a97a-91d521bc8685"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 14:26:59.386839 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:59.386794    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c6e76fe-c6f5-453e-a97a-91d521bc8685-kube-api-access-jlfkw" (OuterVolumeSpecName: "kube-api-access-jlfkw") pod "8c6e76fe-c6f5-453e-a97a-91d521bc8685" (UID: "8c6e76fe-c6f5-453e-a97a-91d521bc8685"). InnerVolumeSpecName "kube-api-access-jlfkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 14:26:59.477449 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:59.477353    2581 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8c6e76fe-c6f5-453e-a97a-91d521bc8685-must-gather-output\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:26:59.477449 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:59.477397    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlfkw\" (UniqueName: \"kubernetes.io/projected/8c6e76fe-c6f5-453e-a97a-91d521bc8685-kube-api-access-jlfkw\") on node \"ip-10-0-139-134.ec2.internal\" DevicePath \"\""
Sep 07 14:26:59.522214 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:26:59.522166    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-n42lf\" is forbidden: User \"system:node:ip-10-0-139-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wgq9p\": no relationship found between node 'ip-10-0-139-134.ec2.internal' and this object" podUID="8c6e76fe-c6f5-453e-a97a-91d521bc8685" pod="openshift-must-gather-wgq9p/must-gather-n42lf"
Sep 07 14:26:59.525902 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:59.525864    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c6e76fe-c6f5-453e-a97a-91d521bc8685" path="/var/lib/kubelet/pods/8c6e76fe-c6f5-453e-a97a-91d521bc8685/volumes"
Sep 07 14:26:59.889400 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:59.889360    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wgq9p_must-gather-n42lf_8c6e76fe-c6f5-453e-a97a-91d521bc8685/copy/0.log"
Sep 07 14:26:59.889992 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:59.889810    2581 generic.go:356] "Generic (PLEG): container finished" podID="8c6e76fe-c6f5-453e-a97a-91d521bc8685" containerID="ce2ce4518837032f1de6cdfc1e98b50ddcd347d4475385b92bfeca060134d1a7" exitCode=143
Sep 07 14:26:59.889992 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:59.889910    2581 scope.go:117] "RemoveContainer" containerID="ce2ce4518837032f1de6cdfc1e98b50ddcd347d4475385b92bfeca060134d1a7"
Sep 07 14:26:59.890121 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:59.890078    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wgq9p/must-gather-n42lf"
Sep 07 14:26:59.902407 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:59.902376    2581 scope.go:117] "RemoveContainer" containerID="a035735152b0526bacec06fb4416980cb2b5e54d6bd675a895da11c51f0b56a5"
Sep 07 14:26:59.925166 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:59.925137    2581 scope.go:117] "RemoveContainer" containerID="ce2ce4518837032f1de6cdfc1e98b50ddcd347d4475385b92bfeca060134d1a7"
Sep 07 14:26:59.925624 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:26:59.925589    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce2ce4518837032f1de6cdfc1e98b50ddcd347d4475385b92bfeca060134d1a7\": container with ID starting with ce2ce4518837032f1de6cdfc1e98b50ddcd347d4475385b92bfeca060134d1a7 not found: ID does not exist" containerID="ce2ce4518837032f1de6cdfc1e98b50ddcd347d4475385b92bfeca060134d1a7"
Sep 07 14:26:59.925750 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:59.925636    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce2ce4518837032f1de6cdfc1e98b50ddcd347d4475385b92bfeca060134d1a7"} err="failed to get container status \"ce2ce4518837032f1de6cdfc1e98b50ddcd347d4475385b92bfeca060134d1a7\": rpc error: code = NotFound desc = could not find container \"ce2ce4518837032f1de6cdfc1e98b50ddcd347d4475385b92bfeca060134d1a7\": container with ID starting with ce2ce4518837032f1de6cdfc1e98b50ddcd347d4475385b92bfeca060134d1a7 not found: ID does not exist"
Sep 07 14:26:59.925750 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:59.925660    2581 scope.go:117] "RemoveContainer" containerID="a035735152b0526bacec06fb4416980cb2b5e54d6bd675a895da11c51f0b56a5"
Sep 07 14:26:59.925941 ip-10-0-139-134 kubenswrapper[2581]: E0907 14:26:59.925917    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a035735152b0526bacec06fb4416980cb2b5e54d6bd675a895da11c51f0b56a5\": container with ID starting with a035735152b0526bacec06fb4416980cb2b5e54d6bd675a895da11c51f0b56a5 not found: ID does not exist" containerID="a035735152b0526bacec06fb4416980cb2b5e54d6bd675a895da11c51f0b56a5"
Sep 07 14:26:59.926004 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:26:59.925947    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a035735152b0526bacec06fb4416980cb2b5e54d6bd675a895da11c51f0b56a5"} err="failed to get container status \"a035735152b0526bacec06fb4416980cb2b5e54d6bd675a895da11c51f0b56a5\": rpc error: code = NotFound desc = could not find container \"a035735152b0526bacec06fb4416980cb2b5e54d6bd675a895da11c51f0b56a5\": container with ID starting with a035735152b0526bacec06fb4416980cb2b5e54d6bd675a895da11c51f0b56a5 not found: ID does not exist"
Sep 07 14:27:01.080985 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:01.080946    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7f9c5467b7-zr55b_0f3a5789-8dff-487a-95ea-52bcdb782875/metrics-server/0.log"
Sep 07 14:27:01.115178 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:01.115144    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-pcwvv_4dd88c76-afbd-47c3-9d1b-80386b202e95/monitoring-plugin/0.log"
Sep 07 14:27:01.156098 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:01.156059    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-btsmx_3ceb2c46-6927-46bc-a86a-f74c0ec80d41/node-exporter/0.log"
Sep 07 14:27:01.178522 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:01.178485    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-btsmx_3ceb2c46-6927-46bc-a86a-f74c0ec80d41/kube-rbac-proxy/0.log"
Sep 07 14:27:01.204832 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:01.204804    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-btsmx_3ceb2c46-6927-46bc-a86a-f74c0ec80d41/init-textfile/0.log"
Sep 07 14:27:01.678048 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:01.678013    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-hswqc_4ddba003-6ec1-469a-ad2a-42bd138f34b7/prometheus-operator/0.log"
Sep 07 14:27:01.700785 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:01.700750    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-hswqc_4ddba003-6ec1-469a-ad2a-42bd138f34b7/kube-rbac-proxy/0.log"
Sep 07 14:27:01.842454 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:01.842421    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6694465ff-8cj6w_69d6d779-9b56-4220-b354-096a66073b3a/thanos-query/0.log"
Sep 07 14:27:01.863932 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:01.863879    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6694465ff-8cj6w_69d6d779-9b56-4220-b354-096a66073b3a/kube-rbac-proxy-web/0.log"
Sep 07 14:27:01.887966 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:01.887934    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6694465ff-8cj6w_69d6d779-9b56-4220-b354-096a66073b3a/kube-rbac-proxy/0.log"
Sep 07 14:27:01.920421 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:01.920394    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6694465ff-8cj6w_69d6d779-9b56-4220-b354-096a66073b3a/prom-label-proxy/0.log"
Sep 07 14:27:01.946032 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:01.945946    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6694465ff-8cj6w_69d6d779-9b56-4220-b354-096a66073b3a/kube-rbac-proxy-rules/0.log"
Sep 07 14:27:01.971780 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:01.971737    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6694465ff-8cj6w_69d6d779-9b56-4220-b354-096a66073b3a/kube-rbac-proxy-metrics/0.log"
Sep 07 14:27:04.131169 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.131132    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-zg24k_221b3998-648e-4b69-89fb-ebd2ed7abdac/download-server/0.log"
Sep 07 14:27:04.738471 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.738432    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"]
Sep 07 14:27:04.738928 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.738909    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c6e76fe-c6f5-453e-a97a-91d521bc8685" containerName="gather"
Sep 07 14:27:04.738978 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.738933    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c6e76fe-c6f5-453e-a97a-91d521bc8685" containerName="gather"
Sep 07 14:27:04.738978 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.738957    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c6e76fe-c6f5-453e-a97a-91d521bc8685" containerName="copy"
Sep 07 14:27:04.738978 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.738966    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c6e76fe-c6f5-453e-a97a-91d521bc8685" containerName="copy"
Sep 07 14:27:04.739076 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.739030    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c6e76fe-c6f5-453e-a97a-91d521bc8685" containerName="copy"
Sep 07 14:27:04.739076 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.739041    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c6e76fe-c6f5-453e-a97a-91d521bc8685" containerName="gather"
Sep 07 14:27:04.744657 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.744628    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"
Sep 07 14:27:04.750082 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.750050    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"]
Sep 07 14:27:04.828684 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.828649    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dfcb\" (UniqueName: \"kubernetes.io/projected/1afcf800-5996-4d6f-9b47-10b5fd3dc8b0-kube-api-access-5dfcb\") pod \"perf-node-gather-daemonset-vcd7v\" (UID: \"1afcf800-5996-4d6f-9b47-10b5fd3dc8b0\") " pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"
Sep 07 14:27:04.828866 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.828714    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1afcf800-5996-4d6f-9b47-10b5fd3dc8b0-podres\") pod \"perf-node-gather-daemonset-vcd7v\" (UID: \"1afcf800-5996-4d6f-9b47-10b5fd3dc8b0\") " pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"
Sep 07 14:27:04.828866 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.828769    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1afcf800-5996-4d6f-9b47-10b5fd3dc8b0-proc\") pod \"perf-node-gather-daemonset-vcd7v\" (UID: \"1afcf800-5996-4d6f-9b47-10b5fd3dc8b0\") " pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"
Sep 07 14:27:04.828866 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.828840    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1afcf800-5996-4d6f-9b47-10b5fd3dc8b0-sys\") pod \"perf-node-gather-daemonset-vcd7v\" (UID: \"1afcf800-5996-4d6f-9b47-10b5fd3dc8b0\") " pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"
Sep 07 14:27:04.828991 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.828884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1afcf800-5996-4d6f-9b47-10b5fd3dc8b0-lib-modules\") pod \"perf-node-gather-daemonset-vcd7v\" (UID: \"1afcf800-5996-4d6f-9b47-10b5fd3dc8b0\") " pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"
Sep 07 14:27:04.929597 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.929565    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1afcf800-5996-4d6f-9b47-10b5fd3dc8b0-sys\") pod \"perf-node-gather-daemonset-vcd7v\" (UID: \"1afcf800-5996-4d6f-9b47-10b5fd3dc8b0\") " pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"
Sep 07 14:27:04.929775 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.929604    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1afcf800-5996-4d6f-9b47-10b5fd3dc8b0-lib-modules\") pod \"perf-node-gather-daemonset-vcd7v\" (UID: \"1afcf800-5996-4d6f-9b47-10b5fd3dc8b0\") " pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"
Sep 07 14:27:04.929775 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.929636    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dfcb\" (UniqueName: \"kubernetes.io/projected/1afcf800-5996-4d6f-9b47-10b5fd3dc8b0-kube-api-access-5dfcb\") pod \"perf-node-gather-daemonset-vcd7v\" (UID: \"1afcf800-5996-4d6f-9b47-10b5fd3dc8b0\") " pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"
Sep 07 14:27:04.929775 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.929691    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1afcf800-5996-4d6f-9b47-10b5fd3dc8b0-podres\") pod \"perf-node-gather-daemonset-vcd7v\" (UID: \"1afcf800-5996-4d6f-9b47-10b5fd3dc8b0\") " pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"
Sep 07 14:27:04.929775 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.929737    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1afcf800-5996-4d6f-9b47-10b5fd3dc8b0-lib-modules\") pod \"perf-node-gather-daemonset-vcd7v\" (UID: \"1afcf800-5996-4d6f-9b47-10b5fd3dc8b0\") " pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"
Sep 07 14:27:04.929775 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.929691    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1afcf800-5996-4d6f-9b47-10b5fd3dc8b0-sys\") pod \"perf-node-gather-daemonset-vcd7v\" (UID: \"1afcf800-5996-4d6f-9b47-10b5fd3dc8b0\") " pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"
Sep 07 14:27:04.929775 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.929746    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1afcf800-5996-4d6f-9b47-10b5fd3dc8b0-proc\") pod \"perf-node-gather-daemonset-vcd7v\" (UID: \"1afcf800-5996-4d6f-9b47-10b5fd3dc8b0\") " pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"
Sep 07 14:27:04.929775 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.929772    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1afcf800-5996-4d6f-9b47-10b5fd3dc8b0-podres\") pod \"perf-node-gather-daemonset-vcd7v\" (UID: \"1afcf800-5996-4d6f-9b47-10b5fd3dc8b0\") " pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"
Sep 07 14:27:04.930030 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.929787    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1afcf800-5996-4d6f-9b47-10b5fd3dc8b0-proc\") pod \"perf-node-gather-daemonset-vcd7v\" (UID: \"1afcf800-5996-4d6f-9b47-10b5fd3dc8b0\") " pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"
Sep 07 14:27:04.939685 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:04.939651    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dfcb\" (UniqueName: \"kubernetes.io/projected/1afcf800-5996-4d6f-9b47-10b5fd3dc8b0-kube-api-access-5dfcb\") pod \"perf-node-gather-daemonset-vcd7v\" (UID: \"1afcf800-5996-4d6f-9b47-10b5fd3dc8b0\") " pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"
Sep 07 14:27:05.058012 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:05.057930    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"
Sep 07 14:27:05.337921 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:05.337885    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"]
Sep 07 14:27:05.344869 ip-10-0-139-134 kubenswrapper[2581]: W0907 14:27:05.344837    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1afcf800_5996_4d6f_9b47_10b5fd3dc8b0.slice/crio-e0bd2a2fae0c34fedb0f2da9d5cc1f1de2d527a45f79116ddfb3b414175f1af2 WatchSource:0}: Error finding container e0bd2a2fae0c34fedb0f2da9d5cc1f1de2d527a45f79116ddfb3b414175f1af2: Status 404 returned error can't find the container with id e0bd2a2fae0c34fedb0f2da9d5cc1f1de2d527a45f79116ddfb3b414175f1af2
Sep 07 14:27:05.513945 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:05.513921    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9qh6w_69fd2a51-3aad-48e2-938e-7bc82deab21a/dns/0.log"
Sep 07 14:27:05.534253 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:05.534217    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9qh6w_69fd2a51-3aad-48e2-938e-7bc82deab21a/kube-rbac-proxy/0.log"
Sep 07 14:27:05.643534 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:05.643451    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mwtrw_6e1fe657-72f7-49a7-ad98-1adb910682be/dns-node-resolver/0.log"
Sep 07 14:27:05.929813 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:05.929729    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v" event={"ID":"1afcf800-5996-4d6f-9b47-10b5fd3dc8b0","Type":"ContainerStarted","Data":"28439e1e501d66a1a3a356a341f2e68a966cfef2eec326bdf497658cca58ffac"}
Sep 07 14:27:05.929813 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:05.929793    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v" event={"ID":"1afcf800-5996-4d6f-9b47-10b5fd3dc8b0","Type":"ContainerStarted","Data":"e0bd2a2fae0c34fedb0f2da9d5cc1f1de2d527a45f79116ddfb3b414175f1af2"}
Sep 07 14:27:05.930126 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:05.929825    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"
Sep 07 14:27:05.946943 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:05.946878    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v" podStartSLOduration=1.946857057 podStartE2EDuration="1.946857057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 14:27:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 14:27:05.946152942 +0000 UTC m=+1766.946581338" watchObservedRunningTime="2026-09-07 14:27:05.946857057 +0000 UTC m=+1766.947285451"
Sep 07 14:27:06.055380 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:06.055349    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-44mrd_80593104-b03b-4e55-9146-02b5f0f94c9b/node-ca/0.log"
Sep 07 14:27:07.218101 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:07.218066    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sxmvt_39e32f83-7ada-441f-ae68-282d20bb4698/serve-healthcheck-canary/0.log"
Sep 07 14:27:07.559947 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:07.559847    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-br4lq_270f9ec5-070f-46ba-bc25-ef02408c53a5/insights-operator/0.log"
Sep 07 14:27:07.560552 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:07.560515    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-br4lq_270f9ec5-070f-46ba-bc25-ef02408c53a5/insights-operator/1.log"
Sep 07 14:27:07.581136 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:07.581109    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gplqp_7e716e19-8ce8-4865-ad0d-612bb4b7d6bd/kube-rbac-proxy/0.log"
Sep 07 14:27:07.600997 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:07.600971    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gplqp_7e716e19-8ce8-4865-ad0d-612bb4b7d6bd/exporter/0.log"
Sep 07 14:27:07.621845 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:07.621813    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gplqp_7e716e19-8ce8-4865-ad0d-612bb4b7d6bd/extractor/0.log"
Sep 07 14:27:11.943631 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:11.943600    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4mhhv/perf-node-gather-daemonset-vcd7v"
Sep 07 14:27:12.147928 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:12.147893    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-stcr2_465c83e0-d454-4446-8f6a-360687eff180/kube-storage-version-migrator-operator/1.log"
Sep 07 14:27:12.149591 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:12.149562    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-stcr2_465c83e0-d454-4446-8f6a-360687eff180/kube-storage-version-migrator-operator/0.log"
Sep 07 14:27:13.059882 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:13.059854    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6lwhm_2826663e-857c-488f-8102-0845b2f46709/kube-multus-additional-cni-plugins/0.log"
Sep 07 14:27:13.084614 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:13.084579    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6lwhm_2826663e-857c-488f-8102-0845b2f46709/egress-router-binary-copy/0.log"
Sep 07 14:27:13.107282 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:13.107249    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6lwhm_2826663e-857c-488f-8102-0845b2f46709/cni-plugins/0.log"
Sep 07 14:27:13.128585 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:13.128552    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6lwhm_2826663e-857c-488f-8102-0845b2f46709/bond-cni-plugin/0.log"
Sep 07 14:27:13.149093 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:13.149056    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6lwhm_2826663e-857c-488f-8102-0845b2f46709/routeoverride-cni/0.log"
Sep 07 14:27:13.172563 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:13.172531    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6lwhm_2826663e-857c-488f-8102-0845b2f46709/whereabouts-cni-bincopy/0.log"
Sep 07 14:27:13.197503 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:13.197473    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6lwhm_2826663e-857c-488f-8102-0845b2f46709/whereabouts-cni/0.log"
Sep 07 14:27:13.635690 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:13.635655    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kqfcv_d7c1dfc5-6f69-4094-8899-8762438becac/kube-multus/0.log"
Sep 07 14:27:13.758627 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:13.758539    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z7zzr_f487c012-9aff-45d1-af45-3dd071a10e2e/network-metrics-daemon/0.log"
Sep 07 14:27:13.782071 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:13.782037    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z7zzr_f487c012-9aff-45d1-af45-3dd071a10e2e/kube-rbac-proxy/0.log"
Sep 07 14:27:14.565170 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:14.565087    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4qnph_f4e085e4-1e00-4e03-ac87-cdf6155e0f83/ovn-controller/0.log"
Sep 07 14:27:14.584935 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:14.584905    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4qnph_f4e085e4-1e00-4e03-ac87-cdf6155e0f83/ovn-acl-logging/0.log"
Sep 07 14:27:14.611112 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:14.611083    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4qnph_f4e085e4-1e00-4e03-ac87-cdf6155e0f83/kube-rbac-proxy-node/0.log"
Sep 07 14:27:14.636310 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:14.636269    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4qnph_f4e085e4-1e00-4e03-ac87-cdf6155e0f83/kube-rbac-proxy-ovn-metrics/0.log"
Sep 07 14:27:14.655250 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:14.655221    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4qnph_f4e085e4-1e00-4e03-ac87-cdf6155e0f83/northd/0.log"
Sep 07 14:27:14.675827 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:14.675800    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4qnph_f4e085e4-1e00-4e03-ac87-cdf6155e0f83/nbdb/0.log"
Sep 07 14:27:14.703283 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:14.703256    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4qnph_f4e085e4-1e00-4e03-ac87-cdf6155e0f83/sbdb/0.log"
Sep 07 14:27:14.763453 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:14.763417    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4qnph_f4e085e4-1e00-4e03-ac87-cdf6155e0f83/ovnkube-controller/0.log"
Sep 07 14:27:16.154795 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:16.154759    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-685456655f-b7xvd_aa9e9b9c-ad3f-465c-b0b9-68045c26e9fe/check-endpoints/0.log"
Sep 07 14:27:16.202226 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:16.202144    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-l6hnr_4016228e-6351-475d-a718-c2ff55edbfee/network-check-target-container/0.log"
Sep 07 14:27:17.107367 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:17.107335    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-wdc79_238e154a-f3f9-49f4-a251-93d41a3b2bdc/iptables-alerter/0.log"
Sep 07 14:27:17.836060 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:17.836021    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-mdmtf_a2a37b6d-e2bf-4db5-829b-f2d41f9f4b7d/tuned/0.log"
Sep 07 14:27:19.538515 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:19.538474    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-vkrjq_6e40a3b4-79fd-4e21-962d-d989ab5c78f2/cluster-samples-operator/0.log"
Sep 07 14:27:19.555742 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:19.555709    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-vkrjq_6e40a3b4-79fd-4e21-962d-d989ab5c78f2/cluster-samples-operator-watch/0.log"
Sep 07 14:27:20.503720 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:20.503683    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-859f94c4b-lfgqm_cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4/service-ca-operator/1.log"
Sep 07 14:27:20.505425 ip-10-0-139-134 kubenswrapper[2581]: I0907 14:27:20.505399    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-859f94c4b-lfgqm_cacbc5ee-3f48-4e09-a4a2-1a5f45d69ae4/service-ca-operator/0.log"