Sep 15 07:50:47.098923 ip-10-0-134-189 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 07:50:47.518262 ip-10-0-134-189 kubenswrapper[2586]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 07:50:47.518262 ip-10-0-134-189 kubenswrapper[2586]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 07:50:47.518262 ip-10-0-134-189 kubenswrapper[2586]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 07:50:47.518262 ip-10-0-134-189 kubenswrapper[2586]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 07:50:47.518262 ip-10-0-134-189 kubenswrapper[2586]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 07:50:47.520136 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.520045    2586 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 07:50:47.525231 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525215    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 07:50:47.525231 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525231    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 07:50:47.525296 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525235    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 07:50:47.525296 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525239    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 07:50:47.525296 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525243    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 07:50:47.525296 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525247    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 07:50:47.525296 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525250    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 07:50:47.525296 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525253    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 07:50:47.525296 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525256    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 07:50:47.525296 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525259    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 07:50:47.525296 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525262    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 07:50:47.525296 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525264    2586 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 07:50:47.525296 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525267    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 07:50:47.525296 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525270    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 07:50:47.525296 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525273    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 07:50:47.525296 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525275    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 07:50:47.525296 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525279    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 07:50:47.525296 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525281    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 07:50:47.525296 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525284    2586 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 07:50:47.525296 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525286    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 07:50:47.525296 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525290    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 07:50:47.525296 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525292    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 07:50:47.525791 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525295    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 07:50:47.525791 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525298    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 07:50:47.525791 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525301    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 07:50:47.525791 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525306    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 07:50:47.525791 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525309    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 07:50:47.525791 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525312    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 07:50:47.525791 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525315    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 07:50:47.525791 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525318    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 07:50:47.525791 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525321    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 07:50:47.525791 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525323    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 07:50:47.525791 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525326    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 07:50:47.525791 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525329    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 07:50:47.525791 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525333    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 07:50:47.525791 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525336    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 07:50:47.525791 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525338    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 07:50:47.525791 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525341    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 07:50:47.525791 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525344    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 07:50:47.525791 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525347    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 07:50:47.525791 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525350    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 07:50:47.526257 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525353    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 07:50:47.526257 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525355    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 07:50:47.526257 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525358    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 07:50:47.526257 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525361    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 07:50:47.526257 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525364    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 07:50:47.526257 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525367    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 07:50:47.526257 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525370    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 07:50:47.526257 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525373    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 07:50:47.526257 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525376    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 07:50:47.526257 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525379    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 07:50:47.526257 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525382    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 07:50:47.526257 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525384    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 07:50:47.526257 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525387    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 07:50:47.526257 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525390    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 07:50:47.526257 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525393    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 07:50:47.526257 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525395    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 07:50:47.526257 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525398    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 07:50:47.526257 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525401    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 07:50:47.526257 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525403    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 07:50:47.526257 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525406    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 07:50:47.526764 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525408    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 07:50:47.526764 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525411    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 07:50:47.526764 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525413    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 07:50:47.526764 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525416    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 07:50:47.526764 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525418    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 07:50:47.526764 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525421    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 07:50:47.526764 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525423    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 07:50:47.526764 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525426    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 07:50:47.526764 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525428    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 07:50:47.526764 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525431    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 07:50:47.526764 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525434    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 07:50:47.526764 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525437    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 07:50:47.526764 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525439    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 07:50:47.526764 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525442    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 07:50:47.526764 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525444    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 07:50:47.526764 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525447    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 07:50:47.526764 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525449    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 07:50:47.526764 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525452    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 07:50:47.526764 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525455    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 07:50:47.526764 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525457    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 07:50:47.527237 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525460    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 07:50:47.527237 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525463    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 07:50:47.527237 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525465    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 07:50:47.527237 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525468    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 07:50:47.527237 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525470    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 07:50:47.527237 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525475    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 07:50:47.527237 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525479    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 07:50:47.527237 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525481    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 07:50:47.527237 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525484    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 07:50:47.527237 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525486    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 07:50:47.527237 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525489    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 07:50:47.527237 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525491    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 07:50:47.527237 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525494    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 07:50:47.527237 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525496    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 07:50:47.527237 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525499    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 07:50:47.527237 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525501    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 07:50:47.527237 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525504    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 07:50:47.527237 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.525507    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 07:50:47.527237 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526221    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 07:50:47.527698 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526228    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 07:50:47.527698 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526232    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 07:50:47.527698 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526235    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 07:50:47.527698 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526238    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 07:50:47.527698 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526242    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 07:50:47.527698 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526245    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 07:50:47.527698 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526248    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 07:50:47.527698 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526251    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 07:50:47.527698 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526254    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 07:50:47.527698 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526257    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 07:50:47.527698 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526260    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 07:50:47.527698 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526263    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 07:50:47.527698 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526266    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 07:50:47.527698 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526269    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 07:50:47.527698 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526272    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 07:50:47.527698 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526276    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 07:50:47.527698 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526280    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 07:50:47.527698 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526283    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 07:50:47.527698 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526286    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 07:50:47.527698 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526288    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 07:50:47.528212 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526291    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 07:50:47.528212 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526294    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 07:50:47.528212 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526297    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 07:50:47.528212 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526299    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 07:50:47.528212 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526302    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 07:50:47.528212 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526304    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 07:50:47.528212 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526307    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 07:50:47.528212 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526309    2586 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 07:50:47.528212 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526312    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 07:50:47.528212 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526314    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 07:50:47.528212 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526317    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 07:50:47.528212 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526319    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 07:50:47.528212 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526322    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 07:50:47.528212 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526324    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 07:50:47.528212 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526326    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 07:50:47.528212 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526329    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 07:50:47.528212 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526331    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 07:50:47.528212 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526335    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 07:50:47.528212 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526337    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 07:50:47.528212 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526340    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 07:50:47.528726 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526343    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 07:50:47.528726 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526345    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 07:50:47.528726 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526348    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 07:50:47.528726 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526351    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 07:50:47.528726 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526354    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 07:50:47.528726 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526358    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 07:50:47.528726 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526360    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 07:50:47.528726 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526364    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 07:50:47.528726 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526367    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 07:50:47.528726 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526370    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 07:50:47.528726 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526372    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 07:50:47.528726 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526375    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 07:50:47.528726 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526377    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 07:50:47.528726 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526380    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 07:50:47.528726 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526382    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 07:50:47.528726 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526384    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 07:50:47.528726 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526387    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 07:50:47.528726 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526389    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 07:50:47.528726 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526392    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 07:50:47.528726 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526395    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 07:50:47.529233 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526397    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 07:50:47.529233 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526400    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 07:50:47.529233 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526402    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 07:50:47.529233 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526405    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 07:50:47.529233 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526407    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 07:50:47.529233 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526410    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 07:50:47.529233 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526412    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 07:50:47.529233 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526415    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 07:50:47.529233 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526420    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 07:50:47.529233 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526423    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 07:50:47.529233 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526427    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 07:50:47.529233 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526429    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 07:50:47.529233 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526432    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 07:50:47.529233 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526434    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 07:50:47.529233 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526438    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 07:50:47.529233 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526440    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 07:50:47.529233 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526443    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 07:50:47.529233 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526446    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 07:50:47.529233 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526448    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 07:50:47.529820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526451    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 07:50:47.529820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526454    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 07:50:47.529820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526456    2586 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 07:50:47.529820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526459    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 07:50:47.529820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526461    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 07:50:47.529820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526464    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 07:50:47.529820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526466    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 07:50:47.529820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526469    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 07:50:47.529820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526471    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 07:50:47.529820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526475    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 07:50:47.529820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526478    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 07:50:47.529820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526482    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 07:50:47.529820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526484    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 07:50:47.529820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526487    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 07:50:47.529820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526490    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 07:50:47.529820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526493    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 07:50:47.529820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526495    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 07:50:47.529820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526498    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 07:50:47.529820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526500    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 07:50:47.529820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526877    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 07:50:47.530320 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526882    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 07:50:47.530320 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526885    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 07:50:47.530320 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526888    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 07:50:47.530320 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526891    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 07:50:47.530320 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526894    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 07:50:47.530320 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526897    2586 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 07:50:47.530320 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526899    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 07:50:47.530320 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526902    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 07:50:47.530320 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526905    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 07:50:47.530320 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526908    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 07:50:47.530320 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526910    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 07:50:47.530320 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526913    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 07:50:47.530320 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526915    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 07:50:47.530320 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526918    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 07:50:47.530320 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526921    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 07:50:47.530320 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526923    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 07:50:47.530320 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526925    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 07:50:47.530320 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526928    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 07:50:47.530320 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526930    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 07:50:47.530320 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526933    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 07:50:47.530856 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526935    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 07:50:47.530856 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526938    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 07:50:47.530856 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526940    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 07:50:47.530856 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526943    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 07:50:47.530856 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526945    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 07:50:47.530856 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526947    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 07:50:47.530856 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526950    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 07:50:47.530856 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526952    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 07:50:47.530856 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526955    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 07:50:47.530856 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526957    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 07:50:47.530856 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526960    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 07:50:47.530856 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526962    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 07:50:47.530856 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526966    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 07:50:47.530856 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526970    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 07:50:47.530856 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526973    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 07:50:47.530856 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526976    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 07:50:47.530856 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526979    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 07:50:47.530856 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526982    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 07:50:47.530856 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526985    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 07:50:47.531323 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526987    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 07:50:47.531323 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526990    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 07:50:47.531323 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526992    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 07:50:47.531323 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526996    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 07:50:47.531323 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.526998    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 07:50:47.531323 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527000    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 07:50:47.531323 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527003    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 07:50:47.531323 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527005    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 07:50:47.531323 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527008    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 07:50:47.531323 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527011    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 07:50:47.531323 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527015    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 07:50:47.531323 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527018    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 07:50:47.531323 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527021    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 07:50:47.531323 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527024    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 07:50:47.531323 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527027    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 07:50:47.531323 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527031    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 07:50:47.531323 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527033    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 07:50:47.531323 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527036    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 07:50:47.531323 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527038    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 07:50:47.531820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527041    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 07:50:47.531820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527044    2586 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 07:50:47.531820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527047    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 07:50:47.531820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527050    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 07:50:47.531820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527053    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 07:50:47.531820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527055    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 07:50:47.531820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527058    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 07:50:47.531820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527061    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 07:50:47.531820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527063    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 07:50:47.531820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527065    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 07:50:47.531820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527068    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 07:50:47.531820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527071    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 07:50:47.531820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527074    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 07:50:47.531820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527076    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 07:50:47.531820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527079    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 07:50:47.531820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527081    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 07:50:47.531820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527084    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 07:50:47.531820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527087    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 07:50:47.531820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527090    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 07:50:47.531820 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527092    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 07:50:47.532353 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527095    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 07:50:47.532353 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527097    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 07:50:47.532353 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527100    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 07:50:47.532353 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527102    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 07:50:47.532353 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527104    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 07:50:47.532353 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527107    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 07:50:47.532353 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527109    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 07:50:47.532353 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527112    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 07:50:47.532353 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527117    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 07:50:47.532353 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527119    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 07:50:47.532353 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527122    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 07:50:47.532353 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527124    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 07:50:47.532353 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527127    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 07:50:47.532353 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527131    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 07:50:47.532353 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527134    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 07:50:47.532353 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527136    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 07:50:47.532353 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527139    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 07:50:47.532353 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527142    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 07:50:47.532353 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527145    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 07:50:47.532353 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527147    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527221    2586 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527255    2586 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527263    2586 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527267    2586 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527272    2586 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527276    2586 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527280    2586 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527284    2586 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527288    2586 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527291    2586 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527294    2586 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527298    2586 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527301    2586 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527304    2586 flags.go:64] FLAG: --cgroup-root=""
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527307    2586 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527310    2586 flags.go:64] FLAG: --client-ca-file=""
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527313    2586 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527315    2586 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527319    2586 flags.go:64] FLAG: --cluster-domain=""
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527322    2586 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527327    2586 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527330    2586 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527334    2586 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 07:50:47.532859 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527337    2586 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527340    2586 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527343    2586 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527347    2586 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527350    2586 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527353    2586 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527356    2586 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527359    2586 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527362    2586 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527366    2586 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527369    2586 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527372    2586 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527375    2586 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527377    2586 flags.go:64] FLAG: --enable-server="true"
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527381    2586 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527385    2586 flags.go:64] FLAG: --event-burst="100"
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527388    2586 flags.go:64] FLAG: --event-qps="50"
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527391    2586 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527394    2586 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527397    2586 flags.go:64] FLAG: --eviction-hard=""
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527400    2586 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527403    2586 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527406    2586 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527409    2586 flags.go:64] FLAG: --eviction-soft=""
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527412    2586 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 07:50:47.533455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527415    2586 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527418    2586 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527420    2586 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527423    2586 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527429    2586 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527432    2586 flags.go:64] FLAG: --feature-gates=""
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527436    2586 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527439    2586 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527442    2586 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527445    2586 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527450    2586 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527453    2586 flags.go:64] FLAG: --help="false"
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527456    2586 flags.go:64] FLAG: --hostname-override="ip-10-0-134-189.ec2.internal"
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527459    2586 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527462    2586 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527465    2586 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527468    2586 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527472    2586 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527475    2586 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527478    2586 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527481    2586 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527483    2586 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527487    2586 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527490    2586 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 07:50:47.534115 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527493    2586 flags.go:64] FLAG: --kube-reserved=""
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527496    2586 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527499    2586 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527502    2586 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527504    2586 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527507    2586 flags.go:64] FLAG: --lock-file=""
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527510    2586 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527513    2586 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527515    2586 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527521    2586 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527523    2586 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527526    2586 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527530    2586 flags.go:64] FLAG: --logging-format="text"
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527533    2586 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527536    2586 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527539    2586 flags.go:64] FLAG: --manifest-url=""
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527542    2586 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527547    2586 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527552    2586 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527556    2586 flags.go:64] FLAG: --max-pods="110"
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527559    2586 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527562    2586 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527565    2586 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527568    2586 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527571    2586 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 07:50:47.534711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527574    2586 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527577    2586 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527583    2586 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527586    2586 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527589    2586 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527592    2586 flags.go:64] FLAG: --pod-cidr=""
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527595    2586 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527601    2586 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527603    2586 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527607    2586 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527609    2586 flags.go:64] FLAG: --port="10250"
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527612    2586 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527615    2586 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-053d35efa14b3d602"
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527618    2586 flags.go:64] FLAG: --qos-reserved=""
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527621    2586 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527624    2586 flags.go:64] FLAG: --register-node="true"
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527627    2586 flags.go:64] FLAG: --register-with-taints=""
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527658    2586 flags.go:64] FLAG: --registry-burst="10"
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527661    2586 flags.go:64] FLAG: --registry-qps="5"
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527664    2586 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527669    2586 flags.go:64] FLAG: --reserved-memory=""
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527673    2586 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527676    2586 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527679    2586 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527682    2586 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 07:50:47.535320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527686    2586 flags.go:64] FLAG: --runonce="false"
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527689    2586 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527692    2586 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527695    2586 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527698    2586 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527701    2586 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527704    2586 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527707    2586 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527710    2586 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527713    2586 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527716    2586 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527719    2586 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527721    2586 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527724    2586 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527728    2586 flags.go:64] FLAG: --system-cgroups=""
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527731    2586 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527737    2586 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527740    2586 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527742    2586 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527747    2586 flags.go:64] FLAG: --tls-min-version=""
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527750    2586 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527753    2586 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527756    2586 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527759    2586 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527761    2586 flags.go:64] FLAG: --v="2"
Sep 15 07:50:47.536051 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527773    2586 flags.go:64] FLAG: --version="false"
Sep 15 07:50:47.536685 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527778    2586 flags.go:64] FLAG: --vmodule=""
Sep 15 07:50:47.536685 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527783    2586 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 07:50:47.536685 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.527786    2586 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 07:50:47.536685 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527900    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 07:50:47.536685 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527904    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 07:50:47.536685 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527907    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 07:50:47.536685 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527911    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 07:50:47.536685 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527914    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 07:50:47.536685 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527917    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 07:50:47.536685 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527920    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 07:50:47.536685 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527922    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 07:50:47.536685 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527925    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 07:50:47.536685 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527928    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 07:50:47.536685 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527931    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 07:50:47.536685 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527933    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 07:50:47.536685 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527936    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 07:50:47.536685 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527938    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 07:50:47.536685 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527941    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 07:50:47.536685 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527944    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 07:50:47.536685 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527946    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 07:50:47.537189 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527949    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 07:50:47.537189 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527952    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 07:50:47.537189 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527955    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 07:50:47.537189 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527959    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 07:50:47.537189 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527962    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 07:50:47.537189 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527965    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 07:50:47.537189 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527968    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 07:50:47.537189 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527971    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 07:50:47.537189 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527974    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 07:50:47.537189 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527977    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 07:50:47.537189 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527980    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 07:50:47.537189 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527983    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 07:50:47.537189 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527985    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 07:50:47.537189 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527989    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 07:50:47.537189 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527992    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 07:50:47.537189 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527995    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 07:50:47.537189 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.527997    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 07:50:47.537189 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528000    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 07:50:47.537189 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528004    2586 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 07:50:47.537189 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528006    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 07:50:47.537695 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528009    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 07:50:47.537695 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528011    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 07:50:47.537695 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528014    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 07:50:47.537695 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528017    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 07:50:47.537695 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528020    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 07:50:47.537695 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528022    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 07:50:47.537695 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528024    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 07:50:47.537695 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528027    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 07:50:47.537695 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528030    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 07:50:47.537695 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528032    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 07:50:47.537695 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528035    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 07:50:47.537695 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528037    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 07:50:47.537695 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528040    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 07:50:47.537695 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528042    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 07:50:47.537695 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528045    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 07:50:47.537695 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528048    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 07:50:47.537695 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528050    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 07:50:47.537695 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528053    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 07:50:47.537695 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528055    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 07:50:47.537695 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528058    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 07:50:47.538194 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528060    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 07:50:47.538194 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528063    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 07:50:47.538194 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528066    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 07:50:47.538194 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528068    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 07:50:47.538194 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528071    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 07:50:47.538194 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528075    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 07:50:47.538194 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528079    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 07:50:47.538194 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528082    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 07:50:47.538194 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528085    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 07:50:47.538194 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528088    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 07:50:47.538194 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528092    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 07:50:47.538194 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528095    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 07:50:47.538194 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528097    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 07:50:47.538194 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528100    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 07:50:47.538194 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528103    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 07:50:47.538194 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528105    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 07:50:47.538194 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528108    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 07:50:47.538194 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528111    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 07:50:47.538194 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528113    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 07:50:47.538661 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528116    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 07:50:47.538661 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528119    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 07:50:47.538661 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528121    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 07:50:47.538661 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528124    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 07:50:47.538661 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528127    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 07:50:47.538661 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528129    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 07:50:47.538661 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528132    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 07:50:47.538661 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528134    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 07:50:47.538661 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528138    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 07:50:47.538661 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528140    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 07:50:47.538661 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528143    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 07:50:47.538661 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528146    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 07:50:47.538661 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528148    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 07:50:47.538661 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528151    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 07:50:47.538661 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528154    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 07:50:47.538661 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528156    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 07:50:47.538661 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528159    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 07:50:47.538661 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528161    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 07:50:47.538661 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528165    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 07:50:47.538661 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528167    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 07:50:47.539154 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528170    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 07:50:47.539154 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528173    2586 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 07:50:47.539154 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.528176    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 07:50:47.539154 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.528991    2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 07:50:47.539154 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.536526    2586 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 07:50:47.539154 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.536540    2586 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 07:50:47.539154 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.536558    2586 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 07:50:47.539154 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.536564    2586 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 07:50:47.539154 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536618    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 07:50:47.539154 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536622    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 07:50:47.539154 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536625    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 07:50:47.539154 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536643    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 07:50:47.539154 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536648    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 07:50:47.539154 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536651    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 07:50:47.539154 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536654    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 07:50:47.539573 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536656    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 07:50:47.539573 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536659    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 07:50:47.539573 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536662    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 07:50:47.539573 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536664    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 07:50:47.539573 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536668    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 07:50:47.539573 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536671    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 07:50:47.539573 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536674    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 07:50:47.539573 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536677    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 07:50:47.539573 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536680    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 07:50:47.539573 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536682    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 07:50:47.539573 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536685    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 07:50:47.539573 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536688    2586 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 07:50:47.539573 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536691    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 07:50:47.539573 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536694    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 07:50:47.539573 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536696    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 07:50:47.539573 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536699    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 07:50:47.539573 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536701    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 07:50:47.539573 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536704    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 07:50:47.539573 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536706    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 07:50:47.539573 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536709    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 07:50:47.540155 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536711    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 07:50:47.540155 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536714    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 07:50:47.540155 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536717    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 07:50:47.540155 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536720    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 07:50:47.540155 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536723    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 07:50:47.540155 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536726    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 07:50:47.540155 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536729    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 07:50:47.540155 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536731    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 07:50:47.540155 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536734    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 07:50:47.540155 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536736    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 07:50:47.540155 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536739    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 07:50:47.540155 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536741    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 07:50:47.540155 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536744    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 07:50:47.540155 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536747    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 07:50:47.540155 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536750    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 07:50:47.540155 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536752    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 07:50:47.540155 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536755    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 07:50:47.540155 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536757    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 07:50:47.540155 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536761    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 07:50:47.540155 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536764    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 07:50:47.540665 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536766    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 07:50:47.540665 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536769    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 07:50:47.540665 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536771    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 07:50:47.540665 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536774    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 07:50:47.540665 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536777    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 07:50:47.540665 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536779    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 07:50:47.540665 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536782    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 07:50:47.540665 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536785    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 07:50:47.540665 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536787    2586 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 07:50:47.540665 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536790    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 07:50:47.540665 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536792    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 07:50:47.540665 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536795    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 07:50:47.540665 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536797    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 07:50:47.540665 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536801    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 07:50:47.540665 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536804    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 07:50:47.540665 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536807    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 07:50:47.540665 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536809    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 07:50:47.540665 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536812    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 07:50:47.540665 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536815    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 07:50:47.540665 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536818    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 07:50:47.541163 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536820    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 07:50:47.541163 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536823    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 07:50:47.541163 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536825    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 07:50:47.541163 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536829    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 07:50:47.541163 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536833    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 07:50:47.541163 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536849    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 07:50:47.541163 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536854    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 07:50:47.541163 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536858    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 07:50:47.541163 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536861    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 07:50:47.541163 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536864    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 07:50:47.541163 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536867    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 07:50:47.541163 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536870    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 07:50:47.541163 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536873    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 07:50:47.541163 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536876    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 07:50:47.541163 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536880    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 07:50:47.541163 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536884    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 07:50:47.541163 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536887    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 07:50:47.541163 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536890    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 07:50:47.541595 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536892    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 07:50:47.541595 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536895    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 07:50:47.541595 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536898    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 07:50:47.541595 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536901    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 07:50:47.541595 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536903    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 07:50:47.541595 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536906    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 07:50:47.541595 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536908    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 07:50:47.541595 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536911    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 07:50:47.541595 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536915    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 07:50:47.541595 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536917    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 07:50:47.541595 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536920    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 07:50:47.541595 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536922    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 07:50:47.541595 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536925    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 07:50:47.541595 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.536928    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 07:50:47.541967 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.536933    2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 07:50:47.541967 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537048    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 07:50:47.541967 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537052    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 07:50:47.541967 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537055    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 07:50:47.541967 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537058    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 07:50:47.541967 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537060    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 07:50:47.541967 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537063    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 07:50:47.541967 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537066    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 07:50:47.541967 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537068    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 07:50:47.541967 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537072    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 07:50:47.541967 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537074    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 07:50:47.541967 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537077    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 07:50:47.541967 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537080    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 07:50:47.541967 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537082    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 07:50:47.541967 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537085    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 07:50:47.542336 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537088    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 07:50:47.542336 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537090    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 07:50:47.542336 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537093    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 07:50:47.542336 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537095    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 07:50:47.542336 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537098    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 07:50:47.542336 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537100    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 07:50:47.542336 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537103    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 07:50:47.542336 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537105    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 07:50:47.542336 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537107    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 07:50:47.542336 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537110    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 07:50:47.542336 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537113    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 07:50:47.542336 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537116    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 07:50:47.542336 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537119    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 07:50:47.542336 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537121    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 07:50:47.542336 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537124    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 07:50:47.542336 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537126    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 07:50:47.542336 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537129    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 07:50:47.542336 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537131    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 07:50:47.542336 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537134    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 07:50:47.542336 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537136    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 07:50:47.542835 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537139    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 07:50:47.542835 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537142    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 07:50:47.542835 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537144    2586 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 07:50:47.542835 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537147    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 07:50:47.542835 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537149    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 07:50:47.542835 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537152    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 07:50:47.542835 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537154    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 07:50:47.542835 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537157    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 07:50:47.542835 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537159    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 07:50:47.542835 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537162    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 07:50:47.542835 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537165    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 07:50:47.542835 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537167    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 07:50:47.542835 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537170    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 07:50:47.542835 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537172    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 07:50:47.542835 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537175    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 07:50:47.542835 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537177    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 07:50:47.542835 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537181    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 07:50:47.542835 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537185    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 07:50:47.542835 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537187    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 07:50:47.542835 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537190    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 07:50:47.543324 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537193    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 07:50:47.543324 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537195    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 07:50:47.543324 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537199    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 07:50:47.543324 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537201    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 07:50:47.543324 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537204    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 07:50:47.543324 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537207    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 07:50:47.543324 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537209    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 07:50:47.543324 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537212    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 07:50:47.543324 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537215    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 07:50:47.543324 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537217    2586 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 07:50:47.543324 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537220    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 07:50:47.543324 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537222    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 07:50:47.543324 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537225    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 07:50:47.543324 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537227    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 07:50:47.543324 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537230    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 07:50:47.543324 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537232    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 07:50:47.543324 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537235    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 07:50:47.543324 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537237    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 07:50:47.543324 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537240    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 07:50:47.543324 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537242    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 07:50:47.543865 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537244    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 07:50:47.543865 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537247    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 07:50:47.543865 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537249    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 07:50:47.543865 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537252    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 07:50:47.543865 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537255    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 07:50:47.543865 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537257    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 07:50:47.543865 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537260    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 07:50:47.543865 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537262    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 07:50:47.543865 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537266    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 07:50:47.543865 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537269    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 07:50:47.543865 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537272    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 07:50:47.543865 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537275    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 07:50:47.543865 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537278    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 07:50:47.543865 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537280    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 07:50:47.543865 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537283    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 07:50:47.543865 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537286    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 07:50:47.543865 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537288    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 07:50:47.543865 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537291    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 07:50:47.543865 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537293    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 07:50:47.544450 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537296    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 07:50:47.544450 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537300    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 07:50:47.544450 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537303    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 07:50:47.544450 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537306    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 07:50:47.544450 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537309    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 07:50:47.544450 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:47.537311    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 07:50:47.544450 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.537317    2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 07:50:47.544450 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.537408    2586 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 07:50:47.544450 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.539873    2586 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 07:50:47.544450 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.540914    2586 server.go:1019] "Starting client certificate rotation"
Sep 15 07:50:47.544450 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.541022    2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 07:50:47.544450 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.541064    2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 07:50:47.544450 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.544309    2586 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 07:50:47.552043 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.552025    2586 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 07:50:47.564175 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.564144    2586 log.go:25] "Validated CRI v1 runtime API"
Sep 15 07:50:47.567525 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.567512    2586 log.go:25] "Validated CRI v1 image API"
Sep 15 07:50:47.568301 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.568287    2586 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 07:50:47.572381 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.572361    2586 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9ca57cd4-a64a-4672-9acf-ea8f18f3c382:/dev/nvme0n1p4 b7ee3973-7143-48e9-bfe0-fabe84966b3e:/dev/nvme0n1p3]
Sep 15 07:50:47.572443 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.572379    2586 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 07:50:47.573299 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.573282    2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 07:50:47.577412 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.577305    2586 manager.go:216] Machine: {Timestamp:2026-09-15 07:50:47.57602994 +0000 UTC m=+0.367492654 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092008 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec297e564858d51e396bad9edeb0739a SystemUUID:ec297e56-4858-d51e-396b-ad9edeb0739a BootID:1bec93f4-8192-49f3-9b98-ff92d6b26b5e Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e1:3b:5d:9f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e1:3b:5d:9f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:f1:fa:e0:48:07 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 07:50:47.577412 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.577405    2586 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 07:50:47.577594 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.577480    2586 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 07:50:47.580169 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.580146    2586 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 07:50:47.580331 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.580171    2586 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-189.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 07:50:47.581575 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.581562    2586 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 07:50:47.581645 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.581583    2586 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 07:50:47.581645 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.581594    2586 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 07:50:47.582364 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.582353    2586 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 07:50:47.583508 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.583497    2586 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 07:50:47.587779 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.587757    2586 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 07:50:47.587910 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.587899    2586 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 07:50:47.587976 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.587938    2586 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 07:50:47.587976 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.587952    2586 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 07:50:47.587976 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.587968    2586 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 07:50:47.588111 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.587981    2586 kubelet.go:398] "Adding apiserver pod source"
Sep 15 07:50:47.588111 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.587993    2586 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 07:50:47.588469 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.588456    2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 07:50:47.588508 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.588477    2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 07:50:47.593249 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.593188    2586 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 07:50:47.597055 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.597040    2586 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 07:50:47.597144 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.597071    2586 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 07:50:47.598951 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.598938    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 07:50:47.599024 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.598954    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 07:50:47.599024 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.598961    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 07:50:47.599024 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.598966    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 07:50:47.599024 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.598975    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 07:50:47.599024 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.598983    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 07:50:47.599024 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.598996    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 07:50:47.599024 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.599016    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 07:50:47.599024 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.599023    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 07:50:47.599024 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.599028    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 07:50:47.599338 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.599036    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 07:50:47.599338 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.599042    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 07:50:47.599338 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:47.599316    2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 07:50:47.599433 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:47.599334    2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 07:50:47.600770 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.600759    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 07:50:47.600806 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.600771    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 07:50:47.604468 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.604455    2586 server.go:1268] "Started kubelet"
Sep 15 07:50:47.604590 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.604538    2586 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 07:50:47.604590 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.604563    2586 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 07:50:47.604695 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.604615    2586 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 07:50:47.605381 ip-10-0-134-189 systemd[1]: Started Kubernetes Kubelet.
Sep 15 07:50:47.606122 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.606104    2586 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 07:50:47.606595 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.606580    2586 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 07:50:47.613433 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.613418    2586 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 07:50:47.613499 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.613439    2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 07:50:47.613566 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:47.613542    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-189.ec2.internal\" not found"
Sep 15 07:50:47.614338 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.614131    2586 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 07:50:47.614338 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.614296    2586 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 07:50:47.614338 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.614309    2586 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 07:50:47.614498 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.614482    2586 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 07:50:47.614533 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.614498    2586 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 07:50:47.614618 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.614603    2586 factory.go:55] Registering systemd factory
Sep 15 07:50:47.614693 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.614622    2586 factory.go:223] Registration of the systemd container factory successfully
Sep 15 07:50:47.614826 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.614814    2586 factory.go:153] Registering CRI-O factory
Sep 15 07:50:47.614826 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.614830    2586 factory.go:223] Registration of the crio container factory successfully
Sep 15 07:50:47.614945 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.614879    2586 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 07:50:47.614945 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.614899    2586 factory.go:103] Registering Raw factory
Sep 15 07:50:47.614945 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.614914    2586 manager.go:1196] Started watching for new ooms in manager
Sep 15 07:50:47.615161 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:47.615142    2586 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 07:50:47.615286 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.615271    2586 manager.go:349] Starting recovery of all containers
Sep 15 07:50:47.618655 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:47.618618    2586 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 15 07:50:47.618748 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.618693    2586 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 07:50:47.618877 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:47.618849    2586 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 15 07:50:47.620024 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:47.618729    2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-189.ec2.internal.18d56f28b6b67f4f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-189.ec2.internal,UID:ip-10-0-134-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-189.ec2.internal,},FirstTimestamp:2026-09-15 07:50:47.604428623 +0000 UTC m=+0.395891337,LastTimestamp:2026-09-15 07:50:47.604428623 +0000 UTC m=+0.395891337,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-189.ec2.internal,}"
Sep 15 07:50:47.627179 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.626335    2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jts47"
Sep 15 07:50:47.627179 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.626576    2586 manager.go:354] Recovery completed
Sep 15 07:50:47.633069 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.633054    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 07:50:47.633927 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.633914    2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jts47"
Sep 15 07:50:47.635243 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.635220    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 07:50:47.635315 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.635249    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 07:50:47.635315 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.635261    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeHasSufficientPID"
Sep 15 07:50:47.635889 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.635872    2586 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 07:50:47.635889 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.635885    2586 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 07:50:47.635889 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.635886    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 07:50:47.636065 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.635902    2586 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 07:50:47.636903 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.636573    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 07:50:47.636903 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.636596    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 07:50:47.636903 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.636605    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeHasSufficientPID"
Sep 15 07:50:47.637286 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:47.637212    2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-189.ec2.internal.18d56f28b88c998d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-189.ec2.internal,UID:ip-10-0-134-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-189.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-189.ec2.internal,},FirstTimestamp:2026-09-15 07:50:47.635237261 +0000 UTC m=+0.426699974,LastTimestamp:2026-09-15 07:50:47.635237261 +0000 UTC m=+0.426699974,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-189.ec2.internal,}"
Sep 15 07:50:47.638063 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.638046    2586 policy_none.go:49] "None policy: Start"
Sep 15 07:50:47.638063 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.638066    2586 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 07:50:47.638200 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.638079    2586 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 07:50:47.640232 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.640219    2586 policy_none.go:47] "Start"
Sep 15 07:50:47.667318 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.667303    2586 manager.go:337] "Starting Device Plugin manager"
Sep 15 07:50:47.667428 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:47.667342    2586 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 07:50:47.667428 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.667351    2586 server.go:87] "Starting device plugin registration server"
Sep 15 07:50:47.667589 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.667572    2586 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 07:50:47.667751 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.667588    2586 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 07:50:47.667980 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.667845    2586 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 07:50:47.667980 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.667925    2586 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 07:50:47.667980 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.667933    2586 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 07:50:47.668366 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:47.668332    2586 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 07:50:47.668437 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:47.668396    2586 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-189.ec2.internal\" not found"
Sep 15 07:50:47.713462 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.713439    2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 07:50:47.715592 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.714684    2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 07:50:47.715592 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.714729    2586 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 07:50:47.715592 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.714759    2586 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 07:50:47.715592 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:47.714828    2586 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 15 07:50:47.717076 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.717059    2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 07:50:47.768122 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.768093    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 07:50:47.769172 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.769107    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 07:50:47.769172 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.769140    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 07:50:47.769172 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.769152    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeHasSufficientPID"
Sep 15 07:50:47.769390 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.769178    2586 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-189.ec2.internal"
Sep 15 07:50:47.777823 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.777807    2586 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-189.ec2.internal"
Sep 15 07:50:47.777884 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:47.777829    2586 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-189.ec2.internal\": node \"ip-10-0-134-189.ec2.internal\" not found"
Sep 15 07:50:47.804020 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:47.803996    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-189.ec2.internal\" not found"
Sep 15 07:50:47.815146 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.815126    2586 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-189.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-189.ec2.internal"]
Sep 15 07:50:47.815244 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.815188    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 07:50:47.816104 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.816089    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 07:50:47.816191 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.816121    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 07:50:47.816191 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.816136    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeHasSufficientPID"
Sep 15 07:50:47.818472 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.818450    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 07:50:47.818577 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.818562    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-189.ec2.internal"
Sep 15 07:50:47.818620 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.818601    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 07:50:47.819192 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.819173    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 07:50:47.819269 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.819207    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 07:50:47.819269 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.819215    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 07:50:47.819269 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.819222    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeHasSufficientPID"
Sep 15 07:50:47.819269 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.819233    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 07:50:47.819269 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.819246    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeHasSufficientPID"
Sep 15 07:50:47.821426 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.821409    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-189.ec2.internal"
Sep 15 07:50:47.821495 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.821437    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 07:50:47.822081 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.822067    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 07:50:47.822174 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.822095    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 07:50:47.822174 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.822108    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeHasSufficientPID"
Sep 15 07:50:47.843152 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:47.843137    2586 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-189.ec2.internal\" not found" node="ip-10-0-134-189.ec2.internal"
Sep 15 07:50:47.846412 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:47.846397    2586 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-189.ec2.internal\" not found" node="ip-10-0-134-189.ec2.internal"
Sep 15 07:50:47.904575 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:47.904557    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-189.ec2.internal\" not found"
Sep 15 07:50:47.915857 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.915839    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c97f908167f20c09da5c0e0087b3f35-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-189.ec2.internal\" (UID: \"4c97f908167f20c09da5c0e0087b3f35\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-189.ec2.internal"
Sep 15 07:50:47.915918 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.915864    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c97f908167f20c09da5c0e0087b3f35-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-189.ec2.internal\" (UID: \"4c97f908167f20c09da5c0e0087b3f35\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-189.ec2.internal"
Sep 15 07:50:47.915918 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:47.915881    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4bf36dcd150da66bbf96efc4d354ac7b-config\") pod \"kube-apiserver-proxy-ip-10-0-134-189.ec2.internal\" (UID: \"4bf36dcd150da66bbf96efc4d354ac7b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-189.ec2.internal"
Sep 15 07:50:48.005024 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:48.004994    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-189.ec2.internal\" not found"
Sep 15 07:50:48.016369 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:48.016345    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4bf36dcd150da66bbf96efc4d354ac7b-config\") pod \"kube-apiserver-proxy-ip-10-0-134-189.ec2.internal\" (UID: \"4bf36dcd150da66bbf96efc4d354ac7b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-189.ec2.internal"
Sep 15 07:50:48.016434 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:48.016375    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c97f908167f20c09da5c0e0087b3f35-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-189.ec2.internal\" (UID: \"4c97f908167f20c09da5c0e0087b3f35\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-189.ec2.internal"
Sep 15 07:50:48.016434 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:48.016392    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c97f908167f20c09da5c0e0087b3f35-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-189.ec2.internal\" (UID: \"4c97f908167f20c09da5c0e0087b3f35\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-189.ec2.internal"
Sep 15 07:50:48.016434 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:48.016418    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c97f908167f20c09da5c0e0087b3f35-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-189.ec2.internal\" (UID: \"4c97f908167f20c09da5c0e0087b3f35\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-189.ec2.internal"
Sep 15 07:50:48.016543 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:48.016431    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4bf36dcd150da66bbf96efc4d354ac7b-config\") pod \"kube-apiserver-proxy-ip-10-0-134-189.ec2.internal\" (UID: \"4bf36dcd150da66bbf96efc4d354ac7b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-189.ec2.internal"
Sep 15 07:50:48.016543 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:48.016452    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c97f908167f20c09da5c0e0087b3f35-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-189.ec2.internal\" (UID: \"4c97f908167f20c09da5c0e0087b3f35\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-189.ec2.internal"
Sep 15 07:50:48.105808 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:48.105751    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-189.ec2.internal\" not found"
Sep 15 07:50:48.146259 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:48.146228    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-189.ec2.internal"
Sep 15 07:50:48.149389 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:48.149376    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-189.ec2.internal"
Sep 15 07:50:48.206044 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:48.206017    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-189.ec2.internal\" not found"
Sep 15 07:50:48.306447 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:48.306408    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-189.ec2.internal\" not found"
Sep 15 07:50:48.408424 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:48.408352    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-189.ec2.internal\" not found"
Sep 15 07:50:48.509988 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:48.509950    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-189.ec2.internal\" not found"
Sep 15 07:50:48.541766 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:48.541740    2586 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 07:50:48.542378 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:48.541895    2586 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 07:50:48.611394 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:48.611361    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-189.ec2.internal\" not found"
Sep 15 07:50:48.640207 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:48.640172    2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 07:45:48 +0000 UTC" deadline="2028-03-07 20:40:43.440378751 +0000 UTC"
Sep 15 07:50:48.640207 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:48.640200    2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12948h49m54.800182621s"
Sep 15 07:50:48.711524 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:48.711461    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-189.ec2.internal\" not found"
Sep 15 07:50:48.765489 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:48.765462    2586 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 07:50:48.814083 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:48.814048    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-189.ec2.internal\" not found"
Sep 15 07:50:48.891654 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:48.891622    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bf36dcd150da66bbf96efc4d354ac7b.slice/crio-55e55ce99c558cc13589dc1a89da08cc48794cb83bf99d53dbe3765390c8003a WatchSource:0}: Error finding container 55e55ce99c558cc13589dc1a89da08cc48794cb83bf99d53dbe3765390c8003a: Status 404 returned error can't find the container with id 55e55ce99c558cc13589dc1a89da08cc48794cb83bf99d53dbe3765390c8003a
Sep 15 07:50:48.891989 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:48.891965    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c97f908167f20c09da5c0e0087b3f35.slice/crio-947615e76e71820faed7476e69eee04186100e749b265beb73a67a0a5f8f3877 WatchSource:0}: Error finding container 947615e76e71820faed7476e69eee04186100e749b265beb73a67a0a5f8f3877: Status 404 returned error can't find the container with id 947615e76e71820faed7476e69eee04186100e749b265beb73a67a0a5f8f3877
Sep 15 07:50:48.896295 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:48.896279    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 07:50:48.914565 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:48.914540    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-189.ec2.internal\" not found"
Sep 15 07:50:49.015620 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:49.015540    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-189.ec2.internal\" not found"
Sep 15 07:50:49.115845 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:49.115820    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-189.ec2.internal\" not found"
Sep 15 07:50:49.121953 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.121929    2586 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 07:50:49.191482 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.191457    2586 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 07:50:49.215162 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.215127    2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-189.ec2.internal"
Sep 15 07:50:49.228106 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.228082    2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 07:50:49.230023 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.230006    2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-189.ec2.internal"
Sep 15 07:50:49.239049 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.239030    2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 07:50:49.592725 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.592686    2586 apiserver.go:52] "Watching apiserver"
Sep 15 07:50:49.604011 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.603973    2586 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 07:50:49.605198 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.605161    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-vz2jd","kube-system/global-pull-secret-syncer-frqd6","kube-system/konnectivity-agent-5wmdc","kube-system/kube-apiserver-proxy-ip-10-0-134-189.ec2.internal","openshift-dns/node-resolver-sxwp6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-189.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-zlqdd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k","openshift-cluster-node-tuning-operator/tuned-hvlpq","openshift-image-registry/node-ca-tm9mm","openshift-multus/multus-additional-cni-plugins-kg6gg","openshift-multus/multus-vzrd7","openshift-multus/network-metrics-daemon-dhdbz","openshift-network-diagnostics/network-check-target-q6bn9"]
Sep 15 07:50:49.607958 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.607933    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tm9mm"
Sep 15 07:50:49.610352 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.610245    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:50:49.610352 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:49.610336    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdbz" podUID="1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0"
Sep 15 07:50:49.610778 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.610599    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 07:50:49.610778 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.610745    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 07:50:49.610778 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.610759    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 07:50:49.611015 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.610855    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gsggq\""
Sep 15 07:50:49.612742 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.612696    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5wmdc"
Sep 15 07:50:49.613690 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.613662    2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 07:50:49.615081 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.614960    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dl7c8\""
Sep 15 07:50:49.615215 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.615095    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 07:50:49.615215 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.615165    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 07:50:49.615486 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.615469    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:50:49.615552 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:49.615535    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6bn9" podUID="6d3e2b9a-08af-462b-b07c-7f082791973c"
Sep 15 07:50:49.619281 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.619260    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sxwp6"
Sep 15 07:50:49.622015 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.621988    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 07:50:49.622181 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.622114    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 07:50:49.622286 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.622265    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zhj6g\""
Sep 15 07:50:49.623648 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.623625    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.625726 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.625707    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 07:50:49.625840 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.625822    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 07:50:49.625982 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.625964    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 07:50:49.626064 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.626031    2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 07:50:49.626207 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.626187    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lj6qd\""
Sep 15 07:50:49.626280 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.626263    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd0cf790-5285-4db4-a40a-d40575ca5514-host\") pod \"node-ca-tm9mm\" (UID: \"fd0cf790-5285-4db4-a40a-d40575ca5514\") " pod="openshift-image-registry/node-ca-tm9mm"
Sep 15 07:50:49.626339 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.626292    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd0cf790-5285-4db4-a40a-d40575ca5514-serviceca\") pod \"node-ca-tm9mm\" (UID: \"fd0cf790-5285-4db4-a40a-d40575ca5514\") " pod="openshift-image-registry/node-ca-tm9mm"
Sep 15 07:50:49.626339 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.626320    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs\") pod \"network-metrics-daemon-dhdbz\" (UID: \"1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0\") " pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:50:49.626446 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.626347    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6knx\" (UniqueName: \"kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx\") pod \"network-check-target-q6bn9\" (UID: \"6d3e2b9a-08af-462b-b07c-7f082791973c\") " pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:50:49.626446 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.626405    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6rd7\" (UniqueName: \"kubernetes.io/projected/fd0cf790-5285-4db4-a40a-d40575ca5514-kube-api-access-f6rd7\") pod \"node-ca-tm9mm\" (UID: \"fd0cf790-5285-4db4-a40a-d40575ca5514\") " pod="openshift-image-registry/node-ca-tm9mm"
Sep 15 07:50:49.626551 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.626457    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2t99\" (UniqueName: \"kubernetes.io/projected/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-kube-api-access-t2t99\") pod \"network-metrics-daemon-dhdbz\" (UID: \"1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0\") " pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:50:49.626551 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.626485    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/85304fe9-34fa-4309-be0b-d0403e10229a-agent-certs\") pod \"konnectivity-agent-5wmdc\" (UID: \"85304fe9-34fa-4309-be0b-d0403e10229a\") " pod="kube-system/konnectivity-agent-5wmdc"
Sep 15 07:50:49.626551 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.626530    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/85304fe9-34fa-4309-be0b-d0403e10229a-konnectivity-ca\") pod \"konnectivity-agent-5wmdc\" (UID: \"85304fe9-34fa-4309-be0b-d0403e10229a\") " pod="kube-system/konnectivity-agent-5wmdc"
Sep 15 07:50:49.626551 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.626534    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.628726 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.628703    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 07:50:49.628988 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.628971    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gw44m\""
Sep 15 07:50:49.629328 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.629228    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.629940 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.629762    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 07:50:49.631347 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.631329    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:50:49.631457 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:49.631394    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frqd6" podUID="d36ed006-6ecd-49cd-b7b1-965233accc84"
Sep 15 07:50:49.632195 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.631985    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z8wjf\""
Sep 15 07:50:49.632195 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.632005    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 07:50:49.632195 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.632060    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 07:50:49.632195 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.632182    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 07:50:49.632438 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.632237    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 07:50:49.632438 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.632414    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 07:50:49.632567 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.632548    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 07:50:49.633927 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.633906    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vz2jd"
Sep 15 07:50:49.636184 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.636150    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 07:50:49.637223 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.637200    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 07:50:49.637325 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.637304    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dlvfc\""
Sep 15 07:50:49.637559 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.637470    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 07:50:49.639916 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.637654    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.641266 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.640281    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 07:50:49.641266 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.640436    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 07:50:49.641266 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.640853    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sbmrr\""
Sep 15 07:50:49.641266 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.640921    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 07:50:49.641266 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.640921    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 07:50:49.641266 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.640937    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.641266 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.641052    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 07:50:49.643173 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.643148    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jjvkc\""
Sep 15 07:50:49.644111 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.644064    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 07:50:49.652339 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.652316    2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qpd6v"
Sep 15 07:50:49.658999 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.658979    2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qpd6v"
Sep 15 07:50:49.715190 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.715166    2586 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 07:50:49.720843 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.720774    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-189.ec2.internal" event={"ID":"4bf36dcd150da66bbf96efc4d354ac7b","Type":"ContainerStarted","Data":"55e55ce99c558cc13589dc1a89da08cc48794cb83bf99d53dbe3765390c8003a"}
Sep 15 07:50:49.722847 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.722820    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-189.ec2.internal" event={"ID":"4c97f908167f20c09da5c0e0087b3f35","Type":"ContainerStarted","Data":"947615e76e71820faed7476e69eee04186100e749b265beb73a67a0a5f8f3877"}
Sep 15 07:50:49.727061 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.726714    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2t99\" (UniqueName: \"kubernetes.io/projected/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-kube-api-access-t2t99\") pod \"network-metrics-daemon-dhdbz\" (UID: \"1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0\") " pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:50:49.727061 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.726749    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/85304fe9-34fa-4309-be0b-d0403e10229a-konnectivity-ca\") pod \"konnectivity-agent-5wmdc\" (UID: \"85304fe9-34fa-4309-be0b-d0403e10229a\") " pod="kube-system/konnectivity-agent-5wmdc"
Sep 15 07:50:49.727061 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.726781    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-etc-sysconfig\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.727061 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.726806    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c580ab2-446f-44b2-931e-444d49271760-cnibin\") pod \"multus-additional-cni-plugins-kg6gg\" (UID: \"6c580ab2-446f-44b2-931e-444d49271760\") " pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.727061 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.726833    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c580ab2-446f-44b2-931e-444d49271760-cni-binary-copy\") pod \"multus-additional-cni-plugins-kg6gg\" (UID: \"6c580ab2-446f-44b2-931e-444d49271760\") " pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.727061 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.726860    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-host-run-netns\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.727061 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.726898    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f932980-e655-449a-8497-e65577afede4-host-slash\") pod \"iptables-alerter-vz2jd\" (UID: \"6f932980-e655-449a-8497-e65577afede4\") " pod="openshift-network-operator/iptables-alerter-vz2jd"
Sep 15 07:50:49.727061 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.726924    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-etc-sysctl-d\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.727061 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.726949    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-etc-systemd\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.727061 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.726973    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-host-kubelet\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.727061 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.726996    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-host-slash\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.727061 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727019    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-node-log\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.727061 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727041    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-etc-tuned\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.727828 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727087    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-host-cni-bin\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.727828 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727111    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfm57\" (UniqueName: \"kubernetes.io/projected/6f932980-e655-449a-8497-e65577afede4-kube-api-access-sfm57\") pod \"iptables-alerter-vz2jd\" (UID: \"6f932980-e655-449a-8497-e65577afede4\") " pod="openshift-network-operator/iptables-alerter-vz2jd"
Sep 15 07:50:49.727828 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727167    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-etc-kubernetes\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.727828 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727197    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd0cf790-5285-4db4-a40a-d40575ca5514-host\") pod \"node-ca-tm9mm\" (UID: \"fd0cf790-5285-4db4-a40a-d40575ca5514\") " pod="openshift-image-registry/node-ca-tm9mm"
Sep 15 07:50:49.727828 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727223    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs\") pod \"network-metrics-daemon-dhdbz\" (UID: \"1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0\") " pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:50:49.727828 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727250    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-system-cni-dir\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.727828 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727275    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-host-run-k8s-cni-cncf-io\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.727828 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727299    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-host-var-lib-kubelet\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.727828 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727324    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/54e3cf09-d6a2-4c32-8301-524f7a81716f-multus-daemon-config\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.727828 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727350    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-etc-kubernetes\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.727828 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727389    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-etc-sysctl-conf\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.727828 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727417    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-run-systemd\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.727828 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727442    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-etc-modprobe-d\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.727828 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727464    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d36ed006-6ecd-49cd-b7b1-965233accc84-dbus\") pod \"global-pull-secret-syncer-frqd6\" (UID: \"d36ed006-6ecd-49cd-b7b1-965233accc84\") " pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:50:49.727828 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727488    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/00471982-2782-4f5b-ba82-817b30032b0d-device-dir\") pod \"aws-ebs-csi-driver-node-hv49k\" (UID: \"00471982-2782-4f5b-ba82-817b30032b0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.727828 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727513    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-host-run-ovn-kubernetes\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.727828 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727538    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f932980-e655-449a-8497-e65577afede4-iptables-alerter-script\") pod \"iptables-alerter-vz2jd\" (UID: \"6f932980-e655-449a-8497-e65577afede4\") " pod="openshift-network-operator/iptables-alerter-vz2jd"
Sep 15 07:50:49.728697 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727588    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-multus-cni-dir\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.728697 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727627    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-host-var-lib-cni-multus\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.728697 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727641    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/85304fe9-34fa-4309-be0b-d0403e10229a-konnectivity-ca\") pod \"konnectivity-agent-5wmdc\" (UID: \"85304fe9-34fa-4309-be0b-d0403e10229a\") " pod="kube-system/konnectivity-agent-5wmdc"
Sep 15 07:50:49.728697 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727657    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d36ed006-6ecd-49cd-b7b1-965233accc84-kubelet-config\") pod \"global-pull-secret-syncer-frqd6\" (UID: \"d36ed006-6ecd-49cd-b7b1-965233accc84\") " pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:50:49.728697 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727696    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/00471982-2782-4f5b-ba82-817b30032b0d-registration-dir\") pod \"aws-ebs-csi-driver-node-hv49k\" (UID: \"00471982-2782-4f5b-ba82-817b30032b0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.728697 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727850    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-ovn-node-metrics-cert\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.728697 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727891    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-hostroot\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.728697 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.727916    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-host-run-multus-certs\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.728697 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.728053    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4kgw\" (UniqueName: \"kubernetes.io/projected/54e3cf09-d6a2-4c32-8301-524f7a81716f-kube-api-access-w4kgw\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.728697 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.728092    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd0cf790-5285-4db4-a40a-d40575ca5514-host\") pod \"node-ca-tm9mm\" (UID: \"fd0cf790-5285-4db4-a40a-d40575ca5514\") " pod="openshift-image-registry/node-ca-tm9mm"
Sep 15 07:50:49.728697 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:49.728147    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:50:49.728697 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.728160    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/00471982-2782-4f5b-ba82-817b30032b0d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hv49k\" (UID: \"00471982-2782-4f5b-ba82-817b30032b0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.728697 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:49.728216    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs podName:1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0 nodeName:}" failed. No retries permitted until 2026-09-15 07:50:50.228194944 +0000 UTC m=+3.019657655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs") pod "network-metrics-daemon-dhdbz" (UID: "1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:50:49.728697 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.728398    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-systemd-units\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.728697 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.728466    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-host-cni-netd\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.728697 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.728497    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72g7s\" (UniqueName: \"kubernetes.io/projected/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-kube-api-access-72g7s\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.729509 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.728526    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret\") pod \"global-pull-secret-syncer-frqd6\" (UID: \"d36ed006-6ecd-49cd-b7b1-965233accc84\") " pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:50:49.729509 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.728571    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c580ab2-446f-44b2-931e-444d49271760-system-cni-dir\") pod \"multus-additional-cni-plugins-kg6gg\" (UID: \"6c580ab2-446f-44b2-931e-444d49271760\") " pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.729509 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.728596    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zvgl\" (UniqueName: \"kubernetes.io/projected/6c580ab2-446f-44b2-931e-444d49271760-kube-api-access-7zvgl\") pod \"multus-additional-cni-plugins-kg6gg\" (UID: \"6c580ab2-446f-44b2-931e-444d49271760\") " pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.729509 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.728624    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6dlc\" (UniqueName: \"kubernetes.io/projected/00471982-2782-4f5b-ba82-817b30032b0d-kube-api-access-p6dlc\") pod \"aws-ebs-csi-driver-node-hv49k\" (UID: \"00471982-2782-4f5b-ba82-817b30032b0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.729509 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.728675    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-log-socket\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.729509 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.728713    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-var-lib-openvswitch\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.729509 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.728769    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-tmp\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.729509 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.728806    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c580ab2-446f-44b2-931e-444d49271760-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kg6gg\" (UID: \"6c580ab2-446f-44b2-931e-444d49271760\") " pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.729509 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.728837    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c580ab2-446f-44b2-931e-444d49271760-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kg6gg\" (UID: \"6c580ab2-446f-44b2-931e-444d49271760\") " pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.729509 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.728865    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-multus-conf-dir\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.729509 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.728890    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/270820a5-0bb6-46db-affd-a9ec2c639a9c-tmp-dir\") pod \"node-resolver-sxwp6\" (UID: \"270820a5-0bb6-46db-affd-a9ec2c639a9c\") " pod="openshift-dns/node-resolver-sxwp6"
Sep 15 07:50:49.729509 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.728915    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-etc-openvswitch\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.729509 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.728938    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-ovnkube-config\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.729509 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.728963    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-env-overrides\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.729509 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.728986    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54e3cf09-d6a2-4c32-8301-524f7a81716f-cni-binary-copy\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.729509 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729010    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-host-run-netns\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.730421 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729044    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6rd7\" (UniqueName: \"kubernetes.io/projected/fd0cf790-5285-4db4-a40a-d40575ca5514-kube-api-access-f6rd7\") pod \"node-ca-tm9mm\" (UID: \"fd0cf790-5285-4db4-a40a-d40575ca5514\") " pod="openshift-image-registry/node-ca-tm9mm"
Sep 15 07:50:49.730421 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729096    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-run\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.730421 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729120    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-ovnkube-script-lib\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.730421 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729140    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48dn8\" (UniqueName: \"kubernetes.io/projected/270820a5-0bb6-46db-affd-a9ec2c639a9c-kube-api-access-48dn8\") pod \"node-resolver-sxwp6\" (UID: \"270820a5-0bb6-46db-affd-a9ec2c639a9c\") " pod="openshift-dns/node-resolver-sxwp6"
Sep 15 07:50:49.730421 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729168    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-var-lib-kubelet\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.730421 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729185    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c580ab2-446f-44b2-931e-444d49271760-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kg6gg\" (UID: \"6c580ab2-446f-44b2-931e-444d49271760\") " pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.730421 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729205    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/00471982-2782-4f5b-ba82-817b30032b0d-etc-selinux\") pod \"aws-ebs-csi-driver-node-hv49k\" (UID: \"00471982-2782-4f5b-ba82-817b30032b0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.730421 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729220    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/00471982-2782-4f5b-ba82-817b30032b0d-sys-fs\") pod \"aws-ebs-csi-driver-node-hv49k\" (UID: \"00471982-2782-4f5b-ba82-817b30032b0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.730421 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729236    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.730421 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729276    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zgsx\" (UniqueName: \"kubernetes.io/projected/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-kube-api-access-4zgsx\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.730421 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729313    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-multus-socket-dir-parent\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.730421 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729340    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/85304fe9-34fa-4309-be0b-d0403e10229a-agent-certs\") pod \"konnectivity-agent-5wmdc\" (UID: \"85304fe9-34fa-4309-be0b-d0403e10229a\") " pod="kube-system/konnectivity-agent-5wmdc"
Sep 15 07:50:49.730421 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729366    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/270820a5-0bb6-46db-affd-a9ec2c639a9c-hosts-file\") pod \"node-resolver-sxwp6\" (UID: \"270820a5-0bb6-46db-affd-a9ec2c639a9c\") " pod="openshift-dns/node-resolver-sxwp6"
Sep 15 07:50:49.730421 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729392    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-sys\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.730421 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729424    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-lib-modules\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.730421 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729448    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-host\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.731255 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729472    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/00471982-2782-4f5b-ba82-817b30032b0d-socket-dir\") pod \"aws-ebs-csi-driver-node-hv49k\" (UID: \"00471982-2782-4f5b-ba82-817b30032b0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.731255 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729495    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-run-openvswitch\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.731255 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729519    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-run-ovn\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.731255 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729546    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd0cf790-5285-4db4-a40a-d40575ca5514-serviceca\") pod \"node-ca-tm9mm\" (UID: \"fd0cf790-5285-4db4-a40a-d40575ca5514\") " pod="openshift-image-registry/node-ca-tm9mm"
Sep 15 07:50:49.731255 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729574    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6knx\" (UniqueName: \"kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx\") pod \"network-check-target-q6bn9\" (UID: \"6d3e2b9a-08af-462b-b07c-7f082791973c\") " pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:50:49.731255 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729597    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-cnibin\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.731255 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729623    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-host-var-lib-cni-bin\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.731255 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.729899    2586 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 07:50:49.731255 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.730165    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd0cf790-5285-4db4-a40a-d40575ca5514-serviceca\") pod \"node-ca-tm9mm\" (UID: \"fd0cf790-5285-4db4-a40a-d40575ca5514\") " pod="openshift-image-registry/node-ca-tm9mm"
Sep 15 07:50:49.735634 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:49.735063    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 07:50:49.735634 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:49.735086    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 07:50:49.735634 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:49.735101    2586 projected.go:196] Error preparing data for projected volume kube-api-access-q6knx for pod openshift-network-diagnostics/network-check-target-q6bn9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:50:49.735634 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:49.735156    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx podName:6d3e2b9a-08af-462b-b07c-7f082791973c nodeName:}" failed. No retries permitted until 2026-09-15 07:50:50.235138987 +0000 UTC m=+3.026601705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q6knx" (UniqueName: "kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx") pod "network-check-target-q6bn9" (UID: "6d3e2b9a-08af-462b-b07c-7f082791973c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:50:49.736431 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.736405    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2t99\" (UniqueName: \"kubernetes.io/projected/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-kube-api-access-t2t99\") pod \"network-metrics-daemon-dhdbz\" (UID: \"1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0\") " pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:50:49.737420 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.737398    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/85304fe9-34fa-4309-be0b-d0403e10229a-agent-certs\") pod \"konnectivity-agent-5wmdc\" (UID: \"85304fe9-34fa-4309-be0b-d0403e10229a\") " pod="kube-system/konnectivity-agent-5wmdc"
Sep 15 07:50:49.738315 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.738294    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6rd7\" (UniqueName: \"kubernetes.io/projected/fd0cf790-5285-4db4-a40a-d40575ca5514-kube-api-access-f6rd7\") pod \"node-ca-tm9mm\" (UID: \"fd0cf790-5285-4db4-a40a-d40575ca5514\") " pod="openshift-image-registry/node-ca-tm9mm"
Sep 15 07:50:49.830226 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830189    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-host-run-ovn-kubernetes\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.830400 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830238    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f932980-e655-449a-8497-e65577afede4-iptables-alerter-script\") pod \"iptables-alerter-vz2jd\" (UID: \"6f932980-e655-449a-8497-e65577afede4\") " pod="openshift-network-operator/iptables-alerter-vz2jd"
Sep 15 07:50:49.830400 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830266    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-multus-cni-dir\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.830400 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830290    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-host-var-lib-cni-multus\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.830400 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830316    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d36ed006-6ecd-49cd-b7b1-965233accc84-kubelet-config\") pod \"global-pull-secret-syncer-frqd6\" (UID: \"d36ed006-6ecd-49cd-b7b1-965233accc84\") " pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:50:49.830400 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830343    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/00471982-2782-4f5b-ba82-817b30032b0d-registration-dir\") pod \"aws-ebs-csi-driver-node-hv49k\" (UID: \"00471982-2782-4f5b-ba82-817b30032b0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.830400 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830369    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-ovn-node-metrics-cert\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.830400 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830393    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-hostroot\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.830751 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830419    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-host-run-multus-certs\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.830751 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830444    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4kgw\" (UniqueName: \"kubernetes.io/projected/54e3cf09-d6a2-4c32-8301-524f7a81716f-kube-api-access-w4kgw\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.830751 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830478    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/00471982-2782-4f5b-ba82-817b30032b0d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hv49k\" (UID: \"00471982-2782-4f5b-ba82-817b30032b0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.830751 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830502    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-systemd-units\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.830751 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830527    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-host-cni-netd\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.830751 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830552    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72g7s\" (UniqueName: \"kubernetes.io/projected/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-kube-api-access-72g7s\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.830751 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830577    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret\") pod \"global-pull-secret-syncer-frqd6\" (UID: \"d36ed006-6ecd-49cd-b7b1-965233accc84\") " pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:50:49.830751 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830605    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c580ab2-446f-44b2-931e-444d49271760-system-cni-dir\") pod \"multus-additional-cni-plugins-kg6gg\" (UID: \"6c580ab2-446f-44b2-931e-444d49271760\") " pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.830751 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830631    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zvgl\" (UniqueName: \"kubernetes.io/projected/6c580ab2-446f-44b2-931e-444d49271760-kube-api-access-7zvgl\") pod \"multus-additional-cni-plugins-kg6gg\" (UID: \"6c580ab2-446f-44b2-931e-444d49271760\") " pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.830751 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830659    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6dlc\" (UniqueName: \"kubernetes.io/projected/00471982-2782-4f5b-ba82-817b30032b0d-kube-api-access-p6dlc\") pod \"aws-ebs-csi-driver-node-hv49k\" (UID: \"00471982-2782-4f5b-ba82-817b30032b0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.830751 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830724    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-log-socket\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.830751 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830750    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-var-lib-openvswitch\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.831215 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830779    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-tmp\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.831215 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830805    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c580ab2-446f-44b2-931e-444d49271760-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kg6gg\" (UID: \"6c580ab2-446f-44b2-931e-444d49271760\") " pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.831215 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830833    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c580ab2-446f-44b2-931e-444d49271760-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kg6gg\" (UID: \"6c580ab2-446f-44b2-931e-444d49271760\") " pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.831215 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830859    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-multus-conf-dir\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.831215 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830884    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/270820a5-0bb6-46db-affd-a9ec2c639a9c-tmp-dir\") pod \"node-resolver-sxwp6\" (UID: \"270820a5-0bb6-46db-affd-a9ec2c639a9c\") " pod="openshift-dns/node-resolver-sxwp6"
Sep 15 07:50:49.831215 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830910    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-etc-openvswitch\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.831215 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830936    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-ovnkube-config\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.831215 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830972    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-env-overrides\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.831215 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.830998    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54e3cf09-d6a2-4c32-8301-524f7a81716f-cni-binary-copy\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.831215 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831023    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-host-run-netns\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.831215 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831048    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-run\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.831215 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831074    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-ovnkube-script-lib\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.831215 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831110    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48dn8\" (UniqueName: \"kubernetes.io/projected/270820a5-0bb6-46db-affd-a9ec2c639a9c-kube-api-access-48dn8\") pod \"node-resolver-sxwp6\" (UID: \"270820a5-0bb6-46db-affd-a9ec2c639a9c\") " pod="openshift-dns/node-resolver-sxwp6"
Sep 15 07:50:49.831215 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831136    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-var-lib-kubelet\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.831215 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831163    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c580ab2-446f-44b2-931e-444d49271760-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kg6gg\" (UID: \"6c580ab2-446f-44b2-931e-444d49271760\") " pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.831215 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831188    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/00471982-2782-4f5b-ba82-817b30032b0d-etc-selinux\") pod \"aws-ebs-csi-driver-node-hv49k\" (UID: \"00471982-2782-4f5b-ba82-817b30032b0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.831215 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831218    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/00471982-2782-4f5b-ba82-817b30032b0d-sys-fs\") pod \"aws-ebs-csi-driver-node-hv49k\" (UID: \"00471982-2782-4f5b-ba82-817b30032b0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.831875 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831254    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.831875 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831283    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zgsx\" (UniqueName: \"kubernetes.io/projected/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-kube-api-access-4zgsx\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.831875 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831310    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-multus-socket-dir-parent\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.831875 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831337    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/270820a5-0bb6-46db-affd-a9ec2c639a9c-hosts-file\") pod \"node-resolver-sxwp6\" (UID: \"270820a5-0bb6-46db-affd-a9ec2c639a9c\") " pod="openshift-dns/node-resolver-sxwp6"
Sep 15 07:50:49.831875 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831361    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-sys\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.831875 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831386    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-lib-modules\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.831875 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831411    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-host\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.831875 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831438    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/00471982-2782-4f5b-ba82-817b30032b0d-socket-dir\") pod \"aws-ebs-csi-driver-node-hv49k\" (UID: \"00471982-2782-4f5b-ba82-817b30032b0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.831875 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831472    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-run-openvswitch\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.831875 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831498    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-run-ovn\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.831875 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831543    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-cnibin\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.831875 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831571    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-host-var-lib-cni-bin\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.831875 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831601    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-etc-sysconfig\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.831875 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831627    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c580ab2-446f-44b2-931e-444d49271760-cnibin\") pod \"multus-additional-cni-plugins-kg6gg\" (UID: \"6c580ab2-446f-44b2-931e-444d49271760\") " pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.831875 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831653    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c580ab2-446f-44b2-931e-444d49271760-cni-binary-copy\") pod \"multus-additional-cni-plugins-kg6gg\" (UID: \"6c580ab2-446f-44b2-931e-444d49271760\") " pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.831875 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831679    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-host-run-netns\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.831875 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831705    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f932980-e655-449a-8497-e65577afede4-host-slash\") pod \"iptables-alerter-vz2jd\" (UID: \"6f932980-e655-449a-8497-e65577afede4\") " pod="openshift-network-operator/iptables-alerter-vz2jd"
Sep 15 07:50:49.832520 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831748    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-etc-sysctl-d\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.832520 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831777    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-etc-systemd\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.832520 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831810    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-host-kubelet\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.832520 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831835    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-host-slash\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.832520 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831861    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-node-log\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.832520 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831886    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-etc-tuned\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.832520 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831915    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-host-cni-bin\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.832520 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831949    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfm57\" (UniqueName: \"kubernetes.io/projected/6f932980-e655-449a-8497-e65577afede4-kube-api-access-sfm57\") pod \"iptables-alerter-vz2jd\" (UID: \"6f932980-e655-449a-8497-e65577afede4\") " pod="openshift-network-operator/iptables-alerter-vz2jd"
Sep 15 07:50:49.832520 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.831977    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-etc-kubernetes\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.832520 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.832020    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-system-cni-dir\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.832520 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.832047    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-host-run-k8s-cni-cncf-io\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.832520 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.832080    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-host-var-lib-kubelet\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.832520 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.832123    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/54e3cf09-d6a2-4c32-8301-524f7a81716f-multus-daemon-config\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.832520 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.832153    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-etc-kubernetes\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.832520 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.832187    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-etc-sysctl-conf\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.832520 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.832220    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-run-systemd\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.832520 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.832249    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-etc-modprobe-d\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.832520 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.832276    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d36ed006-6ecd-49cd-b7b1-965233accc84-dbus\") pod \"global-pull-secret-syncer-frqd6\" (UID: \"d36ed006-6ecd-49cd-b7b1-965233accc84\") " pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:50:49.833379 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.832303    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/00471982-2782-4f5b-ba82-817b30032b0d-device-dir\") pod \"aws-ebs-csi-driver-node-hv49k\" (UID: \"00471982-2782-4f5b-ba82-817b30032b0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.833379 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.832434    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/00471982-2782-4f5b-ba82-817b30032b0d-device-dir\") pod \"aws-ebs-csi-driver-node-hv49k\" (UID: \"00471982-2782-4f5b-ba82-817b30032b0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.833379 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.832490    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-host-run-ovn-kubernetes\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.833379 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.832690    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/00471982-2782-4f5b-ba82-817b30032b0d-sys-fs\") pod \"aws-ebs-csi-driver-node-hv49k\" (UID: \"00471982-2782-4f5b-ba82-817b30032b0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.833379 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.832767    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d36ed006-6ecd-49cd-b7b1-965233accc84-kubelet-config\") pod \"global-pull-secret-syncer-frqd6\" (UID: \"d36ed006-6ecd-49cd-b7b1-965233accc84\") " pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:50:49.833379 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.832768    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-host-var-lib-cni-multus\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.833379 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.832779    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.833379 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.832833    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-log-socket\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.833379 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.832911    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/270820a5-0bb6-46db-affd-a9ec2c639a9c-hosts-file\") pod \"node-resolver-sxwp6\" (UID: \"270820a5-0bb6-46db-affd-a9ec2c639a9c\") " pod="openshift-dns/node-resolver-sxwp6"
Sep 15 07:50:49.833379 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.832982    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-sys\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.833379 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.833116    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/00471982-2782-4f5b-ba82-817b30032b0d-registration-dir\") pod \"aws-ebs-csi-driver-node-hv49k\" (UID: \"00471982-2782-4f5b-ba82-817b30032b0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.833379 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.833125    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-lib-modules\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.833379 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.833136    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f932980-e655-449a-8497-e65577afede4-iptables-alerter-script\") pod \"iptables-alerter-vz2jd\" (UID: \"6f932980-e655-449a-8497-e65577afede4\") " pod="openshift-network-operator/iptables-alerter-vz2jd"
Sep 15 07:50:49.833379 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.833175    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-hostroot\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.833379 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.833215    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-etc-systemd\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.833379 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.833224    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-host-run-multus-certs\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.833379 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.833265    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-host-kubelet\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.834885 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.833310    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-host-slash\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.834885 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.833357    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-node-log\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.834885 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.833466    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/00471982-2782-4f5b-ba82-817b30032b0d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hv49k\" (UID: \"00471982-2782-4f5b-ba82-817b30032b0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.834885 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.833518    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-systemd-units\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.834885 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.833563    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-host-cni-netd\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.834885 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.833882    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-etc-sysctl-d\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.834885 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.833895    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/00471982-2782-4f5b-ba82-817b30032b0d-socket-dir\") pod \"aws-ebs-csi-driver-node-hv49k\" (UID: \"00471982-2782-4f5b-ba82-817b30032b0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.834885 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.833939    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c580ab2-446f-44b2-931e-444d49271760-system-cni-dir\") pod \"multus-additional-cni-plugins-kg6gg\" (UID: \"6c580ab2-446f-44b2-931e-444d49271760\") " pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.834885 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.833956    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-run-openvswitch\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.834885 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:49.833971    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 07:50:49.834885 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834022    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-cnibin\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.834885 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:49.834037    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret podName:d36ed006-6ecd-49cd-b7b1-965233accc84 nodeName:}" failed. No retries permitted until 2026-09-15 07:50:50.334018473 +0000 UTC m=+3.125481192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret") pod "global-pull-secret-syncer-frqd6" (UID: "d36ed006-6ecd-49cd-b7b1-965233accc84") : object "kube-system"/"original-pull-secret" not registered
Sep 15 07:50:49.834885 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834059    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-host-run-netns\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.834885 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.832836    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-multus-cni-dir\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.834885 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834086    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-run\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.834885 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834108    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-host-var-lib-cni-bin\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.834885 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834128    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-run-ovn\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.834885 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834134    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-host\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.835668 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834175    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-host-var-lib-kubelet\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.835668 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834201    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54e3cf09-d6a2-4c32-8301-524f7a81716f-cni-binary-copy\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.835668 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834218    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-host-cni-bin\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.835668 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834401    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-etc-sysctl-conf\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.835668 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834446    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-etc-kubernetes\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.835668 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834454    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-host-run-k8s-cni-cncf-io\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.835668 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834532    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-system-cni-dir\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.835668 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834614    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c580ab2-446f-44b2-931e-444d49271760-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kg6gg\" (UID: \"6c580ab2-446f-44b2-931e-444d49271760\") " pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.835668 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834680    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/00471982-2782-4f5b-ba82-817b30032b0d-etc-selinux\") pod \"aws-ebs-csi-driver-node-hv49k\" (UID: \"00471982-2782-4f5b-ba82-817b30032b0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.835668 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834746    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c580ab2-446f-44b2-931e-444d49271760-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kg6gg\" (UID: \"6c580ab2-446f-44b2-931e-444d49271760\") " pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.835668 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834765    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c580ab2-446f-44b2-931e-444d49271760-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kg6gg\" (UID: \"6c580ab2-446f-44b2-931e-444d49271760\") " pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.835668 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834808    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-run-systemd\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.835668 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834816    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-multus-conf-dir\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.835668 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834750    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-etc-kubernetes\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.835668 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834822    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d36ed006-6ecd-49cd-b7b1-965233accc84-dbus\") pod \"global-pull-secret-syncer-frqd6\" (UID: \"d36ed006-6ecd-49cd-b7b1-965233accc84\") " pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:50:49.835668 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834865    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-ovnkube-script-lib\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.835668 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834870    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-var-lib-kubelet\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.835668 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834953    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-etc-openvswitch\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.836734 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.834949    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-etc-modprobe-d\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.836734 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.835035    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-etc-sysconfig\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.836734 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.835062    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/54e3cf09-d6a2-4c32-8301-524f7a81716f-multus-daemon-config\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.836734 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.835089    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c580ab2-446f-44b2-931e-444d49271760-cnibin\") pod \"multus-additional-cni-plugins-kg6gg\" (UID: \"6c580ab2-446f-44b2-931e-444d49271760\") " pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.836734 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.835126    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/270820a5-0bb6-46db-affd-a9ec2c639a9c-tmp-dir\") pod \"node-resolver-sxwp6\" (UID: \"270820a5-0bb6-46db-affd-a9ec2c639a9c\") " pod="openshift-dns/node-resolver-sxwp6"
Sep 15 07:50:49.836734 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.835138    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f932980-e655-449a-8497-e65577afede4-host-slash\") pod \"iptables-alerter-vz2jd\" (UID: \"6f932980-e655-449a-8497-e65577afede4\") " pod="openshift-network-operator/iptables-alerter-vz2jd"
Sep 15 07:50:49.836734 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.835128    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-host-run-netns\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.836734 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.835179    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/54e3cf09-d6a2-4c32-8301-524f7a81716f-multus-socket-dir-parent\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.836734 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.835285    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-var-lib-openvswitch\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.836734 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.835364    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-ovnkube-config\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.836734 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.835457    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-env-overrides\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.836734 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.835618    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c580ab2-446f-44b2-931e-444d49271760-cni-binary-copy\") pod \"multus-additional-cni-plugins-kg6gg\" (UID: \"6c580ab2-446f-44b2-931e-444d49271760\") " pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.837993 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.837958    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-ovn-node-metrics-cert\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.838278 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.838229    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-tmp\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.839605 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.839564    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-etc-tuned\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.842028 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.841811    2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 07:50:49.844588 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.844159    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72g7s\" (UniqueName: \"kubernetes.io/projected/93bb56c0-c79e-4d0c-bd40-9d2f205fcb66-kube-api-access-72g7s\") pod \"tuned-hvlpq\" (UID: \"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66\") " pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.845956 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.845865    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfm57\" (UniqueName: \"kubernetes.io/projected/6f932980-e655-449a-8497-e65577afede4-kube-api-access-sfm57\") pod \"iptables-alerter-vz2jd\" (UID: \"6f932980-e655-449a-8497-e65577afede4\") " pod="openshift-network-operator/iptables-alerter-vz2jd"
Sep 15 07:50:49.846479 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.846452    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48dn8\" (UniqueName: \"kubernetes.io/projected/270820a5-0bb6-46db-affd-a9ec2c639a9c-kube-api-access-48dn8\") pod \"node-resolver-sxwp6\" (UID: \"270820a5-0bb6-46db-affd-a9ec2c639a9c\") " pod="openshift-dns/node-resolver-sxwp6"
Sep 15 07:50:49.847354 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.847261    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zvgl\" (UniqueName: \"kubernetes.io/projected/6c580ab2-446f-44b2-931e-444d49271760-kube-api-access-7zvgl\") pod \"multus-additional-cni-plugins-kg6gg\" (UID: \"6c580ab2-446f-44b2-931e-444d49271760\") " pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:49.847944 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.847744    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4kgw\" (UniqueName: \"kubernetes.io/projected/54e3cf09-d6a2-4c32-8301-524f7a81716f-kube-api-access-w4kgw\") pod \"multus-vzrd7\" (UID: \"54e3cf09-d6a2-4c32-8301-524f7a81716f\") " pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.848407 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.848384    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6dlc\" (UniqueName: \"kubernetes.io/projected/00471982-2782-4f5b-ba82-817b30032b0d-kube-api-access-p6dlc\") pod \"aws-ebs-csi-driver-node-hv49k\" (UID: \"00471982-2782-4f5b-ba82-817b30032b0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.850974 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.850950    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zgsx\" (UniqueName: \"kubernetes.io/projected/ddfadb96-d9a7-4e5a-b004-6e456cbd8b53-kube-api-access-4zgsx\") pod \"ovnkube-node-zlqdd\" (UID: \"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.921998 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.921961    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tm9mm"
Sep 15 07:50:49.931377 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.931337    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5wmdc"
Sep 15 07:50:49.941769 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.941742    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sxwp6"
Sep 15 07:50:49.949102 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.949081    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k"
Sep 15 07:50:49.958964 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.958940    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vzrd7"
Sep 15 07:50:49.966983 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.966952    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hvlpq"
Sep 15 07:50:49.975071 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.974890    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:50:49.983858 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.983835    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vz2jd"
Sep 15 07:50:49.989809 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:49.989791    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kg6gg"
Sep 15 07:50:50.234737 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:50.234633    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs\") pod \"network-metrics-daemon-dhdbz\" (UID: \"1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0\") " pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:50:50.234919 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:50.234770    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:50:50.234919 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:50.234850    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs podName:1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0 nodeName:}" failed. No retries permitted until 2026-09-15 07:50:51.234829871 +0000 UTC m=+4.026292591 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs") pod "network-metrics-daemon-dhdbz" (UID: "1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:50:50.335644 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:50.335605    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret\") pod \"global-pull-secret-syncer-frqd6\" (UID: \"d36ed006-6ecd-49cd-b7b1-965233accc84\") " pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:50:50.335838 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:50.335697    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6knx\" (UniqueName: \"kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx\") pod \"network-check-target-q6bn9\" (UID: \"6d3e2b9a-08af-462b-b07c-7f082791973c\") " pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:50:50.335838 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:50.335788    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 07:50:50.335955 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:50.335875    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret podName:d36ed006-6ecd-49cd-b7b1-965233accc84 nodeName:}" failed. No retries permitted until 2026-09-15 07:50:51.335854338 +0000 UTC m=+4.127317057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret") pod "global-pull-secret-syncer-frqd6" (UID: "d36ed006-6ecd-49cd-b7b1-965233accc84") : object "kube-system"/"original-pull-secret" not registered
Sep 15 07:50:50.335955 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:50.335881    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 07:50:50.335955 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:50.335903    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 07:50:50.335955 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:50.335913    2586 projected.go:196] Error preparing data for projected volume kube-api-access-q6knx for pod openshift-network-diagnostics/network-check-target-q6bn9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:50:50.336154 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:50.335967    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx podName:6d3e2b9a-08af-462b-b07c-7f082791973c nodeName:}" failed. No retries permitted until 2026-09-15 07:50:51.335949714 +0000 UTC m=+4.127412422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q6knx" (UniqueName: "kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx") pod "network-check-target-q6bn9" (UID: "6d3e2b9a-08af-462b-b07c-7f082791973c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:50:50.662646 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:50.662562    2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 07:45:50 +0000 UTC" deadline="2028-04-27 17:18:49.543978303 +0000 UTC"
Sep 15 07:50:50.662646 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:50.662600    2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14169h27m58.881381847s"
Sep 15 07:50:51.039247 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:51.039222    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e3cf09_d6a2_4c32_8301_524f7a81716f.slice/crio-8e6785629bc9af817a0fabfb44cfba658aea5f726021284c9b588f6a1a8970ee WatchSource:0}: Error finding container 8e6785629bc9af817a0fabfb44cfba658aea5f726021284c9b588f6a1a8970ee: Status 404 returned error can't find the container with id 8e6785629bc9af817a0fabfb44cfba658aea5f726021284c9b588f6a1a8970ee
Sep 15 07:50:51.061286 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:51.061157    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85304fe9_34fa_4309_be0b_d0403e10229a.slice/crio-a4daa92dea81b4a45b43b3a47b68d100badaf406d72fc3de3e6c4ffb1d012b43 WatchSource:0}: Error finding container a4daa92dea81b4a45b43b3a47b68d100badaf406d72fc3de3e6c4ffb1d012b43: Status 404 returned error can't find the container with id a4daa92dea81b4a45b43b3a47b68d100badaf406d72fc3de3e6c4ffb1d012b43
Sep 15 07:50:51.064436 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:51.064413    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f932980_e655_449a_8497_e65577afede4.slice/crio-6a24ef2518b6712f15e9372a1d47444e6c7e318fa0f97953ce7c7d428293298d WatchSource:0}: Error finding container 6a24ef2518b6712f15e9372a1d47444e6c7e318fa0f97953ce7c7d428293298d: Status 404 returned error can't find the container with id 6a24ef2518b6712f15e9372a1d47444e6c7e318fa0f97953ce7c7d428293298d
Sep 15 07:50:51.068646 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:51.068622    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93bb56c0_c79e_4d0c_bd40_9d2f205fcb66.slice/crio-04e269aa6703f5c1b0b977c167fe3d796e512930d1b9a2703469814632b8227b WatchSource:0}: Error finding container 04e269aa6703f5c1b0b977c167fe3d796e512930d1b9a2703469814632b8227b: Status 404 returned error can't find the container with id 04e269aa6703f5c1b0b977c167fe3d796e512930d1b9a2703469814632b8227b
Sep 15 07:50:51.069897 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:51.069873    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c580ab2_446f_44b2_931e_444d49271760.slice/crio-99d96e30ecae0c98c4af89550d818d28afcbcd454a7e40c41e6876b101b498e5 WatchSource:0}: Error finding container 99d96e30ecae0c98c4af89550d818d28afcbcd454a7e40c41e6876b101b498e5: Status 404 returned error can't find the container with id 99d96e30ecae0c98c4af89550d818d28afcbcd454a7e40c41e6876b101b498e5
Sep 15 07:50:51.071640 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:51.071601    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddfadb96_d9a7_4e5a_b004_6e456cbd8b53.slice/crio-bd808b35493926858532d0036ce1159911feae9c518539c9722c927c61dcc256 WatchSource:0}: Error finding container bd808b35493926858532d0036ce1159911feae9c518539c9722c927c61dcc256: Status 404 returned error can't find the container with id bd808b35493926858532d0036ce1159911feae9c518539c9722c927c61dcc256
Sep 15 07:50:51.072015 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:51.071991    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00471982_2782_4f5b_ba82_817b30032b0d.slice/crio-cc9d96a1d135c1b27c09e7cb71898adef03f98cc7ecaf8e51a07d4eeb9b1d627 WatchSource:0}: Error finding container cc9d96a1d135c1b27c09e7cb71898adef03f98cc7ecaf8e51a07d4eeb9b1d627: Status 404 returned error can't find the container with id cc9d96a1d135c1b27c09e7cb71898adef03f98cc7ecaf8e51a07d4eeb9b1d627
Sep 15 07:50:51.074060 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:51.073023    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod270820a5_0bb6_46db_affd_a9ec2c639a9c.slice/crio-fbadb2e8b37e35917a7b0c964d2411a9052cccc2097a51c823010f73297f01d9 WatchSource:0}: Error finding container fbadb2e8b37e35917a7b0c964d2411a9052cccc2097a51c823010f73297f01d9: Status 404 returned error can't find the container with id fbadb2e8b37e35917a7b0c964d2411a9052cccc2097a51c823010f73297f01d9
Sep 15 07:50:51.074060 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:50:51.073808    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd0cf790_5285_4db4_a40a_d40575ca5514.slice/crio-6ade82f54d881c5d7d48cae9fb20e688edcd1958525b86fde872e61a06499bc8 WatchSource:0}: Error finding container 6ade82f54d881c5d7d48cae9fb20e688edcd1958525b86fde872e61a06499bc8: Status 404 returned error can't find the container with id 6ade82f54d881c5d7d48cae9fb20e688edcd1958525b86fde872e61a06499bc8
Sep 15 07:50:51.243828 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:51.243599    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs\") pod \"network-metrics-daemon-dhdbz\" (UID: \"1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0\") " pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:50:51.243991 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:51.243845    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:50:51.243991 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:51.243917    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs podName:1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0 nodeName:}" failed. No retries permitted until 2026-09-15 07:50:53.243900139 +0000 UTC m=+6.035362856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs") pod "network-metrics-daemon-dhdbz" (UID: "1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:50:51.344299 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:51.344274    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret\") pod \"global-pull-secret-syncer-frqd6\" (UID: \"d36ed006-6ecd-49cd-b7b1-965233accc84\") " pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:50:51.344387 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:51.344323    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6knx\" (UniqueName: \"kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx\") pod \"network-check-target-q6bn9\" (UID: \"6d3e2b9a-08af-462b-b07c-7f082791973c\") " pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:50:51.344430 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:51.344392    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 07:50:51.344430 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:51.344425    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 07:50:51.344509 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:51.344439    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 07:50:51.344509 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:51.344449    2586 projected.go:196] Error preparing data for projected volume kube-api-access-q6knx for pod openshift-network-diagnostics/network-check-target-q6bn9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:50:51.344509 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:51.344448    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret podName:d36ed006-6ecd-49cd-b7b1-965233accc84 nodeName:}" failed. No retries permitted until 2026-09-15 07:50:53.344433419 +0000 UTC m=+6.135896127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret") pod "global-pull-secret-syncer-frqd6" (UID: "d36ed006-6ecd-49cd-b7b1-965233accc84") : object "kube-system"/"original-pull-secret" not registered
Sep 15 07:50:51.344509 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:51.344501    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx podName:6d3e2b9a-08af-462b-b07c-7f082791973c nodeName:}" failed. No retries permitted until 2026-09-15 07:50:53.344485349 +0000 UTC m=+6.135948055 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q6knx" (UniqueName: "kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx") pod "network-check-target-q6bn9" (UID: "6d3e2b9a-08af-462b-b07c-7f082791973c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:50:51.663184 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:51.663066    2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 07:45:50 +0000 UTC" deadline="2028-05-22 12:21:54.194545487 +0000 UTC"
Sep 15 07:50:51.663184 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:51.663124    2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14764h31m2.531425657s"
Sep 15 07:50:51.719411 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:51.719358    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:50:51.719568 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:51.719490    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frqd6" podUID="d36ed006-6ecd-49cd-b7b1-965233accc84"
Sep 15 07:50:51.719632 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:51.719593    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:50:51.719704 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:51.719691    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdbz" podUID="1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0"
Sep 15 07:50:51.719779 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:51.719771    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:50:51.719870 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:51.719843    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6bn9" podUID="6d3e2b9a-08af-462b-b07c-7f082791973c"
Sep 15 07:50:51.730530 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:51.730492    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vz2jd" event={"ID":"6f932980-e655-449a-8497-e65577afede4","Type":"ContainerStarted","Data":"6a24ef2518b6712f15e9372a1d47444e6c7e318fa0f97953ce7c7d428293298d"}
Sep 15 07:50:51.732638 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:51.732604    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5wmdc" event={"ID":"85304fe9-34fa-4309-be0b-d0403e10229a","Type":"ContainerStarted","Data":"a4daa92dea81b4a45b43b3a47b68d100badaf406d72fc3de3e6c4ffb1d012b43"}
Sep 15 07:50:51.735598 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:51.735567    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tm9mm" event={"ID":"fd0cf790-5285-4db4-a40a-d40575ca5514","Type":"ContainerStarted","Data":"6ade82f54d881c5d7d48cae9fb20e688edcd1958525b86fde872e61a06499bc8"}
Sep 15 07:50:51.738939 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:51.738912    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k" event={"ID":"00471982-2782-4f5b-ba82-817b30032b0d","Type":"ContainerStarted","Data":"cc9d96a1d135c1b27c09e7cb71898adef03f98cc7ecaf8e51a07d4eeb9b1d627"}
Sep 15 07:50:51.741012 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:51.740984    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd" event={"ID":"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53","Type":"ContainerStarted","Data":"bd808b35493926858532d0036ce1159911feae9c518539c9722c927c61dcc256"}
Sep 15 07:50:51.742592 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:51.742531    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg6gg" event={"ID":"6c580ab2-446f-44b2-931e-444d49271760","Type":"ContainerStarted","Data":"99d96e30ecae0c98c4af89550d818d28afcbcd454a7e40c41e6876b101b498e5"}
Sep 15 07:50:51.744122 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:51.744098    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vzrd7" event={"ID":"54e3cf09-d6a2-4c32-8301-524f7a81716f","Type":"ContainerStarted","Data":"8e6785629bc9af817a0fabfb44cfba658aea5f726021284c9b588f6a1a8970ee"}
Sep 15 07:50:51.748708 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:51.748683    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-189.ec2.internal" event={"ID":"4bf36dcd150da66bbf96efc4d354ac7b","Type":"ContainerStarted","Data":"eced94a64e1c4292e1c0aee42b7e8b08e480cbdeb725c69f390f34c44b4e7892"}
Sep 15 07:50:51.750896 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:51.750871    2586 generic.go:356] "Generic (PLEG): container finished" podID="4c97f908167f20c09da5c0e0087b3f35" containerID="1f88e00844b0b442107b4c7a5b241262680135ee34149324e346acdb80eebfe0" exitCode=0
Sep 15 07:50:51.751004 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:51.750950    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-189.ec2.internal" event={"ID":"4c97f908167f20c09da5c0e0087b3f35","Type":"ContainerDied","Data":"1f88e00844b0b442107b4c7a5b241262680135ee34149324e346acdb80eebfe0"}
Sep 15 07:50:51.754999 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:51.754972    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sxwp6" event={"ID":"270820a5-0bb6-46db-affd-a9ec2c639a9c","Type":"ContainerStarted","Data":"fbadb2e8b37e35917a7b0c964d2411a9052cccc2097a51c823010f73297f01d9"}
Sep 15 07:50:51.757990 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:51.757966    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hvlpq" event={"ID":"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66","Type":"ContainerStarted","Data":"04e269aa6703f5c1b0b977c167fe3d796e512930d1b9a2703469814632b8227b"}
Sep 15 07:50:51.763472 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:51.763422    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-189.ec2.internal" podStartSLOduration=2.763403988 podStartE2EDuration="2.763403988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:50:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:50:51.76308585 +0000 UTC m=+4.554548579" watchObservedRunningTime="2026-09-15 07:50:51.763403988 +0000 UTC m=+4.554866717"
Sep 15 07:50:52.770377 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:52.770340    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-189.ec2.internal" event={"ID":"4c97f908167f20c09da5c0e0087b3f35","Type":"ContainerStarted","Data":"544d511fe8c006482d38bfd69a0595bd3fbaddc9e37ab535940cf53f9c38e088"}
Sep 15 07:50:53.262087 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:53.261477    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs\") pod \"network-metrics-daemon-dhdbz\" (UID: \"1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0\") " pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:50:53.262087 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:53.261655    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:50:53.262087 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:53.261736    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs podName:1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0 nodeName:}" failed. No retries permitted until 2026-09-15 07:50:57.2617173 +0000 UTC m=+10.053180018 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs") pod "network-metrics-daemon-dhdbz" (UID: "1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:50:53.363359 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:53.362509    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret\") pod \"global-pull-secret-syncer-frqd6\" (UID: \"d36ed006-6ecd-49cd-b7b1-965233accc84\") " pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:50:53.363359 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:53.362579    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6knx\" (UniqueName: \"kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx\") pod \"network-check-target-q6bn9\" (UID: \"6d3e2b9a-08af-462b-b07c-7f082791973c\") " pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:50:53.363359 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:53.362739    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 07:50:53.363359 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:53.362762    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 07:50:53.363359 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:53.362776    2586 projected.go:196] Error preparing data for projected volume kube-api-access-q6knx for pod openshift-network-diagnostics/network-check-target-q6bn9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:50:53.363359 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:53.362853    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx podName:6d3e2b9a-08af-462b-b07c-7f082791973c nodeName:}" failed. No retries permitted until 2026-09-15 07:50:57.362831801 +0000 UTC m=+10.154294523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q6knx" (UniqueName: "kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx") pod "network-check-target-q6bn9" (UID: "6d3e2b9a-08af-462b-b07c-7f082791973c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:50:53.363359 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:53.363259    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 07:50:53.363359 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:53.363308    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret podName:d36ed006-6ecd-49cd-b7b1-965233accc84 nodeName:}" failed. No retries permitted until 2026-09-15 07:50:57.363293692 +0000 UTC m=+10.154756401 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret") pod "global-pull-secret-syncer-frqd6" (UID: "d36ed006-6ecd-49cd-b7b1-965233accc84") : object "kube-system"/"original-pull-secret" not registered
Sep 15 07:50:53.722456 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:53.722373    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:50:53.722636 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:53.722512    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frqd6" podUID="d36ed006-6ecd-49cd-b7b1-965233accc84"
Sep 15 07:50:53.723050 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:53.723027    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:50:53.723163 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:53.723139    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdbz" podUID="1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0"
Sep 15 07:50:53.723225 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:53.723200    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:50:53.723292 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:53.723275    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6bn9" podUID="6d3e2b9a-08af-462b-b07c-7f082791973c"
Sep 15 07:50:55.715614 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:55.714972    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:50:55.715614 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:55.715100    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frqd6" podUID="d36ed006-6ecd-49cd-b7b1-965233accc84"
Sep 15 07:50:55.715614 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:55.715165    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:50:55.715614 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:55.715245    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdbz" podUID="1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0"
Sep 15 07:50:55.715614 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:55.715286    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:50:55.715614 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:55.715349    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6bn9" podUID="6d3e2b9a-08af-462b-b07c-7f082791973c"
Sep 15 07:50:57.300117 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:57.300079    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs\") pod \"network-metrics-daemon-dhdbz\" (UID: \"1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0\") " pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:50:57.300583 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:57.300275    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:50:57.300583 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:57.300342    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs podName:1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:05.300322323 +0000 UTC m=+18.091785043 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs") pod "network-metrics-daemon-dhdbz" (UID: "1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:50:57.401419 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:57.401383    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6knx\" (UniqueName: \"kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx\") pod \"network-check-target-q6bn9\" (UID: \"6d3e2b9a-08af-462b-b07c-7f082791973c\") " pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:50:57.401590 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:57.401472    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret\") pod \"global-pull-secret-syncer-frqd6\" (UID: \"d36ed006-6ecd-49cd-b7b1-965233accc84\") " pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:50:57.401590 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:57.401574    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 07:50:57.401731 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:57.401601    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 07:50:57.401731 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:57.401613    2586 projected.go:196] Error preparing data for projected volume kube-api-access-q6knx for pod openshift-network-diagnostics/network-check-target-q6bn9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:50:57.401731 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:57.401679    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx podName:6d3e2b9a-08af-462b-b07c-7f082791973c nodeName:}" failed. No retries permitted until 2026-09-15 07:51:05.401665638 +0000 UTC m=+18.193128344 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q6knx" (UniqueName: "kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx") pod "network-check-target-q6bn9" (UID: "6d3e2b9a-08af-462b-b07c-7f082791973c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:50:57.402040 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:57.401581    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 07:50:57.402040 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:57.402011    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret podName:d36ed006-6ecd-49cd-b7b1-965233accc84 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:05.40199765 +0000 UTC m=+18.193460355 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret") pod "global-pull-secret-syncer-frqd6" (UID: "d36ed006-6ecd-49cd-b7b1-965233accc84") : object "kube-system"/"original-pull-secret" not registered
Sep 15 07:50:57.716050 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:57.715694    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:50:57.720441 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:57.717861    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6bn9" podUID="6d3e2b9a-08af-462b-b07c-7f082791973c"
Sep 15 07:50:57.720441 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:57.718278    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:50:57.720441 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:57.718403    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frqd6" podUID="d36ed006-6ecd-49cd-b7b1-965233accc84"
Sep 15 07:50:57.720441 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:57.718470    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:50:57.720441 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:57.718589    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdbz" podUID="1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0"
Sep 15 07:50:59.719558 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:59.719528    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:50:59.720123 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:59.719681    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frqd6" podUID="d36ed006-6ecd-49cd-b7b1-965233accc84"
Sep 15 07:50:59.720123 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:59.720042    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:50:59.720220 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:59.720141    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6bn9" podUID="6d3e2b9a-08af-462b-b07c-7f082791973c"
Sep 15 07:50:59.720220 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:50:59.720045    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:50:59.720283 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:50:59.720251    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdbz" podUID="1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0"
Sep 15 07:51:01.715287 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:01.715189    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:51:01.715287 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:01.715202    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:51:01.715287 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:01.715189    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:51:01.715816 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:01.715307    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6bn9" podUID="6d3e2b9a-08af-462b-b07c-7f082791973c"
Sep 15 07:51:01.715816 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:01.715435    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frqd6" podUID="d36ed006-6ecd-49cd-b7b1-965233accc84"
Sep 15 07:51:01.715816 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:01.715533    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdbz" podUID="1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0"
Sep 15 07:51:03.715248 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:03.715207    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:51:03.715715 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:03.715207    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:51:03.715715 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:03.715353    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdbz" podUID="1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0"
Sep 15 07:51:03.715715 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:03.715220    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:51:03.715715 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:03.715417    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6bn9" podUID="6d3e2b9a-08af-462b-b07c-7f082791973c"
Sep 15 07:51:03.715715 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:03.715498    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frqd6" podUID="d36ed006-6ecd-49cd-b7b1-965233accc84"
Sep 15 07:51:05.357449 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:05.357409    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs\") pod \"network-metrics-daemon-dhdbz\" (UID: \"1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0\") " pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:51:05.357980 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:05.357576    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:51:05.357980 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:05.357663    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs podName:1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:21.357645451 +0000 UTC m=+34.149108167 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs") pod "network-metrics-daemon-dhdbz" (UID: "1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:51:05.458410 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:05.458370    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6knx\" (UniqueName: \"kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx\") pod \"network-check-target-q6bn9\" (UID: \"6d3e2b9a-08af-462b-b07c-7f082791973c\") " pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:51:05.458600 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:05.458450    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret\") pod \"global-pull-secret-syncer-frqd6\" (UID: \"d36ed006-6ecd-49cd-b7b1-965233accc84\") " pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:51:05.458600 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:05.458567    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 07:51:05.458600 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:05.458583    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 07:51:05.458600 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:05.458603    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 07:51:05.458847 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:05.458615    2586 projected.go:196] Error preparing data for projected volume kube-api-access-q6knx for pod openshift-network-diagnostics/network-check-target-q6bn9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:51:05.458847 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:05.458628    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret podName:d36ed006-6ecd-49cd-b7b1-965233accc84 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:21.458610851 +0000 UTC m=+34.250073567 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret") pod "global-pull-secret-syncer-frqd6" (UID: "d36ed006-6ecd-49cd-b7b1-965233accc84") : object "kube-system"/"original-pull-secret" not registered
Sep 15 07:51:05.458847 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:05.458666    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx podName:6d3e2b9a-08af-462b-b07c-7f082791973c nodeName:}" failed. No retries permitted until 2026-09-15 07:51:21.458654499 +0000 UTC m=+34.250117208 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q6knx" (UniqueName: "kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx") pod "network-check-target-q6bn9" (UID: "6d3e2b9a-08af-462b-b07c-7f082791973c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:51:05.715764 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:05.715679    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:51:05.715764 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:05.715721    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:51:05.715987 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:05.715685    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:51:05.715987 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:05.715824    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdbz" podUID="1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0"
Sep 15 07:51:05.715987 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:05.715903    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frqd6" podUID="d36ed006-6ecd-49cd-b7b1-965233accc84"
Sep 15 07:51:05.716145 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:05.715991    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6bn9" podUID="6d3e2b9a-08af-462b-b07c-7f082791973c"
Sep 15 07:51:07.716408 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:07.716375    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:51:07.716875 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:07.716486    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdbz" podUID="1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0"
Sep 15 07:51:07.716943 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:07.716919    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:51:07.717031 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:07.717016    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:51:07.717089 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:07.717046    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6bn9" podUID="6d3e2b9a-08af-462b-b07c-7f082791973c"
Sep 15 07:51:07.717137 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:07.717098    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frqd6" podUID="d36ed006-6ecd-49cd-b7b1-965233accc84"
Sep 15 07:51:09.715614 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.715362    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:51:09.716225 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.715362    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:51:09.716225 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:09.715692    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6bn9" podUID="6d3e2b9a-08af-462b-b07c-7f082791973c"
Sep 15 07:51:09.716225 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:09.715753    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdbz" podUID="1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0"
Sep 15 07:51:09.716225 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.715364    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:51:09.716225 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:09.715853    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frqd6" podUID="d36ed006-6ecd-49cd-b7b1-965233accc84"
Sep 15 07:51:09.809338 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.809289    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vzrd7" event={"ID":"54e3cf09-d6a2-4c32-8301-524f7a81716f","Type":"ContainerStarted","Data":"269222f834d81943fb6011c21075e60d67a9d9354c2ca7af8f773f08d8fb2b67"}
Sep 15 07:51:09.810943 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.810916    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sxwp6" event={"ID":"270820a5-0bb6-46db-affd-a9ec2c639a9c","Type":"ContainerStarted","Data":"f6d1ebc02827aa4039ad46fdfeed187baa6a72c67b5adc54fd1089aca772e097"}
Sep 15 07:51:09.812520 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.812491    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hvlpq" event={"ID":"93bb56c0-c79e-4d0c-bd40-9d2f205fcb66","Type":"ContainerStarted","Data":"a584a76bd0fb0122a59b6b9220eb485ac25c3fcefaffe0ce3e9e4f7023748349"}
Sep 15 07:51:09.814097 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.814068    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5wmdc" event={"ID":"85304fe9-34fa-4309-be0b-d0403e10229a","Type":"ContainerStarted","Data":"38409a96ad317e0b4000a8e18807012d92e200ec147f37f9d6ddf89ee2750884"}
Sep 15 07:51:09.815673 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.815649    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tm9mm" event={"ID":"fd0cf790-5285-4db4-a40a-d40575ca5514","Type":"ContainerStarted","Data":"1fa393642a4a8dc68cab4a5dcbe280d4fd79fda5bb72ab6a6f225328619a4b2c"}
Sep 15 07:51:09.817217 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.817194    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k" event={"ID":"00471982-2782-4f5b-ba82-817b30032b0d","Type":"ContainerStarted","Data":"b2fc2e912e8d833ce4107a71f7514afb36daac2814eb4b59fcceca26018c581d"}
Sep 15 07:51:09.820395 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.820376    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd" event={"ID":"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53","Type":"ContainerStarted","Data":"4514d22005d5b4d1809920ef32150717104097d1a0be84768cafaccd23272d04"}
Sep 15 07:51:09.820505 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.820446    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd" event={"ID":"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53","Type":"ContainerStarted","Data":"b2d8530f9b79689bf588c75d4a97538e756648e1089dca23fe084123d373ee48"}
Sep 15 07:51:09.820505 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.820501    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd" event={"ID":"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53","Type":"ContainerStarted","Data":"017e73ee05ae735d9eba90b71406aab8d274f0e803d74536c995f714eb83487f"}
Sep 15 07:51:09.820618 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.820548    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd" event={"ID":"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53","Type":"ContainerStarted","Data":"60885f0986ad0fce406544ed048d5b31a08fb2b636c141451bcbfaa92fbfd65b"}
Sep 15 07:51:09.820618 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.820596    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd" event={"ID":"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53","Type":"ContainerStarted","Data":"3ab9611b9df71c348e80582f17adccf87717eafa01655f1160a99e47cffe256e"}
Sep 15 07:51:09.820735 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.820665    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd" event={"ID":"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53","Type":"ContainerStarted","Data":"6f837cca3c08ed696e8ac655e364765a1854349f0101b2820ff6d0fb5b1fcded"}
Sep 15 07:51:09.821776 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.821756    2586 generic.go:356] "Generic (PLEG): container finished" podID="6c580ab2-446f-44b2-931e-444d49271760" containerID="3dae100b91e82aa4d7d63b553c3007e9eae97a8f4e6c5a45b84c39b466f5fcb0" exitCode=0
Sep 15 07:51:09.821862 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.821782    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg6gg" event={"ID":"6c580ab2-446f-44b2-931e-444d49271760","Type":"ContainerDied","Data":"3dae100b91e82aa4d7d63b553c3007e9eae97a8f4e6c5a45b84c39b466f5fcb0"}
Sep 15 07:51:09.825615 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.825577    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-189.ec2.internal" podStartSLOduration=20.825565624 podStartE2EDuration="20.825565624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:50:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:50:52.786558276 +0000 UTC m=+5.578021006" watchObservedRunningTime="2026-09-15 07:51:09.825565624 +0000 UTC m=+22.617028347"
Sep 15 07:51:09.826022 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.825994    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vzrd7" podStartSLOduration=4.164859067 podStartE2EDuration="21.825985626s" totalImagesPullingTime="17.661126559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:09.825434438 +0000 UTC m=+22.616897160" watchObservedRunningTime="2026-09-15 07:51:09.825985626 +0000 UTC m=+22.617448349"
Sep 15 07:51:09.838519 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.838482    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tm9mm" podStartSLOduration=4.433918159 podStartE2EDuration="21.83846969s" totalImagesPullingTime="17.404551531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:09.838309098 +0000 UTC m=+22.629771832" watchObservedRunningTime="2026-09-15 07:51:09.83846969 +0000 UTC m=+22.629932412"
Sep 15 07:51:09.852920 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.852887    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5wmdc" podStartSLOduration=4.435841733 podStartE2EDuration="21.852875714s" totalImagesPullingTime="17.417033981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:09.852775378 +0000 UTC m=+22.644238101" watchObservedRunningTime="2026-09-15 07:51:09.852875714 +0000 UTC m=+22.644338433"
Sep 15 07:51:09.887644 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.887602    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sxwp6" podStartSLOduration=4.241374641 podStartE2EDuration="21.88758926s" totalImagesPullingTime="17.646214619s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:09.887434102 +0000 UTC m=+22.678896824" watchObservedRunningTime="2026-09-15 07:51:09.88758926 +0000 UTC m=+22.679051983"
Sep 15 07:51:09.903067 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:09.903025    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hvlpq" podStartSLOduration=4.253112151 podStartE2EDuration="21.903012887s" totalImagesPullingTime="17.649900736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:09.902778146 +0000 UTC m=+22.694240870" watchObservedRunningTime="2026-09-15 07:51:09.903012887 +0000 UTC m=+22.694475609"
Sep 15 07:51:10.097940 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:10.097870    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5wmdc"
Sep 15 07:51:10.606299 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:10.606275    2586 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 07:51:10.683626 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:10.683523    2586 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T07:51:10.606293655Z","UUID":"d3982ab3-43c3-4502-9c79-56eba5f4d471","Handler":null,"Name":"","Endpoint":""}
Sep 15 07:51:10.685290 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:10.685262    2586 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 07:51:10.685407 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:10.685296    2586 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 07:51:10.826583 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:10.826503    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k" event={"ID":"00471982-2782-4f5b-ba82-817b30032b0d","Type":"ContainerStarted","Data":"42a766234b411c4d5e8c697e62eee40e407e37045b854e153629bb8989d3f1b5"}
Sep 15 07:51:10.828112 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:10.828075    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vz2jd" event={"ID":"6f932980-e655-449a-8497-e65577afede4","Type":"ContainerStarted","Data":"1a2779d81d3ea55a2551d5e9fa8ca3f0d0ced863e5d1a7ae375ecfe85f82b498"}
Sep 15 07:51:10.843377 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:10.843337    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vz2jd" podStartSLOduration=5.195416327 podStartE2EDuration="22.84332299s" totalImagesPullingTime="17.647906663s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:10.842899669 +0000 UTC m=+23.634362394" watchObservedRunningTime="2026-09-15 07:51:10.84332299 +0000 UTC m=+23.634785710"
Sep 15 07:51:11.715241 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:11.715159    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:51:11.715405 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:11.715166    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:51:11.715405 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:11.715289    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:51:11.715405 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:11.715290    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6bn9" podUID="6d3e2b9a-08af-462b-b07c-7f082791973c"
Sep 15 07:51:11.715405 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:11.715390    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frqd6" podUID="d36ed006-6ecd-49cd-b7b1-965233accc84"
Sep 15 07:51:11.715593 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:11.715485    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdbz" podUID="1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0"
Sep 15 07:51:11.834082 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:11.834025    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd" event={"ID":"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53","Type":"ContainerStarted","Data":"99ab45c10b5201cf4b0ab1eb73a2830379efad5f67774771ebd2d28832329349"}
Sep 15 07:51:12.838594 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:12.838406    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k" event={"ID":"00471982-2782-4f5b-ba82-817b30032b0d","Type":"ContainerStarted","Data":"69e3801362b84a7e57bab26db0b3f6fd72926d7d9cf4877e674d8ee4efaeefe3"}
Sep 15 07:51:12.856230 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:12.856169    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hv49k" podStartSLOduration=4.448047197 podStartE2EDuration="24.856149765s" totalImagesPullingTime="20.408102568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:50:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:12.855728078 +0000 UTC m=+25.647190800" watchObservedRunningTime="2026-09-15 07:51:12.856149765 +0000 UTC m=+25.647612483"
Sep 15 07:51:13.715608 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:13.715573    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:51:13.715788 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:13.715588    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:51:13.715788 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:13.715714    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdbz" podUID="1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0"
Sep 15 07:51:13.715788 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:13.715726    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:51:13.715949 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:13.715843    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frqd6" podUID="d36ed006-6ecd-49cd-b7b1-965233accc84"
Sep 15 07:51:13.715949 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:13.715916    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6bn9" podUID="6d3e2b9a-08af-462b-b07c-7f082791973c"
Sep 15 07:51:14.625379 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:14.625349    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5wmdc"
Sep 15 07:51:14.625874 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:14.625856    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5wmdc"
Sep 15 07:51:14.846854 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:14.846825    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd" event={"ID":"ddfadb96-d9a7-4e5a-b004-6e456cbd8b53","Type":"ContainerStarted","Data":"bd0b5277731ca3338e0ce74fd642db0bf54f29c578f548c1bc3ae16724c72ff4"}
Sep 15 07:51:14.847459 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:14.847439    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5wmdc"
Sep 15 07:51:14.874546 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:14.874504    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd" podStartSLOduration=9.173610082 podStartE2EDuration="26.874491695s" totalImagesPullingTime="17.700881613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:14.874166374 +0000 UTC m=+27.665629097" watchObservedRunningTime="2026-09-15 07:51:14.874491695 +0000 UTC m=+27.665954418"
Sep 15 07:51:15.717996 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:15.717962    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:51:15.718425 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:15.718050    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:51:15.718425 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:15.718068    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frqd6" podUID="d36ed006-6ecd-49cd-b7b1-965233accc84"
Sep 15 07:51:15.718425 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:15.718080    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:51:15.718425 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:15.718146    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdbz" podUID="1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0"
Sep 15 07:51:15.718425 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:15.718203    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6bn9" podUID="6d3e2b9a-08af-462b-b07c-7f082791973c"
Sep 15 07:51:15.850910 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:15.850875    2586 generic.go:356] "Generic (PLEG): container finished" podID="6c580ab2-446f-44b2-931e-444d49271760" containerID="63bf0c7e592e54de063639c929caa087a1c98b31f1d3a70aaa6396523662107b" exitCode=0
Sep 15 07:51:15.851080 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:15.850955    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg6gg" event={"ID":"6c580ab2-446f-44b2-931e-444d49271760","Type":"ContainerDied","Data":"63bf0c7e592e54de063639c929caa087a1c98b31f1d3a70aaa6396523662107b"}
Sep 15 07:51:15.852211 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:15.851605    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:51:15.852211 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:15.851693    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:51:15.852211 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:15.851726    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:51:15.866573 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:15.866548    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:51:15.867023 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:15.867005    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:51:16.655978 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:16.655947    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-frqd6"]
Sep 15 07:51:16.656201 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:16.656037    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:51:16.656201 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:16.656124    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frqd6" podUID="d36ed006-6ecd-49cd-b7b1-965233accc84"
Sep 15 07:51:16.659354 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:16.659328    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dhdbz"]
Sep 15 07:51:16.659493 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:16.659423    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:51:16.659617 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:16.659578    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdbz" podUID="1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0"
Sep 15 07:51:16.660137 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:16.660112    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q6bn9"]
Sep 15 07:51:16.660222 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:16.660201    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:51:16.660323 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:16.660297    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6bn9" podUID="6d3e2b9a-08af-462b-b07c-7f082791973c"
Sep 15 07:51:17.716359 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:17.716331    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:51:17.717107 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:17.716418    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frqd6" podUID="d36ed006-6ecd-49cd-b7b1-965233accc84"
Sep 15 07:51:18.715880 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:18.715616    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:51:18.715880 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:18.715681    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:51:18.716083 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:18.715906    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6bn9" podUID="6d3e2b9a-08af-462b-b07c-7f082791973c"
Sep 15 07:51:18.716083 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:18.715945    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdbz" podUID="1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0"
Sep 15 07:51:18.860443 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:18.860409    2586 generic.go:356] "Generic (PLEG): container finished" podID="6c580ab2-446f-44b2-931e-444d49271760" containerID="c9c5f9c6596c0d0e1b4a299511b477add857039cd0b10e07739742da8d2c1942" exitCode=0
Sep 15 07:51:18.860857 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:18.860451    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg6gg" event={"ID":"6c580ab2-446f-44b2-931e-444d49271760","Type":"ContainerDied","Data":"c9c5f9c6596c0d0e1b4a299511b477add857039cd0b10e07739742da8d2c1942"}
Sep 15 07:51:19.715360 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:19.715330    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:51:19.715531 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:19.715449    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-frqd6" podUID="d36ed006-6ecd-49cd-b7b1-965233accc84"
Sep 15 07:51:20.715408 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:20.715382    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:51:20.715796 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:20.715385    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:51:20.715796 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:20.715472    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6bn9" podUID="6d3e2b9a-08af-462b-b07c-7f082791973c"
Sep 15 07:51:20.715796 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:20.715577    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhdbz" podUID="1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0"
Sep 15 07:51:20.867126 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:20.867094    2586 generic.go:356] "Generic (PLEG): container finished" podID="6c580ab2-446f-44b2-931e-444d49271760" containerID="a2d22793a6f338a7b3e2d3b6f9aa52c150c93619d822cb2d33527830005c5748" exitCode=0
Sep 15 07:51:20.867304 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:20.867146    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg6gg" event={"ID":"6c580ab2-446f-44b2-931e-444d49271760","Type":"ContainerDied","Data":"a2d22793a6f338a7b3e2d3b6f9aa52c150c93619d822cb2d33527830005c5748"}
Sep 15 07:51:21.372514 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.372477    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs\") pod \"network-metrics-daemon-dhdbz\" (UID: \"1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0\") " pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:51:21.372711 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.372657    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:51:21.372791 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.372733    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs podName:1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:53.372712806 +0000 UTC m=+66.164175521 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs") pod "network-metrics-daemon-dhdbz" (UID: "1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 07:51:21.473644 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.473548    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret\") pod \"global-pull-secret-syncer-frqd6\" (UID: \"d36ed006-6ecd-49cd-b7b1-965233accc84\") " pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:51:21.473644 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.473621    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6knx\" (UniqueName: \"kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx\") pod \"network-check-target-q6bn9\" (UID: \"6d3e2b9a-08af-462b-b07c-7f082791973c\") " pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:51:21.473853 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.473719    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 07:51:21.473853 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.473769    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 07:51:21.473853 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.473790    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 07:51:21.473853 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.473805    2586 projected.go:196] Error preparing data for projected volume kube-api-access-q6knx for pod openshift-network-diagnostics/network-check-target-q6bn9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:51:21.473853 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.473793    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret podName:d36ed006-6ecd-49cd-b7b1-965233accc84 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:53.473773303 +0000 UTC m=+66.265236021 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret") pod "global-pull-secret-syncer-frqd6" (UID: "d36ed006-6ecd-49cd-b7b1-965233accc84") : object "kube-system"/"original-pull-secret" not registered
Sep 15 07:51:21.474049 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.473858    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx podName:6d3e2b9a-08af-462b-b07c-7f082791973c nodeName:}" failed. No retries permitted until 2026-09-15 07:51:53.473847661 +0000 UTC m=+66.265310361 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q6knx" (UniqueName: "kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx") pod "network-check-target-q6bn9" (UID: "6d3e2b9a-08af-462b-b07c-7f082791973c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 07:51:21.522385 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.522350    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-189.ec2.internal" event="NodeReady"
Sep 15 07:51:21.522542 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.522494    2586 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 07:51:21.558825 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.558796    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672"]
Sep 15 07:51:21.562441 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.562416    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672"
Sep 15 07:51:21.564682 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.564325    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-n97wk"]
Sep 15 07:51:21.566430 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.566410    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 15 07:51:21.566531 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.566476    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 07:51:21.567608 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.567585    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kmb2h\""
Sep 15 07:51:21.567721 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.567650    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 15 07:51:21.567721 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.567702    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 07:51:21.568114 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.568089    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-th7m6"]
Sep 15 07:51:21.568208 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.568185    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-n97wk"
Sep 15 07:51:21.570266 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.570129    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 15 07:51:21.570694 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.570672    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 15 07:51:21.570694 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.570669    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 15 07:51:21.570923 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.570909    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 15 07:51:21.570979 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.570931    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-b6v4d\""
Sep 15 07:51:21.572236 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.571774    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-xr5xn"]
Sep 15 07:51:21.572236 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.572034    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-th7m6"
Sep 15 07:51:21.574250 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.574227    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-tb7ms\""
Sep 15 07:51:21.574250 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.574245    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 15 07:51:21.574793 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.574744    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 15 07:51:21.574896 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.574826    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 15 07:51:21.577708 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.576580    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-cp9wl"]
Sep 15 07:51:21.577708 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.576950    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xr5xn"
Sep 15 07:51:21.586980 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.585176    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 15 07:51:21.586980 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.585416    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 15 07:51:21.586980 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.585589    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 15 07:51:21.586980 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.585791    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-5hw44\""
Sep 15 07:51:21.586980 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.585941    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 15 07:51:21.588215 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.587407    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-srb27"]
Sep 15 07:51:21.588215 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.587843    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-cp9wl"
Sep 15 07:51:21.591150 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.591100    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-669c6d8db4-rp2c5"]
Sep 15 07:51:21.591322 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.591309    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-srb27"
Sep 15 07:51:21.592449 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.592429    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 15 07:51:21.592705 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.591573    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 15 07:51:21.593711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.592122    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 15 07:51:21.593711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.592192    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-pdqkm\""
Sep 15 07:51:21.593711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.591511    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 15 07:51:21.595507 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.594671    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86dd9785f-ctwrx"]
Sep 15 07:51:21.595743 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.595722    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 15 07:51:21.595867 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.595850    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:21.595996 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.595980    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xk5rx\""
Sep 15 07:51:21.596600 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.596582    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 15 07:51:21.598271 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.598254    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 15 07:51:21.598417 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.598400    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.598489 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.598342    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-fth5n"]
Sep 15 07:51:21.599723 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.599701    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 15 07:51:21.599815 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.599744    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 15 07:51:21.599877 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.599843    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 15 07:51:21.599936 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.599883    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 15 07:51:21.600038 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.600024    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 15 07:51:21.600097 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.600078    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 15 07:51:21.600452 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.600433    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4qhqj\""
Sep 15 07:51:21.602482 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.602458    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 15 07:51:21.603289 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.603271    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7bsc5\""
Sep 15 07:51:21.603564 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.603536    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 15 07:51:21.603814 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.603797    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 15 07:51:21.604020 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.603998    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-rrtj4"]
Sep 15 07:51:21.604517 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.604498    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-fth5n"
Sep 15 07:51:21.607302 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.607262    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-wwv7l"]
Sep 15 07:51:21.607396 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.607375    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rrtj4"
Sep 15 07:51:21.608258 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.608237    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 15 07:51:21.608349 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.608279    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 07:51:21.608349 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.608299    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 07:51:21.608471 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.608374    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bswmb\""
Sep 15 07:51:21.608471 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.608445    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 15 07:51:21.610180 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.610058    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 15 07:51:21.611788 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.611766    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9gpbx\""
Sep 15 07:51:21.612010 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.611989    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672"]
Sep 15 07:51:21.612074 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.612044    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-xr5xn"]
Sep 15 07:51:21.612074 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.612069    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-n97wk"]
Sep 15 07:51:21.612172 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.612100    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-th7m6"]
Sep 15 07:51:21.612172 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.612137    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-srb27"]
Sep 15 07:51:21.612172 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.612145    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 15 07:51:21.612172 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.612159    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-669c6d8db4-rp2c5"]
Sep 15 07:51:21.612343 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.612185    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86dd9785f-ctwrx"]
Sep 15 07:51:21.612343 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.612206    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-wwv7l"]
Sep 15 07:51:21.612343 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.612233    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-fth5n"]
Sep 15 07:51:21.612343 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.612252    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kdpdg"]
Sep 15 07:51:21.617941 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.616199    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-wwv7l"
Sep 15 07:51:21.617941 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.617542    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 15 07:51:21.619143 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.619123    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hnrrg"]
Sep 15 07:51:21.619253 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.619166    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qn8rh\""
Sep 15 07:51:21.619417 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.619369    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 07:51:21.619507 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.619470    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 07:51:21.620024 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.620007    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kdpdg"
Sep 15 07:51:21.623256 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.623235    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 07:51:21.623373 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.623353    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 15 07:51:21.623666 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.623615    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 07:51:21.623911 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.623751    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hgpkq\""
Sep 15 07:51:21.624021 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.624007    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 07:51:21.625294 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.625276    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-cp9wl"]
Sep 15 07:51:21.625452 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.625425    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:51:21.625749 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.625426    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kdpdg"]
Sep 15 07:51:21.625849 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.625768    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-rrtj4"]
Sep 15 07:51:21.625849 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.625786    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hnrrg"]
Sep 15 07:51:21.627832 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.627813    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jf87k\""
Sep 15 07:51:21.628132 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.628117    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 07:51:21.628296 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.628130    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 07:51:21.674323 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674299    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87nwv\" (UniqueName: \"kubernetes.io/projected/2ac26be4-56a7-4bbc-abcb-de5b68959883-kube-api-access-87nwv\") pod \"service-ca-operator-cf7c776b7-xr5xn\" (UID: \"2ac26be4-56a7-4bbc-abcb-de5b68959883\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xr5xn"
Sep 15 07:51:21.674439 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674335    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f07222e9-cd97-4468-81e2-b609ade2d29c-service-ca-bundle\") pod \"insights-operator-5844b856db-fth5n\" (UID: \"f07222e9-cd97-4468-81e2-b609ade2d29c\") " pod="openshift-insights/insights-operator-5844b856db-fth5n"
Sep 15 07:51:21.674439 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674362    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f07222e9-cd97-4468-81e2-b609ade2d29c-serving-cert\") pod \"insights-operator-5844b856db-fth5n\" (UID: \"f07222e9-cd97-4468-81e2-b609ade2d29c\") " pod="openshift-insights/insights-operator-5844b856db-fth5n"
Sep 15 07:51:21.674439 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674396    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-metrics-certs\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:21.674439 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674417    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5527013-2ce3-48e3-b472-a593cbfbb55f-serving-cert\") pod \"console-operator-696884fb9c-cp9wl\" (UID: \"a5527013-2ce3-48e3-b472-a593cbfbb55f\") " pod="openshift-console-operator/console-operator-696884fb9c-cp9wl"
Sep 15 07:51:21.674439 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674437    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfm5x\" (UniqueName: \"kubernetes.io/projected/6b8214e2-c0ae-4ea5-992d-8a1b54e78196-kube-api-access-dfm5x\") pod \"kube-storage-version-migrator-operator-6c8f84f897-n97wk\" (UID: \"6b8214e2-c0ae-4ea5-992d-8a1b54e78196\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-n97wk"
Sep 15 07:51:21.674718 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674462    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw5mr\" (UniqueName: \"kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-kube-api-access-xw5mr\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.674718 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674516    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxf5w\" (UniqueName: \"kubernetes.io/projected/d829a2e5-593c-46f1-b4e9-55ac54ff459e-kube-api-access-sxf5w\") pod \"volume-data-source-validator-86695b7cc7-srb27\" (UID: \"d829a2e5-593c-46f1-b4e9-55ac54ff459e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-srb27"
Sep 15 07:51:21.674718 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674552    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f07222e9-cd97-4468-81e2-b609ade2d29c-tmp\") pod \"insights-operator-5844b856db-fth5n\" (UID: \"f07222e9-cd97-4468-81e2-b609ade2d29c\") " pod="openshift-insights/insights-operator-5844b856db-fth5n"
Sep 15 07:51:21.674718 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674578    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/793a3fee-4d06-4a69-97a5-b3a27db1d916-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-rrtj4\" (UID: \"793a3fee-4d06-4a69-97a5-b3a27db1d916\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rrtj4"
Sep 15 07:51:21.674718 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674646    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h87vz\" (UniqueName: \"kubernetes.io/projected/4bd79376-f224-48c6-8c02-89f1be3e0a14-kube-api-access-h87vz\") pod \"cluster-monitoring-operator-6cd954b897-p5672\" (UID: \"4bd79376-f224-48c6-8c02-89f1be3e0a14\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672"
Sep 15 07:51:21.674718 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674675    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b683e191-3926-4cc6-9326-beefc401a214-ca-trust-extracted\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.674718 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674706    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b683e191-3926-4cc6-9326-beefc401a214-image-registry-private-configuration\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.675043 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674742    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b683e191-3926-4cc6-9326-beefc401a214-trusted-ca\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.675043 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674765    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/793a3fee-4d06-4a69-97a5-b3a27db1d916-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-rrtj4\" (UID: \"793a3fee-4d06-4a69-97a5-b3a27db1d916\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rrtj4"
Sep 15 07:51:21.675043 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674799    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ac26be4-56a7-4bbc-abcb-de5b68959883-config\") pod \"service-ca-operator-cf7c776b7-xr5xn\" (UID: \"2ac26be4-56a7-4bbc-abcb-de5b68959883\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xr5xn"
Sep 15 07:51:21.675043 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674839    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/774b0ac9-0340-4bf4-b619-3d222d5ff31f-service-ca-bundle\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:21.675043 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674870    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5527013-2ce3-48e3-b472-a593cbfbb55f-config\") pod \"console-operator-696884fb9c-cp9wl\" (UID: \"a5527013-2ce3-48e3-b472-a593cbfbb55f\") " pod="openshift-console-operator/console-operator-696884fb9c-cp9wl"
Sep 15 07:51:21.675043 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674885    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a5527013-2ce3-48e3-b472-a593cbfbb55f-trusted-ca\") pod \"console-operator-696884fb9c-cp9wl\" (UID: \"a5527013-2ce3-48e3-b472-a593cbfbb55f\") " pod="openshift-console-operator/console-operator-696884fb9c-cp9wl"
Sep 15 07:51:21.675043 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674902    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg4xs\" (UniqueName: \"kubernetes.io/projected/a5527013-2ce3-48e3-b472-a593cbfbb55f-kube-api-access-gg4xs\") pod \"console-operator-696884fb9c-cp9wl\" (UID: \"a5527013-2ce3-48e3-b472-a593cbfbb55f\") " pod="openshift-console-operator/console-operator-696884fb9c-cp9wl"
Sep 15 07:51:21.675043 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674943    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4s8c\" (UniqueName: \"kubernetes.io/projected/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-kube-api-access-l4s8c\") pod \"cluster-samples-operator-86499c89c4-th7m6\" (UID: \"fb4abd1b-bf9e-4015-99e8-851a2a3e9a83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-th7m6"
Sep 15 07:51:21.675043 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674965    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4bd79376-f224-48c6-8c02-89f1be3e0a14-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-p5672\" (UID: \"4bd79376-f224-48c6-8c02-89f1be3e0a14\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672"
Sep 15 07:51:21.675043 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.674984    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b8214e2-c0ae-4ea5-992d-8a1b54e78196-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-n97wk\" (UID: \"6b8214e2-c0ae-4ea5-992d-8a1b54e78196\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-n97wk"
Sep 15 07:51:21.675043 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.675018    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq7w7\" (UniqueName: \"kubernetes.io/projected/774b0ac9-0340-4bf4-b619-3d222d5ff31f-kube-api-access-gq7w7\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:21.675624 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.675050    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b683e191-3926-4cc6-9326-beefc401a214-installation-pull-secrets\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.675624 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.675069    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-stats-auth\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:21.675624 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.675091    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-default-certificate\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:21.675624 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.675113    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f07222e9-cd97-4468-81e2-b609ade2d29c-snapshots\") pod \"insights-operator-5844b856db-fth5n\" (UID: \"f07222e9-cd97-4468-81e2-b609ade2d29c\") " pod="openshift-insights/insights-operator-5844b856db-fth5n"
Sep 15 07:51:21.675624 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.675133    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8w2c\" (UniqueName: \"kubernetes.io/projected/f07222e9-cd97-4468-81e2-b609ade2d29c-kube-api-access-p8w2c\") pod \"insights-operator-5844b856db-fth5n\" (UID: \"f07222e9-cd97-4468-81e2-b609ade2d29c\") " pod="openshift-insights/insights-operator-5844b856db-fth5n"
Sep 15 07:51:21.675624 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.675154    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frgx5\" (UniqueName: \"kubernetes.io/projected/f0f5c03f-9cf0-42bf-abae-0ede056b7586-kube-api-access-frgx5\") pod \"network-check-source-6f8b768455-wwv7l\" (UID: \"f0f5c03f-9cf0-42bf-abae-0ede056b7586\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-wwv7l"
Sep 15 07:51:21.675624 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.675194    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bd79376-f224-48c6-8c02-89f1be3e0a14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-p5672\" (UID: \"4bd79376-f224-48c6-8c02-89f1be3e0a14\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672"
Sep 15 07:51:21.675624 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.675211    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-bound-sa-token\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.675624 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.675233    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ac26be4-56a7-4bbc-abcb-de5b68959883-serving-cert\") pod \"service-ca-operator-cf7c776b7-xr5xn\" (UID: \"2ac26be4-56a7-4bbc-abcb-de5b68959883\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xr5xn"
Sep 15 07:51:21.675624 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.675315    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b683e191-3926-4cc6-9326-beefc401a214-registry-certificates\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.675624 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.675347    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f07222e9-cd97-4468-81e2-b609ade2d29c-trusted-ca-bundle\") pod \"insights-operator-5844b856db-fth5n\" (UID: \"f07222e9-cd97-4468-81e2-b609ade2d29c\") " pod="openshift-insights/insights-operator-5844b856db-fth5n"
Sep 15 07:51:21.675624 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.675378    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-th7m6\" (UID: \"fb4abd1b-bf9e-4015-99e8-851a2a3e9a83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-th7m6"
Sep 15 07:51:21.675624 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.675403    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.675624 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.675427    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b8214e2-c0ae-4ea5-992d-8a1b54e78196-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-n97wk\" (UID: \"6b8214e2-c0ae-4ea5-992d-8a1b54e78196\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-n97wk"
Sep 15 07:51:21.714987 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.714960    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:51:21.717365 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.717342    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 07:51:21.747206 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.747138    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:21.775886 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.775849    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87nwv\" (UniqueName: \"kubernetes.io/projected/2ac26be4-56a7-4bbc-abcb-de5b68959883-kube-api-access-87nwv\") pod \"service-ca-operator-cf7c776b7-xr5xn\" (UID: \"2ac26be4-56a7-4bbc-abcb-de5b68959883\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xr5xn"
Sep 15 07:51:21.776038 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.775893    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f07222e9-cd97-4468-81e2-b609ade2d29c-service-ca-bundle\") pod \"insights-operator-5844b856db-fth5n\" (UID: \"f07222e9-cd97-4468-81e2-b609ade2d29c\") " pod="openshift-insights/insights-operator-5844b856db-fth5n"
Sep 15 07:51:21.776038 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.775920    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f07222e9-cd97-4468-81e2-b609ade2d29c-serving-cert\") pod \"insights-operator-5844b856db-fth5n\" (UID: \"f07222e9-cd97-4468-81e2-b609ade2d29c\") " pod="openshift-insights/insights-operator-5844b856db-fth5n"
Sep 15 07:51:21.776038 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.775960    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-metrics-certs\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:21.776207 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.776063    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5527013-2ce3-48e3-b472-a593cbfbb55f-serving-cert\") pod \"console-operator-696884fb9c-cp9wl\" (UID: \"a5527013-2ce3-48e3-b472-a593cbfbb55f\") " pod="openshift-console-operator/console-operator-696884fb9c-cp9wl"
Sep 15 07:51:21.776207 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.776072    2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 07:51:21.776207 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.776096    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfm5x\" (UniqueName: \"kubernetes.io/projected/6b8214e2-c0ae-4ea5-992d-8a1b54e78196-kube-api-access-dfm5x\") pod \"kube-storage-version-migrator-operator-6c8f84f897-n97wk\" (UID: \"6b8214e2-c0ae-4ea5-992d-8a1b54e78196\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-n97wk"
Sep 15 07:51:21.776207 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.776134    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-metrics-certs podName:774b0ac9-0340-4bf4-b619-3d222d5ff31f nodeName:}" failed. No retries permitted until 2026-09-15 07:51:22.27611674 +0000 UTC m=+35.067579456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-metrics-certs") pod "router-default-669c6d8db4-rp2c5" (UID: "774b0ac9-0340-4bf4-b619-3d222d5ff31f") : secret "router-metrics-certs-default" not found
Sep 15 07:51:21.776207 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.776153    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-metrics-tls\") pod \"dns-default-hnrrg\" (UID: \"cab80741-1ae4-4014-b5dc-7d1e4751f3c9\") " pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:51:21.776207 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.776183    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw5mr\" (UniqueName: \"kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-kube-api-access-xw5mr\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.776521 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.776213    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxf5w\" (UniqueName: \"kubernetes.io/projected/d829a2e5-593c-46f1-b4e9-55ac54ff459e-kube-api-access-sxf5w\") pod \"volume-data-source-validator-86695b7cc7-srb27\" (UID: \"d829a2e5-593c-46f1-b4e9-55ac54ff459e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-srb27"
Sep 15 07:51:21.776521 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.776239    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f07222e9-cd97-4468-81e2-b609ade2d29c-tmp\") pod \"insights-operator-5844b856db-fth5n\" (UID: \"f07222e9-cd97-4468-81e2-b609ade2d29c\") " pod="openshift-insights/insights-operator-5844b856db-fth5n"
Sep 15 07:51:21.776521 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.776286    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-tmp-dir\") pod \"dns-default-hnrrg\" (UID: \"cab80741-1ae4-4014-b5dc-7d1e4751f3c9\") " pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:51:21.776521 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.776326    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/793a3fee-4d06-4a69-97a5-b3a27db1d916-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-rrtj4\" (UID: \"793a3fee-4d06-4a69-97a5-b3a27db1d916\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rrtj4"
Sep 15 07:51:21.776521 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.776370    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h87vz\" (UniqueName: \"kubernetes.io/projected/4bd79376-f224-48c6-8c02-89f1be3e0a14-kube-api-access-h87vz\") pod \"cluster-monitoring-operator-6cd954b897-p5672\" (UID: \"4bd79376-f224-48c6-8c02-89f1be3e0a14\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672"
Sep 15 07:51:21.776521 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.776403    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b683e191-3926-4cc6-9326-beefc401a214-ca-trust-extracted\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.776521 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.776435    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b683e191-3926-4cc6-9326-beefc401a214-image-registry-private-configuration\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.776521 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.776461    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b683e191-3926-4cc6-9326-beefc401a214-trusted-ca\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.776521 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.776491    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/793a3fee-4d06-4a69-97a5-b3a27db1d916-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-rrtj4\" (UID: \"793a3fee-4d06-4a69-97a5-b3a27db1d916\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rrtj4"
Sep 15 07:51:21.777041 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.776536    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f07222e9-cd97-4468-81e2-b609ade2d29c-service-ca-bundle\") pod \"insights-operator-5844b856db-fth5n\" (UID: \"f07222e9-cd97-4468-81e2-b609ade2d29c\") " pod="openshift-insights/insights-operator-5844b856db-fth5n"
Sep 15 07:51:21.777041 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.776648    2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 07:51:21.777041 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.776711    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/793a3fee-4d06-4a69-97a5-b3a27db1d916-networking-console-plugin-cert podName:793a3fee-4d06-4a69-97a5-b3a27db1d916 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:22.276693065 +0000 UTC m=+35.068155772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/793a3fee-4d06-4a69-97a5-b3a27db1d916-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-rrtj4" (UID: "793a3fee-4d06-4a69-97a5-b3a27db1d916") : secret "networking-console-plugin-cert" not found
Sep 15 07:51:21.777041 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.776777    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ac26be4-56a7-4bbc-abcb-de5b68959883-config\") pod \"service-ca-operator-cf7c776b7-xr5xn\" (UID: \"2ac26be4-56a7-4bbc-abcb-de5b68959883\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xr5xn"
Sep 15 07:51:21.782607 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.780740    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgwvt\" (UniqueName: \"kubernetes.io/projected/5c3e0fb9-88d9-4643-ac6a-f3ade63ff6f8-kube-api-access-jgwvt\") pod \"ingress-canary-kdpdg\" (UID: \"5c3e0fb9-88d9-4643-ac6a-f3ade63ff6f8\") " pod="openshift-ingress-canary/ingress-canary-kdpdg"
Sep 15 07:51:21.782607 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.780803    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/774b0ac9-0340-4bf4-b619-3d222d5ff31f-service-ca-bundle\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:21.782607 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.780865    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5527013-2ce3-48e3-b472-a593cbfbb55f-config\") pod \"console-operator-696884fb9c-cp9wl\" (UID: \"a5527013-2ce3-48e3-b472-a593cbfbb55f\") " pod="openshift-console-operator/console-operator-696884fb9c-cp9wl"
Sep 15 07:51:21.782607 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.780888    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b683e191-3926-4cc6-9326-beefc401a214-ca-trust-extracted\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.782607 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.780977    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a5527013-2ce3-48e3-b472-a593cbfbb55f-trusted-ca\") pod \"console-operator-696884fb9c-cp9wl\" (UID: \"a5527013-2ce3-48e3-b472-a593cbfbb55f\") " pod="openshift-console-operator/console-operator-696884fb9c-cp9wl"
Sep 15 07:51:21.782607 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.781015    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg4xs\" (UniqueName: \"kubernetes.io/projected/a5527013-2ce3-48e3-b472-a593cbfbb55f-kube-api-access-gg4xs\") pod \"console-operator-696884fb9c-cp9wl\" (UID: \"a5527013-2ce3-48e3-b472-a593cbfbb55f\") " pod="openshift-console-operator/console-operator-696884fb9c-cp9wl"
Sep 15 07:51:21.782607 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.781052    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4s8c\" (UniqueName: \"kubernetes.io/projected/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-kube-api-access-l4s8c\") pod \"cluster-samples-operator-86499c89c4-th7m6\" (UID: \"fb4abd1b-bf9e-4015-99e8-851a2a3e9a83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-th7m6"
Sep 15 07:51:21.782607 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.781074    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/774b0ac9-0340-4bf4-b619-3d222d5ff31f-service-ca-bundle podName:774b0ac9-0340-4bf4-b619-3d222d5ff31f nodeName:}" failed. No retries permitted until 2026-09-15 07:51:22.281047488 +0000 UTC m=+35.072510212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/774b0ac9-0340-4bf4-b619-3d222d5ff31f-service-ca-bundle") pod "router-default-669c6d8db4-rp2c5" (UID: "774b0ac9-0340-4bf4-b619-3d222d5ff31f") : configmap references non-existent config key: service-ca.crt
Sep 15 07:51:21.782607 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.781112    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4bd79376-f224-48c6-8c02-89f1be3e0a14-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-p5672\" (UID: \"4bd79376-f224-48c6-8c02-89f1be3e0a14\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672"
Sep 15 07:51:21.782607 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.781736    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/793a3fee-4d06-4a69-97a5-b3a27db1d916-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-rrtj4\" (UID: \"793a3fee-4d06-4a69-97a5-b3a27db1d916\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rrtj4"
Sep 15 07:51:21.782607 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.776748    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f07222e9-cd97-4468-81e2-b609ade2d29c-tmp\") pod \"insights-operator-5844b856db-fth5n\" (UID: \"f07222e9-cd97-4468-81e2-b609ade2d29c\") " pod="openshift-insights/insights-operator-5844b856db-fth5n"
Sep 15 07:51:21.782607 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.782038    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5527013-2ce3-48e3-b472-a593cbfbb55f-config\") pod \"console-operator-696884fb9c-cp9wl\" (UID: \"a5527013-2ce3-48e3-b472-a593cbfbb55f\") " pod="openshift-console-operator/console-operator-696884fb9c-cp9wl"
Sep 15 07:51:21.783277 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.783035    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b8214e2-c0ae-4ea5-992d-8a1b54e78196-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-n97wk\" (UID: \"6b8214e2-c0ae-4ea5-992d-8a1b54e78196\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-n97wk"
Sep 15 07:51:21.783277 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.783180    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq7w7\" (UniqueName: \"kubernetes.io/projected/774b0ac9-0340-4bf4-b619-3d222d5ff31f-kube-api-access-gq7w7\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:21.783277 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.783223    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c3e0fb9-88d9-4643-ac6a-f3ade63ff6f8-cert\") pod \"ingress-canary-kdpdg\" (UID: \"5c3e0fb9-88d9-4643-ac6a-f3ade63ff6f8\") " pod="openshift-ingress-canary/ingress-canary-kdpdg"
Sep 15 07:51:21.783433 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.783276    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-config-volume\") pod \"dns-default-hnrrg\" (UID: \"cab80741-1ae4-4014-b5dc-7d1e4751f3c9\") " pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:51:21.783433 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.783307    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b683e191-3926-4cc6-9326-beefc401a214-trusted-ca\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.783433 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.783386    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a5527013-2ce3-48e3-b472-a593cbfbb55f-trusted-ca\") pod \"console-operator-696884fb9c-cp9wl\" (UID: \"a5527013-2ce3-48e3-b472-a593cbfbb55f\") " pod="openshift-console-operator/console-operator-696884fb9c-cp9wl"
Sep 15 07:51:21.783433 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.783378    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b683e191-3926-4cc6-9326-beefc401a214-installation-pull-secrets\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.783647 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.783494    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-stats-auth\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:21.783647 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.783521    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b683e191-3926-4cc6-9326-beefc401a214-image-registry-private-configuration\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.783647 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.783530    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-default-certificate\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:21.783647 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.783618    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f07222e9-cd97-4468-81e2-b609ade2d29c-snapshots\") pod \"insights-operator-5844b856db-fth5n\" (UID: \"f07222e9-cd97-4468-81e2-b609ade2d29c\") " pod="openshift-insights/insights-operator-5844b856db-fth5n"
Sep 15 07:51:21.783844 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.783688    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8w2c\" (UniqueName: \"kubernetes.io/projected/f07222e9-cd97-4468-81e2-b609ade2d29c-kube-api-access-p8w2c\") pod \"insights-operator-5844b856db-fth5n\" (UID: \"f07222e9-cd97-4468-81e2-b609ade2d29c\") " pod="openshift-insights/insights-operator-5844b856db-fth5n"
Sep 15 07:51:21.783844 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.783796    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frgx5\" (UniqueName: \"kubernetes.io/projected/f0f5c03f-9cf0-42bf-abae-0ede056b7586-kube-api-access-frgx5\") pod \"network-check-source-6f8b768455-wwv7l\" (UID: \"f0f5c03f-9cf0-42bf-abae-0ede056b7586\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-wwv7l"
Sep 15 07:51:21.783948 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.783908    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bd79376-f224-48c6-8c02-89f1be3e0a14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-p5672\" (UID: \"4bd79376-f224-48c6-8c02-89f1be3e0a14\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672"
Sep 15 07:51:21.784010 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.783964    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-bound-sa-token\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.784094 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.784023    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ac26be4-56a7-4bbc-abcb-de5b68959883-serving-cert\") pod \"service-ca-operator-cf7c776b7-xr5xn\" (UID: \"2ac26be4-56a7-4bbc-abcb-de5b68959883\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xr5xn"
Sep 15 07:51:21.784171 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.784117    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b683e191-3926-4cc6-9326-beefc401a214-registry-certificates\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.784227 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.784147    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ac26be4-56a7-4bbc-abcb-de5b68959883-config\") pod \"service-ca-operator-cf7c776b7-xr5xn\" (UID: \"2ac26be4-56a7-4bbc-abcb-de5b68959883\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xr5xn"
Sep 15 07:51:21.784227 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.784180    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f07222e9-cd97-4468-81e2-b609ade2d29c-trusted-ca-bundle\") pod \"insights-operator-5844b856db-fth5n\" (UID: \"f07222e9-cd97-4468-81e2-b609ade2d29c\") " pod="openshift-insights/insights-operator-5844b856db-fth5n"
Sep 15 07:51:21.784326 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.784235    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-th7m6\" (UID: \"fb4abd1b-bf9e-4015-99e8-851a2a3e9a83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-th7m6"
Sep 15 07:51:21.784326 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.784276    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.784431 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.784329    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b8214e2-c0ae-4ea5-992d-8a1b54e78196-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-n97wk\" (UID: \"6b8214e2-c0ae-4ea5-992d-8a1b54e78196\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-n97wk"
Sep 15 07:51:21.784431 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.784394    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv4rm\" (UniqueName: \"kubernetes.io/projected/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-kube-api-access-pv4rm\") pod \"dns-default-hnrrg\" (UID: \"cab80741-1ae4-4014-b5dc-7d1e4751f3c9\") " pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:51:21.784924 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.784902    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4bd79376-f224-48c6-8c02-89f1be3e0a14-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-p5672\" (UID: \"4bd79376-f224-48c6-8c02-89f1be3e0a14\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672"
Sep 15 07:51:21.785081 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.785062    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f07222e9-cd97-4468-81e2-b609ade2d29c-snapshots\") pod \"insights-operator-5844b856db-fth5n\" (UID: \"f07222e9-cd97-4468-81e2-b609ade2d29c\") " pod="openshift-insights/insights-operator-5844b856db-fth5n"
Sep 15 07:51:21.786626 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.785736    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b683e191-3926-4cc6-9326-beefc401a214-registry-certificates\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.786626 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.786139    2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 07:51:21.786626 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.786298    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd79376-f224-48c6-8c02-89f1be3e0a14-cluster-monitoring-operator-tls podName:4bd79376-f224-48c6-8c02-89f1be3e0a14 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:22.286281925 +0000 UTC m=+35.077744630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4bd79376-f224-48c6-8c02-89f1be3e0a14-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-p5672" (UID: "4bd79376-f224-48c6-8c02-89f1be3e0a14") : secret "cluster-monitoring-operator-tls" not found
Sep 15 07:51:21.786626 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.786512    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f07222e9-cd97-4468-81e2-b609ade2d29c-trusted-ca-bundle\") pod \"insights-operator-5844b856db-fth5n\" (UID: \"f07222e9-cd97-4468-81e2-b609ade2d29c\") " pod="openshift-insights/insights-operator-5844b856db-fth5n"
Sep 15 07:51:21.787488 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.787466    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 07:51:21.787583 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.787533    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-default-certificate\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:21.787708 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.787691    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-samples-operator-tls podName:fb4abd1b-bf9e-4015-99e8-851a2a3e9a83 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:22.287625159 +0000 UTC m=+35.079087868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-th7m6" (UID: "fb4abd1b-bf9e-4015-99e8-851a2a3e9a83") : secret "samples-operator-tls" not found
Sep 15 07:51:21.788589 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.787798    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 07:51:21.788589 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.787814    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86dd9785f-ctwrx: secret "image-registry-tls" not found
Sep 15 07:51:21.788589 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.787876    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls podName:b683e191-3926-4cc6-9326-beefc401a214 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:22.287855894 +0000 UTC m=+35.079318596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls") pod "image-registry-86dd9785f-ctwrx" (UID: "b683e191-3926-4cc6-9326-beefc401a214") : secret "image-registry-tls" not found
Sep 15 07:51:21.788589 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.788072    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b8214e2-c0ae-4ea5-992d-8a1b54e78196-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-n97wk\" (UID: \"6b8214e2-c0ae-4ea5-992d-8a1b54e78196\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-n97wk"
Sep 15 07:51:21.788589 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.788442    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b8214e2-c0ae-4ea5-992d-8a1b54e78196-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-n97wk\" (UID: \"6b8214e2-c0ae-4ea5-992d-8a1b54e78196\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-n97wk"
Sep 15 07:51:21.791456 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.791436    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ac26be4-56a7-4bbc-abcb-de5b68959883-serving-cert\") pod \"service-ca-operator-cf7c776b7-xr5xn\" (UID: \"2ac26be4-56a7-4bbc-abcb-de5b68959883\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xr5xn"
Sep 15 07:51:21.791599 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.791505    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxf5w\" (UniqueName: \"kubernetes.io/projected/d829a2e5-593c-46f1-b4e9-55ac54ff459e-kube-api-access-sxf5w\") pod \"volume-data-source-validator-86695b7cc7-srb27\" (UID: \"d829a2e5-593c-46f1-b4e9-55ac54ff459e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-srb27"
Sep 15 07:51:21.792047 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.792022    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f07222e9-cd97-4468-81e2-b609ade2d29c-serving-cert\") pod \"insights-operator-5844b856db-fth5n\" (UID: \"f07222e9-cd97-4468-81e2-b609ade2d29c\") " pod="openshift-insights/insights-operator-5844b856db-fth5n"
Sep 15 07:51:21.792133 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.792066    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4s8c\" (UniqueName: \"kubernetes.io/projected/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-kube-api-access-l4s8c\") pod \"cluster-samples-operator-86499c89c4-th7m6\" (UID: \"fb4abd1b-bf9e-4015-99e8-851a2a3e9a83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-th7m6"
Sep 15 07:51:21.793355 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.793330    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5527013-2ce3-48e3-b472-a593cbfbb55f-serving-cert\") pod \"console-operator-696884fb9c-cp9wl\" (UID: \"a5527013-2ce3-48e3-b472-a593cbfbb55f\") " pod="openshift-console-operator/console-operator-696884fb9c-cp9wl"
Sep 15 07:51:21.796030 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.794498    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87nwv\" (UniqueName: \"kubernetes.io/projected/2ac26be4-56a7-4bbc-abcb-de5b68959883-kube-api-access-87nwv\") pod \"service-ca-operator-cf7c776b7-xr5xn\" (UID: \"2ac26be4-56a7-4bbc-abcb-de5b68959883\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xr5xn"
Sep 15 07:51:21.796030 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.795202    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw5mr\" (UniqueName: \"kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-kube-api-access-xw5mr\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.796030 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.795376    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b683e191-3926-4cc6-9326-beefc401a214-installation-pull-secrets\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.796030 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.795581    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-stats-auth\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:21.796030 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.795959    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfm5x\" (UniqueName: \"kubernetes.io/projected/6b8214e2-c0ae-4ea5-992d-8a1b54e78196-kube-api-access-dfm5x\") pod \"kube-storage-version-migrator-operator-6c8f84f897-n97wk\" (UID: \"6b8214e2-c0ae-4ea5-992d-8a1b54e78196\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-n97wk"
Sep 15 07:51:21.798272 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.798073    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg4xs\" (UniqueName: \"kubernetes.io/projected/a5527013-2ce3-48e3-b472-a593cbfbb55f-kube-api-access-gg4xs\") pod \"console-operator-696884fb9c-cp9wl\" (UID: \"a5527013-2ce3-48e3-b472-a593cbfbb55f\") " pod="openshift-console-operator/console-operator-696884fb9c-cp9wl"
Sep 15 07:51:21.798272 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.798219    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h87vz\" (UniqueName: \"kubernetes.io/projected/4bd79376-f224-48c6-8c02-89f1be3e0a14-kube-api-access-h87vz\") pod \"cluster-monitoring-operator-6cd954b897-p5672\" (UID: \"4bd79376-f224-48c6-8c02-89f1be3e0a14\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672"
Sep 15 07:51:21.798613 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.798591    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8w2c\" (UniqueName: \"kubernetes.io/projected/f07222e9-cd97-4468-81e2-b609ade2d29c-kube-api-access-p8w2c\") pod \"insights-operator-5844b856db-fth5n\" (UID: \"f07222e9-cd97-4468-81e2-b609ade2d29c\") " pod="openshift-insights/insights-operator-5844b856db-fth5n"
Sep 15 07:51:21.798806 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.798597    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frgx5\" (UniqueName: \"kubernetes.io/projected/f0f5c03f-9cf0-42bf-abae-0ede056b7586-kube-api-access-frgx5\") pod \"network-check-source-6f8b768455-wwv7l\" (UID: \"f0f5c03f-9cf0-42bf-abae-0ede056b7586\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-wwv7l"
Sep 15 07:51:21.798806 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.798700    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-bound-sa-token\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:21.798919 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.798833    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq7w7\" (UniqueName: \"kubernetes.io/projected/774b0ac9-0340-4bf4-b619-3d222d5ff31f-kube-api-access-gq7w7\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:21.829464 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.829427    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:21.885283 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.885259    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c3e0fb9-88d9-4643-ac6a-f3ade63ff6f8-cert\") pod \"ingress-canary-kdpdg\" (UID: \"5c3e0fb9-88d9-4643-ac6a-f3ade63ff6f8\") " pod="openshift-ingress-canary/ingress-canary-kdpdg"
Sep 15 07:51:21.885283 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.885287    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-config-volume\") pod \"dns-default-hnrrg\" (UID: \"cab80741-1ae4-4014-b5dc-7d1e4751f3c9\") " pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:51:21.885488 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.885370    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv4rm\" (UniqueName: \"kubernetes.io/projected/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-kube-api-access-pv4rm\") pod \"dns-default-hnrrg\" (UID: \"cab80741-1ae4-4014-b5dc-7d1e4751f3c9\") " pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:51:21.885488 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.885430    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-metrics-tls\") pod \"dns-default-hnrrg\" (UID: \"cab80741-1ae4-4014-b5dc-7d1e4751f3c9\") " pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:51:21.885488 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.885463    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-tmp-dir\") pod \"dns-default-hnrrg\" (UID: \"cab80741-1ae4-4014-b5dc-7d1e4751f3c9\") " pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:51:21.885627 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.885586    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgwvt\" (UniqueName: \"kubernetes.io/projected/5c3e0fb9-88d9-4643-ac6a-f3ade63ff6f8-kube-api-access-jgwvt\") pod \"ingress-canary-kdpdg\" (UID: \"5c3e0fb9-88d9-4643-ac6a-f3ade63ff6f8\") " pod="openshift-ingress-canary/ingress-canary-kdpdg"
Sep 15 07:51:21.885753 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.885739    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 07:51:21.885829 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:21.885811    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-metrics-tls podName:cab80741-1ae4-4014-b5dc-7d1e4751f3c9 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:22.385793089 +0000 UTC m=+35.177255809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-metrics-tls") pod "dns-default-hnrrg" (UID: "cab80741-1ae4-4014-b5dc-7d1e4751f3c9") : secret "dns-default-metrics-tls" not found
Sep 15 07:51:21.885829 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.885819    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-tmp-dir\") pod \"dns-default-hnrrg\" (UID: \"cab80741-1ae4-4014-b5dc-7d1e4751f3c9\") " pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:51:21.886063 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.886040    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-config-volume\") pod \"dns-default-hnrrg\" (UID: \"cab80741-1ae4-4014-b5dc-7d1e4751f3c9\") " pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:51:21.888370 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.888287    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c3e0fb9-88d9-4643-ac6a-f3ade63ff6f8-cert\") pod \"ingress-canary-kdpdg\" (UID: \"5c3e0fb9-88d9-4643-ac6a-f3ade63ff6f8\") " pod="openshift-ingress-canary/ingress-canary-kdpdg"
Sep 15 07:51:21.888481 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.888467    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-n97wk"
Sep 15 07:51:21.894143 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.894110    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgwvt\" (UniqueName: \"kubernetes.io/projected/5c3e0fb9-88d9-4643-ac6a-f3ade63ff6f8-kube-api-access-jgwvt\") pod \"ingress-canary-kdpdg\" (UID: \"5c3e0fb9-88d9-4643-ac6a-f3ade63ff6f8\") " pod="openshift-ingress-canary/ingress-canary-kdpdg"
Sep 15 07:51:21.895044 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.895023    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv4rm\" (UniqueName: \"kubernetes.io/projected/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-kube-api-access-pv4rm\") pod \"dns-default-hnrrg\" (UID: \"cab80741-1ae4-4014-b5dc-7d1e4751f3c9\") " pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:51:21.920160 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.920129    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xr5xn"
Sep 15 07:51:21.923365 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.923305    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-cp9wl"
Sep 15 07:51:21.932314 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.932261    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-srb27"
Sep 15 07:51:21.953822 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.953738    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-fth5n"
Sep 15 07:51:21.971259 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.970878    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-wwv7l"
Sep 15 07:51:21.975424 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:21.975234    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kdpdg"
Sep 15 07:51:22.190272 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.190140    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-n97wk"]
Sep 15 07:51:22.195963 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:51:22.195752    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b8214e2_c0ae_4ea5_992d_8a1b54e78196.slice/crio-6c759085341f813cc1e3a08a59e97a8632dbfaedef7572541fc9dab42e06352b WatchSource:0}: Error finding container 6c759085341f813cc1e3a08a59e97a8632dbfaedef7572541fc9dab42e06352b: Status 404 returned error can't find the container with id 6c759085341f813cc1e3a08a59e97a8632dbfaedef7572541fc9dab42e06352b
Sep 15 07:51:22.211852 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.211825    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-xr5xn"]
Sep 15 07:51:22.215808 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:51:22.215781    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac26be4_56a7_4bbc_abcb_de5b68959883.slice/crio-3c8fe73aa8e0f5e768b087b053b5873d234b065e88650f8d112539ee66eb54d1 WatchSource:0}: Error finding container 3c8fe73aa8e0f5e768b087b053b5873d234b065e88650f8d112539ee66eb54d1: Status 404 returned error can't find the container with id 3c8fe73aa8e0f5e768b087b053b5873d234b065e88650f8d112539ee66eb54d1
Sep 15 07:51:22.229007 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.228985    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-cp9wl"]
Sep 15 07:51:22.231664 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.231626    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-srb27"]
Sep 15 07:51:22.232787 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:51:22.232759    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5527013_2ce3_48e3_b472_a593cbfbb55f.slice/crio-bc126ba0d4af77330624ef675e252fd863f2a6f219421937d9d154ecc675173d WatchSource:0}: Error finding container bc126ba0d4af77330624ef675e252fd863f2a6f219421937d9d154ecc675173d: Status 404 returned error can't find the container with id bc126ba0d4af77330624ef675e252fd863f2a6f219421937d9d154ecc675173d
Sep 15 07:51:22.234584 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:51:22.234562    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd829a2e5_593c_46f1_b4e9_55ac54ff459e.slice/crio-392188a5d9a61481814d7d0cc7d0b00dca813fbf0700b20deeef9206299182de WatchSource:0}: Error finding container 392188a5d9a61481814d7d0cc7d0b00dca813fbf0700b20deeef9206299182de: Status 404 returned error can't find the container with id 392188a5d9a61481814d7d0cc7d0b00dca813fbf0700b20deeef9206299182de
Sep 15 07:51:22.283478 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.283413    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kdpdg"]
Sep 15 07:51:22.286991 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:51:22.286963    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c3e0fb9_88d9_4643_ac6a_f3ade63ff6f8.slice/crio-4fe75fad7df1ff141871703ced9b161d0c26add148321ec33f3eeb3c4a8d6f96 WatchSource:0}: Error finding container 4fe75fad7df1ff141871703ced9b161d0c26add148321ec33f3eeb3c4a8d6f96: Status 404 returned error can't find the container with id 4fe75fad7df1ff141871703ced9b161d0c26add148321ec33f3eeb3c4a8d6f96
Sep 15 07:51:22.288230 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.288025    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-wwv7l"]
Sep 15 07:51:22.289569 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.288901    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bd79376-f224-48c6-8c02-89f1be3e0a14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-p5672\" (UID: \"4bd79376-f224-48c6-8c02-89f1be3e0a14\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672"
Sep 15 07:51:22.289569 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.288940    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-th7m6\" (UID: \"fb4abd1b-bf9e-4015-99e8-851a2a3e9a83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-th7m6"
Sep 15 07:51:22.289569 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.288966    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:22.289569 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.289012    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-metrics-certs\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:22.289569 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.289061    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/793a3fee-4d06-4a69-97a5-b3a27db1d916-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-rrtj4\" (UID: \"793a3fee-4d06-4a69-97a5-b3a27db1d916\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rrtj4"
Sep 15 07:51:22.289569 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.289102    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/774b0ac9-0340-4bf4-b619-3d222d5ff31f-service-ca-bundle\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:22.289569 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:22.289120    2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 07:51:22.289569 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:22.289186    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd79376-f224-48c6-8c02-89f1be3e0a14-cluster-monitoring-operator-tls podName:4bd79376-f224-48c6-8c02-89f1be3e0a14 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:23.289166339 +0000 UTC m=+36.080629056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4bd79376-f224-48c6-8c02-89f1be3e0a14-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-p5672" (UID: "4bd79376-f224-48c6-8c02-89f1be3e0a14") : secret "cluster-monitoring-operator-tls" not found
Sep 15 07:51:22.289569 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:22.289234    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/774b0ac9-0340-4bf4-b619-3d222d5ff31f-service-ca-bundle podName:774b0ac9-0340-4bf4-b619-3d222d5ff31f nodeName:}" failed. No retries permitted until 2026-09-15 07:51:23.289218961 +0000 UTC m=+36.080681679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/774b0ac9-0340-4bf4-b619-3d222d5ff31f-service-ca-bundle") pod "router-default-669c6d8db4-rp2c5" (UID: "774b0ac9-0340-4bf4-b619-3d222d5ff31f") : configmap references non-existent config key: service-ca.crt
Sep 15 07:51:22.289569 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.289237    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-fth5n"]
Sep 15 07:51:22.289569 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:22.289310    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 07:51:22.289569 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:22.289322    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86dd9785f-ctwrx: secret "image-registry-tls" not found
Sep 15 07:51:22.289569 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:22.289332    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 07:51:22.289569 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:22.289358    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls podName:b683e191-3926-4cc6-9326-beefc401a214 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:23.28934608 +0000 UTC m=+36.080808781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls") pod "image-registry-86dd9785f-ctwrx" (UID: "b683e191-3926-4cc6-9326-beefc401a214") : secret "image-registry-tls" not found
Sep 15 07:51:22.289569 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:22.289374    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-samples-operator-tls podName:fb4abd1b-bf9e-4015-99e8-851a2a3e9a83 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:23.289365364 +0000 UTC m=+36.080828072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-th7m6" (UID: "fb4abd1b-bf9e-4015-99e8-851a2a3e9a83") : secret "samples-operator-tls" not found
Sep 15 07:51:22.289569 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:22.289406    2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 07:51:22.290139 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:22.289436    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-metrics-certs podName:774b0ac9-0340-4bf4-b619-3d222d5ff31f nodeName:}" failed. No retries permitted until 2026-09-15 07:51:23.289425766 +0000 UTC m=+36.080888472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-metrics-certs") pod "router-default-669c6d8db4-rp2c5" (UID: "774b0ac9-0340-4bf4-b619-3d222d5ff31f") : secret "router-metrics-certs-default" not found
Sep 15 07:51:22.290139 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:22.289442    2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 07:51:22.290139 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:22.289473    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/793a3fee-4d06-4a69-97a5-b3a27db1d916-networking-console-plugin-cert podName:793a3fee-4d06-4a69-97a5-b3a27db1d916 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:23.289464807 +0000 UTC m=+36.080927510 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/793a3fee-4d06-4a69-97a5-b3a27db1d916-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-rrtj4" (UID: "793a3fee-4d06-4a69-97a5-b3a27db1d916") : secret "networking-console-plugin-cert" not found
Sep 15 07:51:22.291594 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:51:22.291571    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f5c03f_9cf0_42bf_abae_0ede056b7586.slice/crio-0ffe6747e5b401c197b8004b504d38f5b7da332fa0338e86f5b77d6f12e994e8 WatchSource:0}: Error finding container 0ffe6747e5b401c197b8004b504d38f5b7da332fa0338e86f5b77d6f12e994e8: Status 404 returned error can't find the container with id 0ffe6747e5b401c197b8004b504d38f5b7da332fa0338e86f5b77d6f12e994e8
Sep 15 07:51:22.389529 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.389487    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-metrics-tls\") pod \"dns-default-hnrrg\" (UID: \"cab80741-1ae4-4014-b5dc-7d1e4751f3c9\") " pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:51:22.389712 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:22.389677    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 07:51:22.389770 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:22.389746    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-metrics-tls podName:cab80741-1ae4-4014-b5dc-7d1e4751f3c9 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:23.389725938 +0000 UTC m=+36.181188653 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-metrics-tls") pod "dns-default-hnrrg" (UID: "cab80741-1ae4-4014-b5dc-7d1e4751f3c9") : secret "dns-default-metrics-tls" not found
Sep 15 07:51:22.715104 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.715075    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:51:22.715298 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.715111    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:51:22.717893 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.717870    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xcgfj\""
Sep 15 07:51:22.717893 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.717886    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 07:51:22.718757 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.718736    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wqt7v\""
Sep 15 07:51:22.874382 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.874346    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-fth5n" event={"ID":"f07222e9-cd97-4468-81e2-b609ade2d29c","Type":"ContainerStarted","Data":"31076bed1baecc98fe47a1e346740dd585600abb683a07b4cb9a00c4c4aaf8a7"}
Sep 15 07:51:22.876366 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.876333    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-srb27" event={"ID":"d829a2e5-593c-46f1-b4e9-55ac54ff459e","Type":"ContainerStarted","Data":"392188a5d9a61481814d7d0cc7d0b00dca813fbf0700b20deeef9206299182de"}
Sep 15 07:51:22.877947 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.877897    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-n97wk" event={"ID":"6b8214e2-c0ae-4ea5-992d-8a1b54e78196","Type":"ContainerStarted","Data":"6c759085341f813cc1e3a08a59e97a8632dbfaedef7572541fc9dab42e06352b"}
Sep 15 07:51:22.881185 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.881131    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kdpdg" event={"ID":"5c3e0fb9-88d9-4643-ac6a-f3ade63ff6f8","Type":"ContainerStarted","Data":"4fe75fad7df1ff141871703ced9b161d0c26add148321ec33f3eeb3c4a8d6f96"}
Sep 15 07:51:22.883808 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.883735    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-wwv7l" event={"ID":"f0f5c03f-9cf0-42bf-abae-0ede056b7586","Type":"ContainerStarted","Data":"0ffe6747e5b401c197b8004b504d38f5b7da332fa0338e86f5b77d6f12e994e8"}
Sep 15 07:51:22.888270 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.888208    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-cp9wl" event={"ID":"a5527013-2ce3-48e3-b472-a593cbfbb55f","Type":"ContainerStarted","Data":"bc126ba0d4af77330624ef675e252fd863f2a6f219421937d9d154ecc675173d"}
Sep 15 07:51:22.894150 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:22.894100    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xr5xn" event={"ID":"2ac26be4-56a7-4bbc-abcb-de5b68959883","Type":"ContainerStarted","Data":"3c8fe73aa8e0f5e768b087b053b5873d234b065e88650f8d112539ee66eb54d1"}
Sep 15 07:51:23.300483 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:23.300442    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bd79376-f224-48c6-8c02-89f1be3e0a14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-p5672\" (UID: \"4bd79376-f224-48c6-8c02-89f1be3e0a14\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672"
Sep 15 07:51:23.300687 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:23.300503    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-th7m6\" (UID: \"fb4abd1b-bf9e-4015-99e8-851a2a3e9a83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-th7m6"
Sep 15 07:51:23.300687 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:23.300530    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:23.300687 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:23.300576    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-metrics-certs\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:23.300869 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:23.300765    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 07:51:23.300869 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:23.300843    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-samples-operator-tls podName:fb4abd1b-bf9e-4015-99e8-851a2a3e9a83 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:25.300812292 +0000 UTC m=+38.092275018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-th7m6" (UID: "fb4abd1b-bf9e-4015-99e8-851a2a3e9a83") : secret "samples-operator-tls" not found
Sep 15 07:51:23.301268 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:23.301253    2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 07:51:23.301351 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:23.301306    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd79376-f224-48c6-8c02-89f1be3e0a14-cluster-monitoring-operator-tls podName:4bd79376-f224-48c6-8c02-89f1be3e0a14 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:25.301289959 +0000 UTC m=+38.092752662 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4bd79376-f224-48c6-8c02-89f1be3e0a14-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-p5672" (UID: "4bd79376-f224-48c6-8c02-89f1be3e0a14") : secret "cluster-monitoring-operator-tls" not found
Sep 15 07:51:23.301411 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:23.301383    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 07:51:23.301411 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:23.301396    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86dd9785f-ctwrx: secret "image-registry-tls" not found
Sep 15 07:51:23.301507 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:23.301428    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls podName:b683e191-3926-4cc6-9326-beefc401a214 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:25.301416942 +0000 UTC m=+38.092879647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls") pod "image-registry-86dd9785f-ctwrx" (UID: "b683e191-3926-4cc6-9326-beefc401a214") : secret "image-registry-tls" not found
Sep 15 07:51:23.301507 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:23.301503    2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 07:51:23.301609 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:23.301535    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-metrics-certs podName:774b0ac9-0340-4bf4-b619-3d222d5ff31f nodeName:}" failed. No retries permitted until 2026-09-15 07:51:25.301524562 +0000 UTC m=+38.092987269 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-metrics-certs") pod "router-default-669c6d8db4-rp2c5" (UID: "774b0ac9-0340-4bf4-b619-3d222d5ff31f") : secret "router-metrics-certs-default" not found
Sep 15 07:51:23.301609 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:23.300626    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/793a3fee-4d06-4a69-97a5-b3a27db1d916-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-rrtj4\" (UID: \"793a3fee-4d06-4a69-97a5-b3a27db1d916\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rrtj4"
Sep 15 07:51:23.301731 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:23.301655    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/774b0ac9-0340-4bf4-b619-3d222d5ff31f-service-ca-bundle\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:23.301956 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:23.301817    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/774b0ac9-0340-4bf4-b619-3d222d5ff31f-service-ca-bundle podName:774b0ac9-0340-4bf4-b619-3d222d5ff31f nodeName:}" failed. No retries permitted until 2026-09-15 07:51:25.301799004 +0000 UTC m=+38.093261711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/774b0ac9-0340-4bf4-b619-3d222d5ff31f-service-ca-bundle") pod "router-default-669c6d8db4-rp2c5" (UID: "774b0ac9-0340-4bf4-b619-3d222d5ff31f") : configmap references non-existent config key: service-ca.crt
Sep 15 07:51:23.301956 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:23.301888    2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 07:51:23.301956 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:23.301920    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/793a3fee-4d06-4a69-97a5-b3a27db1d916-networking-console-plugin-cert podName:793a3fee-4d06-4a69-97a5-b3a27db1d916 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:25.301909371 +0000 UTC m=+38.093372074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/793a3fee-4d06-4a69-97a5-b3a27db1d916-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-rrtj4" (UID: "793a3fee-4d06-4a69-97a5-b3a27db1d916") : secret "networking-console-plugin-cert" not found
Sep 15 07:51:23.403666 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:23.403102    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-metrics-tls\") pod \"dns-default-hnrrg\" (UID: \"cab80741-1ae4-4014-b5dc-7d1e4751f3c9\") " pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:51:23.403666 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:23.403261    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 07:51:23.403666 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:23.403321    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-metrics-tls podName:cab80741-1ae4-4014-b5dc-7d1e4751f3c9 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:25.403303742 +0000 UTC m=+38.194766445 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-metrics-tls") pod "dns-default-hnrrg" (UID: "cab80741-1ae4-4014-b5dc-7d1e4751f3c9") : secret "dns-default-metrics-tls" not found
Sep 15 07:51:24.754357 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:24.754214    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:24.830537 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:24.830503    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:25.324314 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:25.324274    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bd79376-f224-48c6-8c02-89f1be3e0a14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-p5672\" (UID: \"4bd79376-f224-48c6-8c02-89f1be3e0a14\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672"
Sep 15 07:51:25.324497 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:25.324327    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-th7m6\" (UID: \"fb4abd1b-bf9e-4015-99e8-851a2a3e9a83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-th7m6"
Sep 15 07:51:25.324497 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:25.324356    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:25.324497 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:25.324397    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-metrics-certs\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:25.324497 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:25.324437    2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 07:51:25.324736 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:25.324500    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 07:51:25.324736 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:25.324517    2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 07:51:25.324736 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:25.324446    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/793a3fee-4d06-4a69-97a5-b3a27db1d916-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-rrtj4\" (UID: \"793a3fee-4d06-4a69-97a5-b3a27db1d916\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rrtj4"
Sep 15 07:51:25.324736 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:25.324538    2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 07:51:25.324736 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:25.324520    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd79376-f224-48c6-8c02-89f1be3e0a14-cluster-monitoring-operator-tls podName:4bd79376-f224-48c6-8c02-89f1be3e0a14 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:29.324499765 +0000 UTC m=+42.115962479 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4bd79376-f224-48c6-8c02-89f1be3e0a14-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-p5672" (UID: "4bd79376-f224-48c6-8c02-89f1be3e0a14") : secret "cluster-monitoring-operator-tls" not found
Sep 15 07:51:25.324736 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:25.324517    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 07:51:25.324736 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:25.324571    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86dd9785f-ctwrx: secret "image-registry-tls" not found
Sep 15 07:51:25.324736 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:25.324612    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-samples-operator-tls podName:fb4abd1b-bf9e-4015-99e8-851a2a3e9a83 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:29.324595197 +0000 UTC m=+42.116057912 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-th7m6" (UID: "fb4abd1b-bf9e-4015-99e8-851a2a3e9a83") : secret "samples-operator-tls" not found
Sep 15 07:51:25.324736 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:25.324652    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/793a3fee-4d06-4a69-97a5-b3a27db1d916-networking-console-plugin-cert podName:793a3fee-4d06-4a69-97a5-b3a27db1d916 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:29.324625484 +0000 UTC m=+42.116088192 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/793a3fee-4d06-4a69-97a5-b3a27db1d916-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-rrtj4" (UID: "793a3fee-4d06-4a69-97a5-b3a27db1d916") : secret "networking-console-plugin-cert" not found
Sep 15 07:51:25.324736 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:25.324680    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-metrics-certs podName:774b0ac9-0340-4bf4-b619-3d222d5ff31f nodeName:}" failed. No retries permitted until 2026-09-15 07:51:29.324670006 +0000 UTC m=+42.116132714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-metrics-certs") pod "router-default-669c6d8db4-rp2c5" (UID: "774b0ac9-0340-4bf4-b619-3d222d5ff31f") : secret "router-metrics-certs-default" not found
Sep 15 07:51:25.324736 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:25.324702    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls podName:b683e191-3926-4cc6-9326-beefc401a214 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:29.324694253 +0000 UTC m=+42.116156962 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls") pod "image-registry-86dd9785f-ctwrx" (UID: "b683e191-3926-4cc6-9326-beefc401a214") : secret "image-registry-tls" not found
Sep 15 07:51:25.325269 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:25.324764    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/774b0ac9-0340-4bf4-b619-3d222d5ff31f-service-ca-bundle\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:25.325269 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:25.324906    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/774b0ac9-0340-4bf4-b619-3d222d5ff31f-service-ca-bundle podName:774b0ac9-0340-4bf4-b619-3d222d5ff31f nodeName:}" failed. No retries permitted until 2026-09-15 07:51:29.324891725 +0000 UTC m=+42.116354438 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/774b0ac9-0340-4bf4-b619-3d222d5ff31f-service-ca-bundle") pod "router-default-669c6d8db4-rp2c5" (UID: "774b0ac9-0340-4bf4-b619-3d222d5ff31f") : configmap references non-existent config key: service-ca.crt
Sep 15 07:51:25.425755 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:25.425725    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-metrics-tls\") pod \"dns-default-hnrrg\" (UID: \"cab80741-1ae4-4014-b5dc-7d1e4751f3c9\") " pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:51:25.425921 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:25.425876    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 07:51:25.425983 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:25.425947    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-metrics-tls podName:cab80741-1ae4-4014-b5dc-7d1e4751f3c9 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:29.425927112 +0000 UTC m=+42.217389817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-metrics-tls") pod "dns-default-hnrrg" (UID: "cab80741-1ae4-4014-b5dc-7d1e4751f3c9") : secret "dns-default-metrics-tls" not found
Sep 15 07:51:25.976899 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:25.976817    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:26.044838 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:26.044802    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:26.150656 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:26.150526    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:26.247956 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:26.247846    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:26.304596 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:26.304559    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:27.158271 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:27.158224    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:27.212546 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:27.212514    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:28.101263 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:28.101229    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:28.197176 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:28.197137    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:28.258300 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:28.258265    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:29.362006 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:29.361963    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bd79376-f224-48c6-8c02-89f1be3e0a14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-p5672\" (UID: \"4bd79376-f224-48c6-8c02-89f1be3e0a14\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672"
Sep 15 07:51:29.362450 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:29.362011    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-th7m6\" (UID: \"fb4abd1b-bf9e-4015-99e8-851a2a3e9a83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-th7m6"
Sep 15 07:51:29.362450 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:29.362119    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:29.362450 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:29.362140    2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 07:51:29.362450 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:29.362171    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-metrics-certs\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:29.362450 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:29.362215    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd79376-f224-48c6-8c02-89f1be3e0a14-cluster-monitoring-operator-tls podName:4bd79376-f224-48c6-8c02-89f1be3e0a14 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:37.362194751 +0000 UTC m=+50.153657464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4bd79376-f224-48c6-8c02-89f1be3e0a14-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-p5672" (UID: "4bd79376-f224-48c6-8c02-89f1be3e0a14") : secret "cluster-monitoring-operator-tls" not found
Sep 15 07:51:29.362450 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:29.362245    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 07:51:29.362450 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:29.362262    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/793a3fee-4d06-4a69-97a5-b3a27db1d916-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-rrtj4\" (UID: \"793a3fee-4d06-4a69-97a5-b3a27db1d916\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rrtj4"
Sep 15 07:51:29.362450 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:29.362269    2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 07:51:29.362450 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:29.362295    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-samples-operator-tls podName:fb4abd1b-bf9e-4015-99e8-851a2a3e9a83 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:37.362281637 +0000 UTC m=+50.153744354 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-th7m6" (UID: "fb4abd1b-bf9e-4015-99e8-851a2a3e9a83") : secret "samples-operator-tls" not found
Sep 15 07:51:29.362450 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:29.362298    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 07:51:29.362450 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:29.362313    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-metrics-certs podName:774b0ac9-0340-4bf4-b619-3d222d5ff31f nodeName:}" failed. No retries permitted until 2026-09-15 07:51:37.36230659 +0000 UTC m=+50.153769291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-metrics-certs") pod "router-default-669c6d8db4-rp2c5" (UID: "774b0ac9-0340-4bf4-b619-3d222d5ff31f") : secret "router-metrics-certs-default" not found
Sep 15 07:51:29.362450 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:29.362318    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86dd9785f-ctwrx: secret "image-registry-tls" not found
Sep 15 07:51:29.362450 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:29.362332    2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 07:51:29.362450 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:29.362344    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/774b0ac9-0340-4bf4-b619-3d222d5ff31f-service-ca-bundle\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:29.362450 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:29.362363    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls podName:b683e191-3926-4cc6-9326-beefc401a214 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:37.362349741 +0000 UTC m=+50.153812443 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls") pod "image-registry-86dd9785f-ctwrx" (UID: "b683e191-3926-4cc6-9326-beefc401a214") : secret "image-registry-tls" not found
Sep 15 07:51:29.363017 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:29.362385    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/793a3fee-4d06-4a69-97a5-b3a27db1d916-networking-console-plugin-cert podName:793a3fee-4d06-4a69-97a5-b3a27db1d916 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:37.362376321 +0000 UTC m=+50.153839021 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/793a3fee-4d06-4a69-97a5-b3a27db1d916-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-rrtj4" (UID: "793a3fee-4d06-4a69-97a5-b3a27db1d916") : secret "networking-console-plugin-cert" not found
Sep 15 07:51:29.363017 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:29.362402    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/774b0ac9-0340-4bf4-b619-3d222d5ff31f-service-ca-bundle podName:774b0ac9-0340-4bf4-b619-3d222d5ff31f nodeName:}" failed. No retries permitted until 2026-09-15 07:51:37.362394636 +0000 UTC m=+50.153857338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/774b0ac9-0340-4bf4-b619-3d222d5ff31f-service-ca-bundle") pod "router-default-669c6d8db4-rp2c5" (UID: "774b0ac9-0340-4bf4-b619-3d222d5ff31f") : configmap references non-existent config key: service-ca.crt
Sep 15 07:51:29.462937 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:29.462905    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-metrics-tls\") pod \"dns-default-hnrrg\" (UID: \"cab80741-1ae4-4014-b5dc-7d1e4751f3c9\") " pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:51:29.463106 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:29.463066    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 07:51:29.463155 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:29.463141    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-metrics-tls podName:cab80741-1ae4-4014-b5dc-7d1e4751f3c9 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:37.46312123 +0000 UTC m=+50.254583951 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-metrics-tls") pod "dns-default-hnrrg" (UID: "cab80741-1ae4-4014-b5dc-7d1e4751f3c9") : secret "dns-default-metrics-tls" not found
Sep 15 07:51:30.104126 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:30.104080    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:30.426887 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:30.426799    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:30.527663 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:30.527618    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:30.581846 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:30.581793    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:31.924045 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:31.923900    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-n97wk" event={"ID":"6b8214e2-c0ae-4ea5-992d-8a1b54e78196","Type":"ContainerStarted","Data":"576c5ca4b7223a47ab0fb97e9c1293c26d0f93c30620e365ac9146c566929bef"}
Sep 15 07:51:31.927101 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:31.927047    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kdpdg" event={"ID":"5c3e0fb9-88d9-4643-ac6a-f3ade63ff6f8","Type":"ContainerStarted","Data":"3271f5581607d435ff553275fa6490f7f587828b4233b8130f74bcc39f84e60a"}
Sep 15 07:51:31.931173 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:31.930338    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-wwv7l" event={"ID":"f0f5c03f-9cf0-42bf-abae-0ede056b7586","Type":"ContainerStarted","Data":"7a8b34c88c2987e5c901f5e6f805801375bf29632425f08d0d49acacb7de52d9"}
Sep 15 07:51:31.933692 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:31.933667    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cp9wl_a5527013-2ce3-48e3-b472-a593cbfbb55f/console-operator/0.log"
Sep 15 07:51:31.934573 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:31.934265    2586 scope.go:117] "RemoveContainer" containerID="7fbc760a3c6e418669cecf0dabaf954226870233ccd18f1e0c5de11dd8ace79e"
Sep 15 07:51:31.935564 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:31.934712    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-cp9wl" event={"ID":"a5527013-2ce3-48e3-b472-a593cbfbb55f","Type":"ContainerDied","Data":"7fbc760a3c6e418669cecf0dabaf954226870233ccd18f1e0c5de11dd8ace79e"}
Sep 15 07:51:31.935564 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:31.934783    2586 generic.go:356] "Generic (PLEG): container finished" podID="a5527013-2ce3-48e3-b472-a593cbfbb55f" containerID="7fbc760a3c6e418669cecf0dabaf954226870233ccd18f1e0c5de11dd8ace79e" exitCode=255
Sep 15 07:51:31.937863 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:31.937163    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xr5xn" event={"ID":"2ac26be4-56a7-4bbc-abcb-de5b68959883","Type":"ContainerStarted","Data":"2ee922e3f186800d6b331c38fa5eca4f9f80a2277a835246efc4c8504a795dd2"}
Sep 15 07:51:31.947652 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:31.944706    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg6gg" event={"ID":"6c580ab2-446f-44b2-931e-444d49271760","Type":"ContainerStarted","Data":"be268ace9c2d808accf1081a9fd4ffe853081c1622abe2968f73b9f64411effa"}
Sep 15 07:51:31.947652 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:31.947003    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-fth5n" event={"ID":"f07222e9-cd97-4468-81e2-b609ade2d29c","Type":"ContainerStarted","Data":"1249f7928a71657f4c4ee3a6fa639008d599ba19158cf0bbf9c6e48278dda2e5"}
Sep 15 07:51:31.951651 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:31.949665    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-srb27" event={"ID":"d829a2e5-593c-46f1-b4e9-55ac54ff459e","Type":"ContainerStarted","Data":"b7773ab212d5628e8732271c0c55cdd92f9d16058ca233f57cb41b28df10d50e"}
Sep 15 07:51:31.964022 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:31.962939    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-n97wk" podStartSLOduration=14.556582058 podStartE2EDuration="23.962921443s" totalImagesPullingTime="9.406339385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:31.94245677 +0000 UTC m=+44.733919488" watchObservedRunningTime="2026-09-15 07:51:31.962921443 +0000 UTC m=+44.754384170"
Sep 15 07:51:31.964022 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:31.963601    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xr5xn" podStartSLOduration=14.577872816 podStartE2EDuration="23.963591386s" totalImagesPullingTime="9.38571857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:31.962226521 +0000 UTC m=+44.753689246" watchObservedRunningTime="2026-09-15 07:51:31.963591386 +0000 UTC m=+44.755054111"
Sep 15 07:51:32.041069 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:32.040226    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-wwv7l" podStartSLOduration=14.726261264 podStartE2EDuration="24.040202396s" totalImagesPullingTime="9.313941132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:32.015259782 +0000 UTC m=+44.806722502" watchObservedRunningTime="2026-09-15 07:51:32.040202396 +0000 UTC m=+44.831665120"
Sep 15 07:51:32.063984 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:32.062281    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-srb27" podStartSLOduration=21.81748935 podStartE2EDuration="24.062261868s" totalImagesPullingTime="2.244772518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:32.061968733 +0000 UTC m=+44.853431457" watchObservedRunningTime="2026-09-15 07:51:32.062261868 +0000 UTC m=+44.853724592"
Sep 15 07:51:32.084682 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:32.081920    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-fth5n" podStartSLOduration=14.769913967 podStartE2EDuration="24.081900326s" totalImagesPullingTime="9.311986359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:32.080806478 +0000 UTC m=+44.872269204" watchObservedRunningTime="2026-09-15 07:51:32.081900326 +0000 UTC m=+44.873363050"
Sep 15 07:51:32.139535 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:32.139504    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:32.194370 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:32.194334    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:32.758574 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:32.758538    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:32.814849 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:32.814811    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:32.960279 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:32.960199    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cp9wl_a5527013-2ce3-48e3-b472-a593cbfbb55f/console-operator/1.log"
Sep 15 07:51:32.960727 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:32.960648    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cp9wl_a5527013-2ce3-48e3-b472-a593cbfbb55f/console-operator/0.log"
Sep 15 07:51:32.960727 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:32.960678    2586 generic.go:356] "Generic (PLEG): container finished" podID="a5527013-2ce3-48e3-b472-a593cbfbb55f" containerID="94acca1d8cf10f1ea5750c5dc0aec446a04a2511ac049303fc37db28e0e8fb8b" exitCode=255
Sep 15 07:51:32.960832 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:32.960757    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-cp9wl" event={"ID":"a5527013-2ce3-48e3-b472-a593cbfbb55f","Type":"ContainerDied","Data":"94acca1d8cf10f1ea5750c5dc0aec446a04a2511ac049303fc37db28e0e8fb8b"}
Sep 15 07:51:32.960890 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:32.960838    2586 scope.go:117] "RemoveContainer" containerID="7fbc760a3c6e418669cecf0dabaf954226870233ccd18f1e0c5de11dd8ace79e"
Sep 15 07:51:32.961196 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:32.961147    2586 scope.go:117] "RemoveContainer" containerID="94acca1d8cf10f1ea5750c5dc0aec446a04a2511ac049303fc37db28e0e8fb8b"
Sep 15 07:51:32.961383 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:32.961353    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-cp9wl_openshift-console-operator(a5527013-2ce3-48e3-b472-a593cbfbb55f)\"" pod="openshift-console-operator/console-operator-696884fb9c-cp9wl" podUID="a5527013-2ce3-48e3-b472-a593cbfbb55f"
Sep 15 07:51:32.964225 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:32.964201    2586 generic.go:356] "Generic (PLEG): container finished" podID="6c580ab2-446f-44b2-931e-444d49271760" containerID="be268ace9c2d808accf1081a9fd4ffe853081c1622abe2968f73b9f64411effa" exitCode=0
Sep 15 07:51:32.964344 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:32.964270    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg6gg" event={"ID":"6c580ab2-446f-44b2-931e-444d49271760","Type":"ContainerDied","Data":"be268ace9c2d808accf1081a9fd4ffe853081c1622abe2968f73b9f64411effa"}
Sep 15 07:51:32.989787 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:32.989744    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kdpdg" podStartSLOduration=2.6696508740000002 podStartE2EDuration="11.989729859s" totalImagesPullingTime="9.320078985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:51:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:32.989108936 +0000 UTC m=+45.780571660" watchObservedRunningTime="2026-09-15 07:51:32.989729859 +0000 UTC m=+45.781192636"
Sep 15 07:51:33.212573 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:33.212514    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:33.313687 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:33.313628    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:33.460141 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:33.460099    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:33.562958 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:33.562870    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:33.795577 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:33.795538    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:33.880217 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:33.880179    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:33.937486 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:33.937453    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jdrkz"]
Sep 15 07:51:33.954589 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:33.954565    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jdrkz"]
Sep 15 07:51:33.954742 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:33.954694    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:33.956909 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:33.956889    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 07:51:33.957035 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:33.956892    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 07:51:33.957267 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:33.957253    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zmjnb\""
Sep 15 07:51:33.966929 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:33.966904    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:33.971300 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:33.971279    2586 generic.go:356] "Generic (PLEG): container finished" podID="6c580ab2-446f-44b2-931e-444d49271760" containerID="5b8036a05c6bbeb47a04b12ab5f471c10d527c7a78844f14634d59ddafea7a07" exitCode=0
Sep 15 07:51:33.971400 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:33.971363    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg6gg" event={"ID":"6c580ab2-446f-44b2-931e-444d49271760","Type":"ContainerDied","Data":"5b8036a05c6bbeb47a04b12ab5f471c10d527c7a78844f14634d59ddafea7a07"}
Sep 15 07:51:33.972919 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:33.972905    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cp9wl_a5527013-2ce3-48e3-b472-a593cbfbb55f/console-operator/1.log"
Sep 15 07:51:33.973186 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:33.973171    2586 scope.go:117] "RemoveContainer" containerID="94acca1d8cf10f1ea5750c5dc0aec446a04a2511ac049303fc37db28e0e8fb8b"
Sep 15 07:51:33.973313 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:33.973298    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-cp9wl_openshift-console-operator(a5527013-2ce3-48e3-b472-a593cbfbb55f)\"" pod="openshift-console-operator/console-operator-696884fb9c-cp9wl" podUID="a5527013-2ce3-48e3-b472-a593cbfbb55f"
Sep 15 07:51:34.102924 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:34.102591    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:34.102924 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:34.102702    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-data-volume\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:34.103832 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:34.103784    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvx74\" (UniqueName: \"kubernetes.io/projected/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-kube-api-access-vvx74\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:34.103937 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:34.103845    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-crio-socket\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:34.104040 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:34.104015    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:34.205050 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:34.204957    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-data-volume\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:34.205198 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:34.205117    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvx74\" (UniqueName: \"kubernetes.io/projected/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-kube-api-access-vvx74\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:34.205198 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:34.205148    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-crio-socket\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:34.205198 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:34.205192    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:34.205331 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:34.205256    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:34.205331 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:34.205303    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-data-volume\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:34.205429 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:34.205348    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 07:51:34.205429 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:34.205382    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 07:51:34.205429 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:34.205390    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-crio-socket\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:34.205538 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:34.205434    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-kube-rbac-proxy-cm podName:0e07b1b3-32ed-442d-854f-9f9cd71e81e5 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:34.705414448 +0000 UTC m=+47.496877170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jdrkz" (UID: "0e07b1b3-32ed-442d-854f-9f9cd71e81e5") : configmap "kube-rbac-proxy" not found
Sep 15 07:51:34.205538 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:34.205453    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-insights-runtime-extractor-tls podName:0e07b1b3-32ed-442d-854f-9f9cd71e81e5 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:34.705444534 +0000 UTC m=+47.496907247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jdrkz" (UID: "0e07b1b3-32ed-442d-854f-9f9cd71e81e5") : secret "insights-runtime-extractor-tls" not found
Sep 15 07:51:34.213969 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:34.213944    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvx74\" (UniqueName: \"kubernetes.io/projected/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-kube-api-access-vvx74\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:34.708688 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:34.708623    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:34.708874 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:34.708728    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:34.708874 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:34.708756    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 07:51:34.708874 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:34.708832    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-kube-rbac-proxy-cm podName:0e07b1b3-32ed-442d-854f-9f9cd71e81e5 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:35.708816557 +0000 UTC m=+48.500279263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jdrkz" (UID: "0e07b1b3-32ed-442d-854f-9f9cd71e81e5") : configmap "kube-rbac-proxy" not found
Sep 15 07:51:34.708998 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:34.708875    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 07:51:34.708998 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:34.708924    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-insights-runtime-extractor-tls podName:0e07b1b3-32ed-442d-854f-9f9cd71e81e5 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:35.708911434 +0000 UTC m=+48.500374139 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jdrkz" (UID: "0e07b1b3-32ed-442d-854f-9f9cd71e81e5") : secret "insights-runtime-extractor-tls" not found
Sep 15 07:51:34.979120 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:34.979043    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg6gg" event={"ID":"6c580ab2-446f-44b2-931e-444d49271760","Type":"ContainerStarted","Data":"5f797a162b69b928f9f852081dfadafcf9aecd1739375efdd3bc02545f672c45"}
Sep 15 07:51:35.003275 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:35.003231    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kg6gg" podStartSLOduration=10.348342629 podStartE2EDuration="47.00321587s" totalImagesPullingTime="36.654873241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:50:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:35.001421467 +0000 UTC m=+47.792884189" watchObservedRunningTime="2026-09-15 07:51:35.00321587 +0000 UTC m=+47.794678592"
Sep 15 07:51:35.129114 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:35.129085    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:35.194347 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:35.194309    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:35.716471 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:35.716438    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:35.716628 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:35.716586    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 07:51:35.716688 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:35.716624    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:35.716688 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:35.716676    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-insights-runtime-extractor-tls podName:0e07b1b3-32ed-442d-854f-9f9cd71e81e5 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:37.716656554 +0000 UTC m=+50.508119309 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jdrkz" (UID: "0e07b1b3-32ed-442d-854f-9f9cd71e81e5") : secret "insights-runtime-extractor-tls" not found
Sep 15 07:51:35.716764 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:35.716703    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 07:51:35.716764 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:35.716757    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-kube-rbac-proxy-cm podName:0e07b1b3-32ed-442d-854f-9f9cd71e81e5 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:37.71674462 +0000 UTC m=+50.508207321 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jdrkz" (UID: "0e07b1b3-32ed-442d-854f-9f9cd71e81e5") : configmap "kube-rbac-proxy" not found
Sep 15 07:51:35.898256 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:35.898220    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:36.294252 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:36.294224    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sxwp6_270820a5-0bb6-46db-affd-a9ec2c639a9c/dns-node-resolver/0.log"
Sep 15 07:51:37.431979 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:37.431941    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bd79376-f224-48c6-8c02-89f1be3e0a14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-p5672\" (UID: \"4bd79376-f224-48c6-8c02-89f1be3e0a14\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672"
Sep 15 07:51:37.431979 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:37.431985    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-th7m6\" (UID: \"fb4abd1b-bf9e-4015-99e8-851a2a3e9a83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-th7m6"
Sep 15 07:51:37.432521 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:37.432015    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:37.432521 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:37.432107    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 07:51:37.432521 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:37.432122    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86dd9785f-ctwrx: secret "image-registry-tls" not found
Sep 15 07:51:37.432521 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:37.432129    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 15 07:51:37.432521 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:37.432147    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-metrics-certs\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:37.432521 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:37.432170    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls podName:b683e191-3926-4cc6-9326-beefc401a214 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:53.432157208 +0000 UTC m=+66.223619909 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls") pod "image-registry-86dd9785f-ctwrx" (UID: "b683e191-3926-4cc6-9326-beefc401a214") : secret "image-registry-tls" not found
Sep 15 07:51:37.432521 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:37.432191    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-samples-operator-tls podName:fb4abd1b-bf9e-4015-99e8-851a2a3e9a83 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:53.432181831 +0000 UTC m=+66.223644536 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-th7m6" (UID: "fb4abd1b-bf9e-4015-99e8-851a2a3e9a83") : secret "samples-operator-tls" not found
Sep 15 07:51:37.432521 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:37.432216    2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 15 07:51:37.432521 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:37.432242    2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 15 07:51:37.432521 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:37.432259    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-metrics-certs podName:774b0ac9-0340-4bf4-b619-3d222d5ff31f nodeName:}" failed. No retries permitted until 2026-09-15 07:51:53.432248425 +0000 UTC m=+66.223711142 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-metrics-certs") pod "router-default-669c6d8db4-rp2c5" (UID: "774b0ac9-0340-4bf4-b619-3d222d5ff31f") : secret "router-metrics-certs-default" not found
Sep 15 07:51:37.432521 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:37.432254    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/793a3fee-4d06-4a69-97a5-b3a27db1d916-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-rrtj4\" (UID: \"793a3fee-4d06-4a69-97a5-b3a27db1d916\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rrtj4"
Sep 15 07:51:37.432521 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:37.432293    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd79376-f224-48c6-8c02-89f1be3e0a14-cluster-monitoring-operator-tls podName:4bd79376-f224-48c6-8c02-89f1be3e0a14 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:53.432281412 +0000 UTC m=+66.223744127 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4bd79376-f224-48c6-8c02-89f1be3e0a14-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-p5672" (UID: "4bd79376-f224-48c6-8c02-89f1be3e0a14") : secret "cluster-monitoring-operator-tls" not found
Sep 15 07:51:37.432521 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:37.432305    2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 15 07:51:37.432521 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:37.432343    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/793a3fee-4d06-4a69-97a5-b3a27db1d916-networking-console-plugin-cert podName:793a3fee-4d06-4a69-97a5-b3a27db1d916 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:53.432333918 +0000 UTC m=+66.223796624 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/793a3fee-4d06-4a69-97a5-b3a27db1d916-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-rrtj4" (UID: "793a3fee-4d06-4a69-97a5-b3a27db1d916") : secret "networking-console-plugin-cert" not found
Sep 15 07:51:37.432521 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:37.432340    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/774b0ac9-0340-4bf4-b619-3d222d5ff31f-service-ca-bundle\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:37.433019 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:37.432400    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/774b0ac9-0340-4bf4-b619-3d222d5ff31f-service-ca-bundle podName:774b0ac9-0340-4bf4-b619-3d222d5ff31f nodeName:}" failed. No retries permitted until 2026-09-15 07:51:53.432390592 +0000 UTC m=+66.223853308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/774b0ac9-0340-4bf4-b619-3d222d5ff31f-service-ca-bundle") pod "router-default-669c6d8db4-rp2c5" (UID: "774b0ac9-0340-4bf4-b619-3d222d5ff31f") : configmap references non-existent config key: service-ca.crt
Sep 15 07:51:37.494325 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:37.494304    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tm9mm_fd0cf790-5285-4db4-a40a-d40575ca5514/node-ca/0.log"
Sep 15 07:51:37.533030 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:37.532995    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-metrics-tls\") pod \"dns-default-hnrrg\" (UID: \"cab80741-1ae4-4014-b5dc-7d1e4751f3c9\") " pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:51:37.533186 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:37.533113    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 07:51:37.533186 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:37.533162    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-metrics-tls podName:cab80741-1ae4-4014-b5dc-7d1e4751f3c9 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:53.533148609 +0000 UTC m=+66.324611314 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-metrics-tls") pod "dns-default-hnrrg" (UID: "cab80741-1ae4-4014-b5dc-7d1e4751f3c9") : secret "dns-default-metrics-tls" not found
Sep 15 07:51:37.734393 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:37.734328    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:37.734393 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:37.734378    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:37.734555 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:37.734446    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 07:51:37.734555 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:37.734466    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 07:51:37.734555 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:37.734508    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-insights-runtime-extractor-tls podName:0e07b1b3-32ed-442d-854f-9f9cd71e81e5 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:41.73449531 +0000 UTC m=+54.525958016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jdrkz" (UID: "0e07b1b3-32ed-442d-854f-9f9cd71e81e5") : secret "insights-runtime-extractor-tls" not found
Sep 15 07:51:37.734555 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:37.734521    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-kube-rbac-proxy-cm podName:0e07b1b3-32ed-442d-854f-9f9cd71e81e5 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:41.734514985 +0000 UTC m=+54.525977686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jdrkz" (UID: "0e07b1b3-32ed-442d-854f-9f9cd71e81e5") : configmap "kube-rbac-proxy" not found
Sep 15 07:51:37.895001 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:37.894970    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kdpdg_5c3e0fb9-88d9-4643-ac6a-f3ade63ff6f8/serve-healthcheck-canary/0.log"
Sep 15 07:51:38.314239 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:38.314185    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:38.542535 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:38.542502    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:38.696505 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:38.696463    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-n97wk_6b8214e2-c0ae-4ea5-992d-8a1b54e78196/kube-storage-version-migrator-operator/0.log"
Sep 15 07:51:39.480372 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:39.480336    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:39.650199 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:39.650135    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:39.749303 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:39.749219    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:39.808279 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:39.808250    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:39.961461 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:39.961428    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:40.061557 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:40.061463    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:41.769862 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:41.769828    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:41.770273 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:41.769985    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 07:51:41.770273 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:41.770022    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:41.770273 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:41.770052    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-insights-runtime-extractor-tls podName:0e07b1b3-32ed-442d-854f-9f9cd71e81e5 nodeName:}" failed. No retries permitted until 2026-09-15 07:51:49.770037519 +0000 UTC m=+62.561500225 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jdrkz" (UID: "0e07b1b3-32ed-442d-854f-9f9cd71e81e5") : secret "insights-runtime-extractor-tls" not found
Sep 15 07:51:41.770482 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:41.770465    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:41.923542 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:41.923509    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-cp9wl"
Sep 15 07:51:41.923692 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:41.923591    2586 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-cp9wl"
Sep 15 07:51:41.923951 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:41.923938    2586 scope.go:117] "RemoveContainer" containerID="94acca1d8cf10f1ea5750c5dc0aec446a04a2511ac049303fc37db28e0e8fb8b"
Sep 15 07:51:41.924098 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:51:41.924082    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-cp9wl_openshift-console-operator(a5527013-2ce3-48e3-b472-a593cbfbb55f)\"" pod="openshift-console-operator/console-operator-696884fb9c-cp9wl" podUID="a5527013-2ce3-48e3-b472-a593cbfbb55f"
Sep 15 07:51:43.390734 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:43.390696    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:43.442207 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:43.442172    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:43.671036 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:43.670943    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:43.781839 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:43.781806    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:43.838813 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:43.838764    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:44.192691 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:44.192647    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:44.578752 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:44.578653    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:44.782168 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:44.782133    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:44.882603 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:44.882572    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:44.983489 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:44.983457    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:45.181290 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:45.181184    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:45.475168 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:45.475073    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:45.576229 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:45.576199    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:45.762414 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:45.762330    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:45.986504 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:45.986466    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:46.187070 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:46.187032    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:46.588039 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:46.588004    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:46.774570 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:46.774543    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:47.372552 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:47.372522    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:47.776604 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:47.776526    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:47.866714 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:47.866683    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zlqdd"
Sep 15 07:51:47.977417 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:47.977367    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:48.181304 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:48.181269    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:48.376645 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:48.376540    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:48.796745 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:48.796659    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:49.375579 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:49.375520    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:49.776358 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:49.776270    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:49.840438 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:49.840406    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:49.842647 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:49.842615    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e07b1b3-32ed-442d-854f-9f9cd71e81e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jdrkz\" (UID: \"0e07b1b3-32ed-442d-854f-9f9cd71e81e5\") " pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:49.865909 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:49.865889    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zmjnb\""
Sep 15 07:51:49.873939 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:49.873925    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jdrkz"
Sep 15 07:51:49.977151 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:49.977125    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:50.173089 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:50.173019    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jdrkz"]
Sep 15 07:51:50.175138 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:51:50.175114    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e07b1b3_32ed_442d_854f_9f9cd71e81e5.slice/crio-1b02f3106813401f76a210f2c7285442bb0909d682d7b165eedcc8d78ba17047 WatchSource:0}: Error finding container 1b02f3106813401f76a210f2c7285442bb0909d682d7b165eedcc8d78ba17047: Status 404 returned error can't find the container with id 1b02f3106813401f76a210f2c7285442bb0909d682d7b165eedcc8d78ba17047
Sep 15 07:51:50.201171 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:50.201148    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:51.029541 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:51.029507    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jdrkz" event={"ID":"0e07b1b3-32ed-442d-854f-9f9cd71e81e5","Type":"ContainerStarted","Data":"f38336dffa28d35f76b58192d29c891c88eb97d2e486642eb70f8de1cfaa084a"}
Sep 15 07:51:51.029925 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:51.029567    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jdrkz" event={"ID":"0e07b1b3-32ed-442d-854f-9f9cd71e81e5","Type":"ContainerStarted","Data":"dc55035c86520357d482577c02e3e1140005bd55915a1390407894a04c126373"}
Sep 15 07:51:51.029925 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:51.029595    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jdrkz" event={"ID":"0e07b1b3-32ed-442d-854f-9f9cd71e81e5","Type":"ContainerStarted","Data":"1b02f3106813401f76a210f2c7285442bb0909d682d7b165eedcc8d78ba17047"}
Sep 15 07:51:52.719359 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:52.716541    2586 scope.go:117] "RemoveContainer" containerID="94acca1d8cf10f1ea5750c5dc0aec446a04a2511ac049303fc37db28e0e8fb8b"
Sep 15 07:51:53.038264 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.038167    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jdrkz" event={"ID":"0e07b1b3-32ed-442d-854f-9f9cd71e81e5","Type":"ContainerStarted","Data":"de622a31768f68c4f3cf9dca5e5ab1066b886dae8ec7c05b4a91d7e1fcccd40e"}
Sep 15 07:51:53.039909 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.039889    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cp9wl_a5527013-2ce3-48e3-b472-a593cbfbb55f/console-operator/1.log"
Sep 15 07:51:53.040025 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.039935    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-cp9wl" event={"ID":"a5527013-2ce3-48e3-b472-a593cbfbb55f","Type":"ContainerStarted","Data":"23d1689883f4e6c0675038ca46c0d5c1ba6cbcbe227a3a2b7179aff4aae49cec"}
Sep 15 07:51:53.040188 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.040169    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-cp9wl"
Sep 15 07:51:53.055767 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.055728    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jdrkz" podStartSLOduration=17.972821267 podStartE2EDuration="20.055714052s" totalImagesPullingTime="2.082892785s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:51:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:53.0540479 +0000 UTC m=+65.845510623" watchObservedRunningTime="2026-09-15 07:51:53.055714052 +0000 UTC m=+65.847176775"
Sep 15 07:51:53.069423 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.069361    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-cp9wl" podStartSLOduration=35.701513072 podStartE2EDuration="45.06934366s" totalImagesPullingTime="9.367830588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:53.06848557 +0000 UTC m=+65.859948294" watchObservedRunningTime="2026-09-15 07:51:53.06934366 +0000 UTC m=+65.860806388"
Sep 15 07:51:53.073541 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.073521    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-cp9wl"
Sep 15 07:51:53.245774 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.245738    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:53.346578 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.346545    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:53.397144 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.397114    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:53.472562 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.472532    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs\") pod \"network-metrics-daemon-dhdbz\" (UID: \"1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0\") " pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:51:53.472720 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.472587    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bd79376-f224-48c6-8c02-89f1be3e0a14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-p5672\" (UID: \"4bd79376-f224-48c6-8c02-89f1be3e0a14\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672"
Sep 15 07:51:53.472720 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.472623    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-th7m6\" (UID: \"fb4abd1b-bf9e-4015-99e8-851a2a3e9a83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-th7m6"
Sep 15 07:51:53.472720 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.472668    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:53.472844 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.472813    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-metrics-certs\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:53.472906 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.472883    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/793a3fee-4d06-4a69-97a5-b3a27db1d916-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-rrtj4\" (UID: \"793a3fee-4d06-4a69-97a5-b3a27db1d916\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rrtj4"
Sep 15 07:51:53.472959 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.472946    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/774b0ac9-0340-4bf4-b619-3d222d5ff31f-service-ca-bundle\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:53.473648 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.473605    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/774b0ac9-0340-4bf4-b619-3d222d5ff31f-service-ca-bundle\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:53.475142 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.475090    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 07:51:53.475271 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.475252    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774b0ac9-0340-4bf4-b619-3d222d5ff31f-metrics-certs\") pod \"router-default-669c6d8db4-rp2c5\" (UID: \"774b0ac9-0340-4bf4-b619-3d222d5ff31f\") " pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:53.475350 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.475252    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb4abd1b-bf9e-4015-99e8-851a2a3e9a83-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-th7m6\" (UID: \"fb4abd1b-bf9e-4015-99e8-851a2a3e9a83\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-th7m6"
Sep 15 07:51:53.475459 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.475435    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/793a3fee-4d06-4a69-97a5-b3a27db1d916-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-rrtj4\" (UID: \"793a3fee-4d06-4a69-97a5-b3a27db1d916\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rrtj4"
Sep 15 07:51:53.475622 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.475602    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bd79376-f224-48c6-8c02-89f1be3e0a14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-p5672\" (UID: \"4bd79376-f224-48c6-8c02-89f1be3e0a14\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672"
Sep 15 07:51:53.475740 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.475722    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls\") pod \"image-registry-86dd9785f-ctwrx\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") " pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:53.484767 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.484749    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0-metrics-certs\") pod \"network-metrics-daemon-dhdbz\" (UID: \"1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0\") " pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:51:53.565627 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.565590    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:53.573640 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.573611    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret\") pod \"global-pull-secret-syncer-frqd6\" (UID: \"d36ed006-6ecd-49cd-b7b1-965233accc84\") " pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:51:53.573734 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.573664    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6knx\" (UniqueName: \"kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx\") pod \"network-check-target-q6bn9\" (UID: \"6d3e2b9a-08af-462b-b07c-7f082791973c\") " pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:51:53.573734 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.573701    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-metrics-tls\") pod \"dns-default-hnrrg\" (UID: \"cab80741-1ae4-4014-b5dc-7d1e4751f3c9\") " pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:51:53.575920 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.575900    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cab80741-1ae4-4014-b5dc-7d1e4751f3c9-metrics-tls\") pod \"dns-default-hnrrg\" (UID: \"cab80741-1ae4-4014-b5dc-7d1e4751f3c9\") " pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:51:53.576114 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.576099    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 07:51:53.576199 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.576177    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6knx\" (UniqueName: \"kubernetes.io/projected/6d3e2b9a-08af-462b-b07c-7f082791973c-kube-api-access-q6knx\") pod \"network-check-target-q6bn9\" (UID: \"6d3e2b9a-08af-462b-b07c-7f082791973c\") " pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:51:53.585604 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.585588    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d36ed006-6ecd-49cd-b7b1-965233accc84-original-pull-secret\") pod \"global-pull-secret-syncer-frqd6\" (UID: \"d36ed006-6ecd-49cd-b7b1-965233accc84\") " pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:51:53.630936 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.630882    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wqt7v\""
Sep 15 07:51:53.637553 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.637536    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xcgfj\""
Sep 15 07:51:53.639222 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.639206    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhdbz"
Sep 15 07:51:53.646689 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.646673    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:51:53.678584 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.678558    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kmb2h\""
Sep 15 07:51:53.686589 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.686342    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672"
Sep 15 07:51:53.701620 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.701592    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-tb7ms\""
Sep 15 07:51:53.710163 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.710139    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-th7m6"
Sep 15 07:51:53.741862 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.741831    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4qhqj\""
Sep 15 07:51:53.748970 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.748945    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7bsc5\""
Sep 15 07:51:53.750293 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.750271    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:53.758652 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.758614    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:53.764086 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.762322    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9gpbx\""
Sep 15 07:51:53.772824 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.771096    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rrtj4"
Sep 15 07:51:53.784439 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.784417    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jf87k\""
Sep 15 07:51:53.792374 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.792343    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:51:53.825311 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.825168    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-frqd6"
Sep 15 07:51:53.916471 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.916447    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dhdbz"]
Sep 15 07:51:53.918629 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.918523    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q6bn9"]
Sep 15 07:51:53.919216 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:51:53.919133    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9a6da2_485c_4f6b_ab2e_ce2faf5602b0.slice/crio-a32151ad9f3c3999da12599f1c693feaa55205f6f0f4dff67c8ff763e5f1fafb WatchSource:0}: Error finding container a32151ad9f3c3999da12599f1c693feaa55205f6f0f4dff67c8ff763e5f1fafb: Status 404 returned error can't find the container with id a32151ad9f3c3999da12599f1c693feaa55205f6f0f4dff67c8ff763e5f1fafb
Sep 15 07:51:53.921169 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:51:53.921151    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3e2b9a_08af_462b_b07c_7f082791973c.slice/crio-5e0e1872c8703d165a4ea4ea3a0e790a29c0b009933894ed7ef0591d8cf30e7b WatchSource:0}: Error finding container 5e0e1872c8703d165a4ea4ea3a0e790a29c0b009933894ed7ef0591d8cf30e7b: Status 404 returned error can't find the container with id 5e0e1872c8703d165a4ea4ea3a0e790a29c0b009933894ed7ef0591d8cf30e7b
Sep 15 07:51:53.932396 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.932370    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:53.975094 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.975063    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672"]
Sep 15 07:51:53.977729 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:51:53.977706    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd79376_f224_48c6_8c02_89f1be3e0a14.slice/crio-c51cdbe9450402cd5b9be8b7bbbabf870ac639a7410873a029787da6db19c11d WatchSource:0}: Error finding container c51cdbe9450402cd5b9be8b7bbbabf870ac639a7410873a029787da6db19c11d: Status 404 returned error can't find the container with id c51cdbe9450402cd5b9be8b7bbbabf870ac639a7410873a029787da6db19c11d
Sep 15 07:51:53.991621 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:53.991602    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-th7m6"]
Sep 15 07:51:54.042429 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:54.042407    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86dd9785f-ctwrx"]
Sep 15 07:51:54.044928 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:51:54.044904    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb683e191_3926_4cc6_9326_beefc401a214.slice/crio-a46bab5b598b89b89e97bf5e085e83ac00946e31d57cd0d8586c8cd32c968dab WatchSource:0}: Error finding container a46bab5b598b89b89e97bf5e085e83ac00946e31d57cd0d8586c8cd32c968dab: Status 404 returned error can't find the container with id a46bab5b598b89b89e97bf5e085e83ac00946e31d57cd0d8586c8cd32c968dab
Sep 15 07:51:54.045239 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:54.045210    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q6bn9" event={"ID":"6d3e2b9a-08af-462b-b07c-7f082791973c","Type":"ContainerStarted","Data":"449f13a0122cbd947a2492db04de1b2b7e6fe99ea6ff450d82e2b77172ca34ff"}
Sep 15 07:51:54.045323 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:54.045266    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q6bn9" event={"ID":"6d3e2b9a-08af-462b-b07c-7f082791973c","Type":"ContainerStarted","Data":"5e0e1872c8703d165a4ea4ea3a0e790a29c0b009933894ed7ef0591d8cf30e7b"}
Sep 15 07:51:54.045323 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:54.045294    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:51:54.046440 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:54.046421    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672" event={"ID":"4bd79376-f224-48c6-8c02-89f1be3e0a14","Type":"ContainerStarted","Data":"c51cdbe9450402cd5b9be8b7bbbabf870ac639a7410873a029787da6db19c11d"}
Sep 15 07:51:54.048531 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:54.048459    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-669c6d8db4-rp2c5"]
Sep 15 07:51:54.048889 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:54.048611    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-th7m6" event={"ID":"fb4abd1b-bf9e-4015-99e8-851a2a3e9a83","Type":"ContainerStarted","Data":"30b00e454bb5e2925c091c86d2b74cda707c8d9530309bf45219bbaac7e76d5c"}
Sep 15 07:51:54.049840 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:54.049819    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dhdbz" event={"ID":"1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0","Type":"ContainerStarted","Data":"a32151ad9f3c3999da12599f1c693feaa55205f6f0f4dff67c8ff763e5f1fafb"}
Sep 15 07:51:54.051751 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:51:54.051729    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod774b0ac9_0340_4bf4_b619_3d222d5ff31f.slice/crio-1bafe02f5fd90eb12a34ee05d61de69a13c4bcce8eea30f14719794d6dd25b2d WatchSource:0}: Error finding container 1bafe02f5fd90eb12a34ee05d61de69a13c4bcce8eea30f14719794d6dd25b2d: Status 404 returned error can't find the container with id 1bafe02f5fd90eb12a34ee05d61de69a13c4bcce8eea30f14719794d6dd25b2d
Sep 15 07:51:54.060346 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:54.060315    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-rrtj4"]
Sep 15 07:51:54.062826 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:51:54.062802    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod793a3fee_4d06_4a69_97a5_b3a27db1d916.slice/crio-5b706ef057e746b1f3238d88e8b847ed4c4ceb1b829215e62c6f54cec5270994 WatchSource:0}: Error finding container 5b706ef057e746b1f3238d88e8b847ed4c4ceb1b829215e62c6f54cec5270994: Status 404 returned error can't find the container with id 5b706ef057e746b1f3238d88e8b847ed4c4ceb1b829215e62c6f54cec5270994
Sep 15 07:51:54.064125 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:54.064061    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q6bn9" podStartSLOduration=66.064044662 podStartE2EDuration="1m6.064044662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:50:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:54.063350127 +0000 UTC m=+66.854812851" watchObservedRunningTime="2026-09-15 07:51:54.064044662 +0000 UTC m=+66.855507386"
Sep 15 07:51:54.092300 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:54.092264    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hnrrg"]
Sep 15 07:51:54.094888 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:51:54.094863    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcab80741_1ae4_4014_b5dc_7d1e4751f3c9.slice/crio-947d201266e33ce6a90f0e433aab1a60e5f0ff25de2b06e0a0808e908aa2db9a WatchSource:0}: Error finding container 947d201266e33ce6a90f0e433aab1a60e5f0ff25de2b06e0a0808e908aa2db9a: Status 404 returned error can't find the container with id 947d201266e33ce6a90f0e433aab1a60e5f0ff25de2b06e0a0808e908aa2db9a
Sep 15 07:51:54.109819 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:54.109798    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-frqd6"]
Sep 15 07:51:54.112458 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:51:54.112427    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd36ed006_6ecd_49cd_b7b1_965233accc84.slice/crio-cf0f86f075b2ff9eef5cd147ecdc97b12a1c6698adc49ef1f3ef235e3dc504dd WatchSource:0}: Error finding container cf0f86f075b2ff9eef5cd147ecdc97b12a1c6698adc49ef1f3ef235e3dc504dd: Status 404 returned error can't find the container with id cf0f86f075b2ff9eef5cd147ecdc97b12a1c6698adc49ef1f3ef235e3dc504dd
Sep 15 07:51:54.330927 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:54.330836    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:54.715960 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:54.715874    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:54.797198 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:54.797114    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:54.927858 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:54.927768    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:54.998691 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:54.998595    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:55.059301 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:55.059262    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-frqd6" event={"ID":"d36ed006-6ecd-49cd-b7b1-965233accc84","Type":"ContainerStarted","Data":"cf0f86f075b2ff9eef5cd147ecdc97b12a1c6698adc49ef1f3ef235e3dc504dd"}
Sep 15 07:51:55.060875 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:55.060846    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hnrrg" event={"ID":"cab80741-1ae4-4014-b5dc-7d1e4751f3c9","Type":"ContainerStarted","Data":"947d201266e33ce6a90f0e433aab1a60e5f0ff25de2b06e0a0808e908aa2db9a"}
Sep 15 07:51:55.064884 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:55.064856    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-669c6d8db4-rp2c5" event={"ID":"774b0ac9-0340-4bf4-b619-3d222d5ff31f","Type":"ContainerStarted","Data":"b5072382d3803c66319c5e9a0282f4435de6441645d8b0978b738bec8d4fb652"}
Sep 15 07:51:55.064992 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:55.064909    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-669c6d8db4-rp2c5" event={"ID":"774b0ac9-0340-4bf4-b619-3d222d5ff31f","Type":"ContainerStarted","Data":"1bafe02f5fd90eb12a34ee05d61de69a13c4bcce8eea30f14719794d6dd25b2d"}
Sep 15 07:51:55.066812 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:55.066762    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dhdbz" event={"ID":"1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0","Type":"ContainerStarted","Data":"da5dc4404dd625033a9e0db7b7eb23a49097e6b0623bb44399ab4f6d3df13db9"}
Sep 15 07:51:55.068832 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:55.068805    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86dd9785f-ctwrx" event={"ID":"b683e191-3926-4cc6-9326-beefc401a214","Type":"ContainerStarted","Data":"1d4be2bf6793d90161f3fec00b9ae6426601369b5a41474bd2dba2c4e2848f4d"}
Sep 15 07:51:55.068949 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:55.068858    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86dd9785f-ctwrx" event={"ID":"b683e191-3926-4cc6-9326-beefc401a214","Type":"ContainerStarted","Data":"a46bab5b598b89b89e97bf5e085e83ac00946e31d57cd0d8586c8cd32c968dab"}
Sep 15 07:51:55.069415 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:55.069395    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:51:55.072061 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:55.072028    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rrtj4" event={"ID":"793a3fee-4d06-4a69-97a5-b3a27db1d916","Type":"ContainerStarted","Data":"5b706ef057e746b1f3238d88e8b847ed4c4ceb1b829215e62c6f54cec5270994"}
Sep 15 07:51:55.089825 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:55.089777    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-669c6d8db4-rp2c5" podStartSLOduration=47.089761177 podStartE2EDuration="47.089761177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:51:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:55.089301121 +0000 UTC m=+67.880763848" watchObservedRunningTime="2026-09-15 07:51:55.089761177 +0000 UTC m=+67.881223899"
Sep 15 07:51:55.104911 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:55.104886    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:55.168603 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:55.168521    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:55.237495 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:55.237425    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:55.393907 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:55.393876    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:55.449242 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:55.449208    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:55.751709 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:55.751674    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:55.754510 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:55.754487    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:55.775388 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:55.775295    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86dd9785f-ctwrx" podStartSLOduration=67.775258278 podStartE2EDuration="1m7.775258278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:50:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:55.113544422 +0000 UTC m=+67.905007147" watchObservedRunningTime="2026-09-15 07:51:55.775258278 +0000 UTC m=+68.566721001"
Sep 15 07:51:56.079411 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:56.079319    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dhdbz" event={"ID":"1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0","Type":"ContainerStarted","Data":"6566c6dcba6bed9ec3e4da5d698eab80b21c5a25014c71aac17dc9189c5930ef"}
Sep 15 07:51:56.081453 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:56.081404    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rrtj4" event={"ID":"793a3fee-4d06-4a69-97a5-b3a27db1d916","Type":"ContainerStarted","Data":"0a530428d0eb412afc5e0e70b1df4c3271a5a77212bd0284452a1f8439ae0745"}
Sep 15 07:51:56.082022 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:56.081865    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:56.083287 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:56.083245    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-669c6d8db4-rp2c5"
Sep 15 07:51:56.096947 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:56.096834    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dhdbz" podStartSLOduration=67.137635557 podStartE2EDuration="1m8.096815141s" totalImagesPullingTime="959.179584ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:56.096100858 +0000 UTC m=+68.887563583" watchObservedRunningTime="2026-09-15 07:51:56.096815141 +0000 UTC m=+68.888277868"
Sep 15 07:51:56.134842 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:56.134754    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rrtj4" podStartSLOduration=46.63436741 podStartE2EDuration="48.13473462s" totalImagesPullingTime="1.50036721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:56.13371682 +0000 UTC m=+68.925179544" watchObservedRunningTime="2026-09-15 07:51:56.13473462 +0000 UTC m=+68.926197344"
Sep 15 07:51:56.211778 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:56.211743    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:56.270305 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:56.270268    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:56.860943 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:56.860858    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:56.960540 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:56.960130    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:57.062470 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:57.062349    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:57.094593 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:57.094495    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672" event={"ID":"4bd79376-f224-48c6-8c02-89f1be3e0a14","Type":"ContainerStarted","Data":"2d00b089b3643c6c2efcd7650b4c329852b3db03e7fb58b28f24a82261ac619c"}
Sep 15 07:51:57.097769 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:57.097370    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-th7m6" event={"ID":"fb4abd1b-bf9e-4015-99e8-851a2a3e9a83","Type":"ContainerStarted","Data":"52108ef4f4d0bd5e169763529e2a226d6a2f5cf3af028ad0a5e057cd08ccfcd1"}
Sep 15 07:51:57.097769 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:57.097425    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-th7m6" event={"ID":"fb4abd1b-bf9e-4015-99e8-851a2a3e9a83","Type":"ContainerStarted","Data":"b13553440551dba3e95e5b5363973cd8918b8f062ac0e6cb89e2032f4ae6021a"}
Sep 15 07:51:57.116014 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:57.115965    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-p5672" podStartSLOduration=46.322009978 podStartE2EDuration="49.115947796s" totalImagesPullingTime="2.793937818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:57.114495868 +0000 UTC m=+69.905958592" watchObservedRunningTime="2026-09-15 07:51:57.115947796 +0000 UTC m=+69.907410519"
Sep 15 07:51:57.131384 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:57.131339    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-th7m6" podStartSLOduration=46.386702871 podStartE2EDuration="49.131321445s" totalImagesPullingTime="2.744618574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:57.130375674 +0000 UTC m=+69.921838398" watchObservedRunningTime="2026-09-15 07:51:57.131321445 +0000 UTC m=+69.922784168"
Sep 15 07:51:57.143531 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:57.143496    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:57.261107 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:57.261071    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:51:59.107241 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:59.107198    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-frqd6" event={"ID":"d36ed006-6ecd-49cd-b7b1-965233accc84","Type":"ContainerStarted","Data":"4640df34c30be1a530cbc65b3ab2b72a79ce11dda6fc70f55a16de4c3e2dbe14"}
Sep 15 07:51:59.122397 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:51:59.122337    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-frqd6" podStartSLOduration=66.423065732 podStartE2EDuration="1m11.122314364s" totalImagesPullingTime="4.699248632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:59.121543615 +0000 UTC m=+71.913006339" watchObservedRunningTime="2026-09-15 07:51:59.122314364 +0000 UTC m=+71.913777088"
Sep 15 07:52:00.730275 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:00.730238    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:00.830548 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:00.830474    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:01.115871 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:01.115823    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hnrrg" event={"ID":"cab80741-1ae4-4014-b5dc-7d1e4751f3c9","Type":"ContainerStarted","Data":"e56aa52b48e629ad680f35ce446a255d5c504166d86316a167bd664a3e1230be"}
Sep 15 07:52:01.116072 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:01.116044    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:52:01.116141 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:01.116102    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hnrrg" event={"ID":"cab80741-1ae4-4014-b5dc-7d1e4751f3c9","Type":"ContainerStarted","Data":"ff837f6bee75eda717f9f44bcfaae0cf1df8c100e2ffb951d68f3cc85caa459a"}
Sep 15 07:52:01.132734 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:01.132688    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hnrrg" podStartSLOduration=33.941511632 podStartE2EDuration="40.132670204s" totalImagesPullingTime="6.191158572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:51:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:52:01.131390349 +0000 UTC m=+73.922853072" watchObservedRunningTime="2026-09-15 07:52:01.132670204 +0000 UTC m=+73.924132928"
Sep 15 07:52:02.559678 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:02.559621    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:04.472072 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:04.472043    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:04.683557 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:04.683524    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:04.802758 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:04.802687    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t6kbq"]
Sep 15 07:52:04.803161 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:04.803135    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:04.816753 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:04.816731    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:04.819645 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:04.819610    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 07:52:04.820765 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:04.820739    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 07:52:04.820861 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:04.820792    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 07:52:04.821425 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:04.821409    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 07:52:04.821515 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:04.821497    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fn8tn\""
Sep 15 07:52:04.969106 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:04.969075    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-node-exporter-wtmp\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:04.969106 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:04.969109    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-metrics-client-ca\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:04.969325 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:04.969126    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-284rm\" (UniqueName: \"kubernetes.io/projected/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-kube-api-access-284rm\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:04.969325 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:04.969226    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-node-exporter-textfile\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:04.969325 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:04.969269    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-sys\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:04.969455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:04.969326    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-root\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:04.969455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:04.969353    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-node-exporter-tls\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:04.969455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:04.969376    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-node-exporter-accelerators-collector-config\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:04.969455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:04.969404    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:04.983189 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:04.983153    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:05.071843 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.070548    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-node-exporter-textfile\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:05.071843 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.070672    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-sys\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:05.071843 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.070720    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-root\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:05.071843 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.070762    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-node-exporter-tls\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:05.071843 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.070795    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-node-exporter-accelerators-collector-config\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:05.071843 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.070829    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:05.071843 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.070880    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-node-exporter-textfile\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:05.071843 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.070916    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-node-exporter-wtmp\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:05.071843 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.070946    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-metrics-client-ca\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:05.071843 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.070976    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-284rm\" (UniqueName: \"kubernetes.io/projected/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-kube-api-access-284rm\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:05.071843 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.070981    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-sys\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:05.071843 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.071115    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-node-exporter-wtmp\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:05.071843 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.071377    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-root\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:05.071843 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.071739    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-metrics-client-ca\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:05.072516 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.072168    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-node-exporter-accelerators-collector-config\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:05.074203 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.074156    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:05.076317 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.076293    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-node-exporter-tls\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:05.079296 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.079275    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-284rm\" (UniqueName: \"kubernetes.io/projected/3c4c6ac9-8e57-41ea-b5f4-e23db633b07a-kube-api-access-284rm\") pod \"node-exporter-t6kbq\" (UID: \"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a\") " pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:05.083437 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.083410    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:05.125725 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.125695    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t6kbq"
Sep 15 07:52:05.165356 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:52:05.165329    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c4c6ac9_8e57_41ea_b5f4_e23db633b07a.slice/crio-4f9f0a122a978b4949d564cebe05b8a2db013fa0ac3d5fb8c83bdbe892f1053a WatchSource:0}: Error finding container 4f9f0a122a978b4949d564cebe05b8a2db013fa0ac3d5fb8c83bdbe892f1053a: Status 404 returned error can't find the container with id 4f9f0a122a978b4949d564cebe05b8a2db013fa0ac3d5fb8c83bdbe892f1053a
Sep 15 07:52:05.184956 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.184924    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:05.283535 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.283499    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:05.341707 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.341675    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:05.402867 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.402827    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:05.612190 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.612095    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:05.712519 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.712477    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:05.800822 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:05.800790    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:06.133793 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:06.133759    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t6kbq" event={"ID":"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a","Type":"ContainerStarted","Data":"4f9f0a122a978b4949d564cebe05b8a2db013fa0ac3d5fb8c83bdbe892f1053a"}
Sep 15 07:52:06.142088 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:06.142058    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:06.345944 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:06.345901    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:06.447455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:06.447376    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:07.656194 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:07.656162    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:07.739103 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:07.739058    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:07.795100 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:07.795073    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:08.108290 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:08.108255    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:09.482945 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:09.482918    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:09.582885 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:09.582852    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:09.682874 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:09.682836    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:09.786705 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:09.786674    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:10.148661 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:10.148608    2586 generic.go:356] "Generic (PLEG): container finished" podID="3c4c6ac9-8e57-41ea-b5f4-e23db633b07a" containerID="ee0e76b6868d92bce22254e737d775c39d8a029ccd554a82dd4f176f4597e095" exitCode=0
Sep 15 07:52:10.148820 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:10.148695    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t6kbq" event={"ID":"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a","Type":"ContainerDied","Data":"ee0e76b6868d92bce22254e737d775c39d8a029ccd554a82dd4f176f4597e095"}
Sep 15 07:52:10.892038 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:10.892000    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:11.121291 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:11.121262    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hnrrg"
Sep 15 07:52:11.155846 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:11.155771    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t6kbq" event={"ID":"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a","Type":"ContainerStarted","Data":"9c81a4fc1ccf34cfe144548d1ed99d903acb722b043b67f376ba5f531bec7f15"}
Sep 15 07:52:11.155846 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:11.155831    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t6kbq" event={"ID":"3c4c6ac9-8e57-41ea-b5f4-e23db633b07a","Type":"ContainerStarted","Data":"27cf4b3c749fff3024d86b7c5d810788f7d3cf0e47c5196a5a85e6042536e056"}
Sep 15 07:52:11.174614 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:11.174564    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t6kbq" podStartSLOduration=2.58000516 podStartE2EDuration="7.174548615s" totalImagesPullingTime="4.530158659s" totalInitContainerRuntime="64.384796ms" isStatefulPod=true podCreationTimestamp="2026-09-15 07:52:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:52:11.173233028 +0000 UTC m=+83.964695748" watchObservedRunningTime="2026-09-15 07:52:11.174548615 +0000 UTC m=+83.966011337"
Sep 15 07:52:13.758171 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:13.758140    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:13.763792 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:13.763763    2586 patch_prober.go:28] interesting pod/image-registry-86dd9785f-ctwrx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 15 07:52:13.763926 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:13.763809    2586 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-86dd9785f-ctwrx" podUID="b683e191-3926-4cc6-9326-beefc401a214" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 07:52:13.856983 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:13.856945    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:14.379716 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:14.379678    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:14.484564 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:14.484531    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:15.470695 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:15.470656    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:15.571046 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:15.571014    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:17.101904 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:17.101872    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:52:17.234487 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:17.234448    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86dd9785f-ctwrx"]
Sep 15 07:52:17.251284 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:17.251258    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:17.356094 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:17.356007    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:17.411649 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:17.411605    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:17.650075 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:17.649994    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:17.750775 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:17.750744    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:18.285241 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:18.285197    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:18.382055 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:18.382022    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:19.565261 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:19.565221    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:20.183426 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:20.183395    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:20.236150 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:20.236119    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:20.957762 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:20.957730    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:21.013461 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:21.013428    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:25.074802 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:25.074772    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q6bn9"
Sep 15 07:52:25.613390 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:25.613349    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:29.233969 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:29.233938    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:29.334012 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:29.333981    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:30.470007 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:30.469972    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:30.571218 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:30.571182    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:42.259830 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.259782    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-86dd9785f-ctwrx" podUID="b683e191-3926-4cc6-9326-beefc401a214" containerName="registry" containerID="cri-o://1d4be2bf6793d90161f3fec00b9ae6426601369b5a41474bd2dba2c4e2848f4d" gracePeriod=30
Sep 15 07:52:42.501520 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.501497    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:52:42.549747 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.549680    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b683e191-3926-4cc6-9326-beefc401a214-image-registry-private-configuration\") pod \"b683e191-3926-4cc6-9326-beefc401a214\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") "
Sep 15 07:52:42.549747 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.549717    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b683e191-3926-4cc6-9326-beefc401a214-installation-pull-secrets\") pod \"b683e191-3926-4cc6-9326-beefc401a214\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") "
Sep 15 07:52:42.549894 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.549759    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b683e191-3926-4cc6-9326-beefc401a214-trusted-ca\") pod \"b683e191-3926-4cc6-9326-beefc401a214\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") "
Sep 15 07:52:42.549953 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.549930    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b683e191-3926-4cc6-9326-beefc401a214-registry-certificates\") pod \"b683e191-3926-4cc6-9326-beefc401a214\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") "
Sep 15 07:52:42.550010 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.549996    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-bound-sa-token\") pod \"b683e191-3926-4cc6-9326-beefc401a214\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") "
Sep 15 07:52:42.550056 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.550026    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls\") pod \"b683e191-3926-4cc6-9326-beefc401a214\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") "
Sep 15 07:52:42.550105 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.550057    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b683e191-3926-4cc6-9326-beefc401a214-ca-trust-extracted\") pod \"b683e191-3926-4cc6-9326-beefc401a214\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") "
Sep 15 07:52:42.550105 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.550090    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xw5mr\" (UniqueName: \"kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-kube-api-access-xw5mr\") pod \"b683e191-3926-4cc6-9326-beefc401a214\" (UID: \"b683e191-3926-4cc6-9326-beefc401a214\") "
Sep 15 07:52:42.550496 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.550336    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b683e191-3926-4cc6-9326-beefc401a214-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b683e191-3926-4cc6-9326-beefc401a214" (UID: "b683e191-3926-4cc6-9326-beefc401a214"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 07:52:42.551950 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.551910    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b683e191-3926-4cc6-9326-beefc401a214-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b683e191-3926-4cc6-9326-beefc401a214" (UID: "b683e191-3926-4cc6-9326-beefc401a214"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 07:52:42.552394 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.552367    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b683e191-3926-4cc6-9326-beefc401a214" (UID: "b683e191-3926-4cc6-9326-beefc401a214"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:52:42.552493 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.552369    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b683e191-3926-4cc6-9326-beefc401a214-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b683e191-3926-4cc6-9326-beefc401a214" (UID: "b683e191-3926-4cc6-9326-beefc401a214"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:52:42.552493 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.552425    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b683e191-3926-4cc6-9326-beefc401a214" (UID: "b683e191-3926-4cc6-9326-beefc401a214"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:52:42.552692 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.552665    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b683e191-3926-4cc6-9326-beefc401a214-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b683e191-3926-4cc6-9326-beefc401a214" (UID: "b683e191-3926-4cc6-9326-beefc401a214"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:52:42.552796 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.552690    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-kube-api-access-xw5mr" (OuterVolumeSpecName: "kube-api-access-xw5mr") pod "b683e191-3926-4cc6-9326-beefc401a214" (UID: "b683e191-3926-4cc6-9326-beefc401a214"). InnerVolumeSpecName "kube-api-access-xw5mr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:52:42.558670 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.558617    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b683e191-3926-4cc6-9326-beefc401a214-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b683e191-3926-4cc6-9326-beefc401a214" (UID: "b683e191-3926-4cc6-9326-beefc401a214"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 07:52:42.650785 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.650753    2586 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-bound-sa-token\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 07:52:42.650785 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.650779    2586 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-registry-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 07:52:42.650785 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.650788    2586 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b683e191-3926-4cc6-9326-beefc401a214-ca-trust-extracted\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 07:52:42.651000 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.650798    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xw5mr\" (UniqueName: \"kubernetes.io/projected/b683e191-3926-4cc6-9326-beefc401a214-kube-api-access-xw5mr\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 07:52:42.651000 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.650809    2586 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b683e191-3926-4cc6-9326-beefc401a214-image-registry-private-configuration\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 07:52:42.651000 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.650817    2586 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b683e191-3926-4cc6-9326-beefc401a214-installation-pull-secrets\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 07:52:42.651000 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.650825    2586 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b683e191-3926-4cc6-9326-beefc401a214-trusted-ca\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 07:52:42.651000 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:42.650834    2586 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b683e191-3926-4cc6-9326-beefc401a214-registry-certificates\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 07:52:43.270616 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:43.270583    2586 generic.go:356] "Generic (PLEG): container finished" podID="b683e191-3926-4cc6-9326-beefc401a214" containerID="1d4be2bf6793d90161f3fec00b9ae6426601369b5a41474bd2dba2c4e2848f4d" exitCode=0
Sep 15 07:52:43.271010 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:43.270647    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86dd9785f-ctwrx"
Sep 15 07:52:43.271010 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:43.270668    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86dd9785f-ctwrx" event={"ID":"b683e191-3926-4cc6-9326-beefc401a214","Type":"ContainerDied","Data":"1d4be2bf6793d90161f3fec00b9ae6426601369b5a41474bd2dba2c4e2848f4d"}
Sep 15 07:52:43.271010 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:43.270717    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86dd9785f-ctwrx" event={"ID":"b683e191-3926-4cc6-9326-beefc401a214","Type":"ContainerDied","Data":"a46bab5b598b89b89e97bf5e085e83ac00946e31d57cd0d8586c8cd32c968dab"}
Sep 15 07:52:43.271010 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:43.270749    2586 scope.go:117] "RemoveContainer" containerID="1d4be2bf6793d90161f3fec00b9ae6426601369b5a41474bd2dba2c4e2848f4d"
Sep 15 07:52:43.272301 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:43.272276    2586 generic.go:356] "Generic (PLEG): container finished" podID="2ac26be4-56a7-4bbc-abcb-de5b68959883" containerID="2ee922e3f186800d6b331c38fa5eca4f9f80a2277a835246efc4c8504a795dd2" exitCode=0
Sep 15 07:52:43.272415 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:43.272345    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xr5xn" event={"ID":"2ac26be4-56a7-4bbc-abcb-de5b68959883","Type":"ContainerDied","Data":"2ee922e3f186800d6b331c38fa5eca4f9f80a2277a835246efc4c8504a795dd2"}
Sep 15 07:52:43.272621 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:43.272608    2586 scope.go:117] "RemoveContainer" containerID="2ee922e3f186800d6b331c38fa5eca4f9f80a2277a835246efc4c8504a795dd2"
Sep 15 07:52:43.282165 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:43.282149    2586 scope.go:117] "RemoveContainer" containerID="1d4be2bf6793d90161f3fec00b9ae6426601369b5a41474bd2dba2c4e2848f4d"
Sep 15 07:52:43.282423 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:52:43.282407    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d4be2bf6793d90161f3fec00b9ae6426601369b5a41474bd2dba2c4e2848f4d\": container with ID starting with 1d4be2bf6793d90161f3fec00b9ae6426601369b5a41474bd2dba2c4e2848f4d not found: ID does not exist" containerID="1d4be2bf6793d90161f3fec00b9ae6426601369b5a41474bd2dba2c4e2848f4d"
Sep 15 07:52:43.282474 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:43.282429    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d4be2bf6793d90161f3fec00b9ae6426601369b5a41474bd2dba2c4e2848f4d"} err="failed to get container status \"1d4be2bf6793d90161f3fec00b9ae6426601369b5a41474bd2dba2c4e2848f4d\": rpc error: code = NotFound desc = could not find container \"1d4be2bf6793d90161f3fec00b9ae6426601369b5a41474bd2dba2c4e2848f4d\": container with ID starting with 1d4be2bf6793d90161f3fec00b9ae6426601369b5a41474bd2dba2c4e2848f4d not found: ID does not exist"
Sep 15 07:52:43.308763 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:43.308738    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86dd9785f-ctwrx"]
Sep 15 07:52:43.319094 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:43.316312    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-86dd9785f-ctwrx"]
Sep 15 07:52:43.721012 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:43.720978    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b683e191-3926-4cc6-9326-beefc401a214" path="/var/lib/kubelet/pods/b683e191-3926-4cc6-9326-beefc401a214/volumes"
Sep 15 07:52:44.277443 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:44.277412    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-xr5xn" event={"ID":"2ac26be4-56a7-4bbc-abcb-de5b68959883","Type":"ContainerStarted","Data":"c759eccc27320bc77d25dbc247c9461dc8725d8ffd4d5573ea0a22ae249e0ae5"}
Sep 15 07:52:45.467742 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:45.467710    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:45.529652 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:45.529600    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:48.293826 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:48.293793    2586 generic.go:356] "Generic (PLEG): container finished" podID="f07222e9-cd97-4468-81e2-b609ade2d29c" containerID="1249f7928a71657f4c4ee3a6fa639008d599ba19158cf0bbf9c6e48278dda2e5" exitCode=0
Sep 15 07:52:48.294183 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:48.293845    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-fth5n" event={"ID":"f07222e9-cd97-4468-81e2-b609ade2d29c","Type":"ContainerDied","Data":"1249f7928a71657f4c4ee3a6fa639008d599ba19158cf0bbf9c6e48278dda2e5"}
Sep 15 07:52:48.294183 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:48.294150    2586 scope.go:117] "RemoveContainer" containerID="1249f7928a71657f4c4ee3a6fa639008d599ba19158cf0bbf9c6e48278dda2e5"
Sep 15 07:52:49.068114 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:49.068085    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-669c6d8db4-rp2c5_774b0ac9-0340-4bf4-b619-3d222d5ff31f/router/0.log"
Sep 15 07:52:49.079611 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:49.079581    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kdpdg_5c3e0fb9-88d9-4643-ac6a-f3ade63ff6f8/serve-healthcheck-canary/0.log"
Sep 15 07:52:49.301493 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:49.301462    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-fth5n" event={"ID":"f07222e9-cd97-4468-81e2-b609ade2d29c","Type":"ContainerStarted","Data":"e4f65bc2cac13190b5092df04d9ebcbf78753e3f1958df3d2e522d46a15ef88f"}
Sep 15 07:52:53.867430 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:53.867396    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:53.968697 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:53.968665    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:54.023054 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:54.023022    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:52:58.334219 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:58.334182    2586 generic.go:356] "Generic (PLEG): container finished" podID="6b8214e2-c0ae-4ea5-992d-8a1b54e78196" containerID="576c5ca4b7223a47ab0fb97e9c1293c26d0f93c30620e365ac9146c566929bef" exitCode=0
Sep 15 07:52:58.334591 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:58.334258    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-n97wk" event={"ID":"6b8214e2-c0ae-4ea5-992d-8a1b54e78196","Type":"ContainerDied","Data":"576c5ca4b7223a47ab0fb97e9c1293c26d0f93c30620e365ac9146c566929bef"}
Sep 15 07:52:58.334591 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:58.334582    2586 scope.go:117] "RemoveContainer" containerID="576c5ca4b7223a47ab0fb97e9c1293c26d0f93c30620e365ac9146c566929bef"
Sep 15 07:52:59.343370 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:52:59.343329    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-n97wk" event={"ID":"6b8214e2-c0ae-4ea5-992d-8a1b54e78196","Type":"ContainerStarted","Data":"45538a6ccecd29eb9b781d4ad66e4757712ad2764b16cc38957a453ad5a86086"}
Sep 15 07:53:03.852315 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:03.852282    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:53:23.908925 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:23.908875    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:53:24.332503 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:24.332475    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:53:28.981182 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:28.981146    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7b59d99f99-qkzth"]
Sep 15 07:53:28.981590 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:28.981422    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b683e191-3926-4cc6-9326-beefc401a214" containerName="registry"
Sep 15 07:53:28.981590 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:28.981433    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="b683e191-3926-4cc6-9326-beefc401a214" containerName="registry"
Sep 15 07:53:28.981590 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:28.981482    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="b683e191-3926-4cc6-9326-beefc401a214" containerName="registry"
Sep 15 07:53:28.984595 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:28.984573    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:28.986965 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:28.986900    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 15 07:53:28.986965 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:28.986944    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 15 07:53:28.987149 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:28.986943    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 15 07:53:28.987149 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:28.987027    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 15 07:53:28.987304 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:28.987263    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 15 07:53:28.987369 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:28.987353    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-cdtww\""
Sep 15 07:53:28.991982 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:28.991958    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 15 07:53:28.996408 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:28.996381    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b59d99f99-qkzth"]
Sep 15 07:53:29.083186 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.083151    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/427d69f1-ea72-4c48-9185-fa142e6f0d6e-metrics-client-ca\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.083186 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.083188    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/427d69f1-ea72-4c48-9185-fa142e6f0d6e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.083371 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.083216    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/427d69f1-ea72-4c48-9185-fa142e6f0d6e-secret-telemeter-client\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.083371 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.083297    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/427d69f1-ea72-4c48-9185-fa142e6f0d6e-telemeter-client-tls\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.083371 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.083323    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/427d69f1-ea72-4c48-9185-fa142e6f0d6e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.083371 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.083355    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/427d69f1-ea72-4c48-9185-fa142e6f0d6e-federate-client-tls\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.083537 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.083400    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/427d69f1-ea72-4c48-9185-fa142e6f0d6e-serving-certs-ca-bundle\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.083537 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.083434    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st8wm\" (UniqueName: \"kubernetes.io/projected/427d69f1-ea72-4c48-9185-fa142e6f0d6e-kube-api-access-st8wm\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.183922 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.183886    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st8wm\" (UniqueName: \"kubernetes.io/projected/427d69f1-ea72-4c48-9185-fa142e6f0d6e-kube-api-access-st8wm\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.184092 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.183932    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/427d69f1-ea72-4c48-9185-fa142e6f0d6e-metrics-client-ca\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.184092 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.183950    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/427d69f1-ea72-4c48-9185-fa142e6f0d6e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.184092 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.183967    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/427d69f1-ea72-4c48-9185-fa142e6f0d6e-secret-telemeter-client\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.184092 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.184036    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/427d69f1-ea72-4c48-9185-fa142e6f0d6e-telemeter-client-tls\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.184312 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.184092    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/427d69f1-ea72-4c48-9185-fa142e6f0d6e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.184312 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.184142    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/427d69f1-ea72-4c48-9185-fa142e6f0d6e-federate-client-tls\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.184312 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.184173    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/427d69f1-ea72-4c48-9185-fa142e6f0d6e-serving-certs-ca-bundle\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.184884 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.184845    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/427d69f1-ea72-4c48-9185-fa142e6f0d6e-metrics-client-ca\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.185024 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.184928    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/427d69f1-ea72-4c48-9185-fa142e6f0d6e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.185098 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.185074    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/427d69f1-ea72-4c48-9185-fa142e6f0d6e-serving-certs-ca-bundle\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.186555 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.186534    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/427d69f1-ea72-4c48-9185-fa142e6f0d6e-secret-telemeter-client\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.186672 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.186627    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/427d69f1-ea72-4c48-9185-fa142e6f0d6e-telemeter-client-tls\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.186967 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.186944    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/427d69f1-ea72-4c48-9185-fa142e6f0d6e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.187006 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.186994    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/427d69f1-ea72-4c48-9185-fa142e6f0d6e-federate-client-tls\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.191095 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.191077    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st8wm\" (UniqueName: \"kubernetes.io/projected/427d69f1-ea72-4c48-9185-fa142e6f0d6e-kube-api-access-st8wm\") pod \"telemeter-client-7b59d99f99-qkzth\" (UID: \"427d69f1-ea72-4c48-9185-fa142e6f0d6e\") " pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.296416 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.296342    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth"
Sep 15 07:53:29.573437 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:29.573364    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b59d99f99-qkzth"]
Sep 15 07:53:29.577020 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:53:29.576990    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod427d69f1_ea72_4c48_9185_fa142e6f0d6e.slice/crio-26340ded47174ad6ef1d681b4c0f52d320d4d5c42f0040929d89f5b882185393 WatchSource:0}: Error finding container 26340ded47174ad6ef1d681b4c0f52d320d4d5c42f0040929d89f5b882185393: Status 404 returned error can't find the container with id 26340ded47174ad6ef1d681b4c0f52d320d4d5c42f0040929d89f5b882185393
Sep 15 07:53:30.457040 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:30.456998    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth" event={"ID":"427d69f1-ea72-4c48-9185-fa142e6f0d6e","Type":"ContainerStarted","Data":"26340ded47174ad6ef1d681b4c0f52d320d4d5c42f0040929d89f5b882185393"}
Sep 15 07:53:31.462338 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:31.462303    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth" event={"ID":"427d69f1-ea72-4c48-9185-fa142e6f0d6e","Type":"ContainerStarted","Data":"ae223f85a5b49c1a69f0a5951c0a640ccd23f6cfc1eb5316f3980efe7e793f16"}
Sep 15 07:53:33.471100 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:33.471065    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth" event={"ID":"427d69f1-ea72-4c48-9185-fa142e6f0d6e","Type":"ContainerStarted","Data":"9e3e79b1bc52f1c8769ca6672d14da9d0ecbce5af4d9c13c1c8d2b34803d22a5"}
Sep 15 07:53:33.471459 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:33.471122    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth" event={"ID":"427d69f1-ea72-4c48-9185-fa142e6f0d6e","Type":"ContainerStarted","Data":"9fdce109b6af4780555a417b8e6a0e3df7f1a1b4bf5f822ec131f52512ab31c6"}
Sep 15 07:53:33.493046 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:33.492993    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7b59d99f99-qkzth" podStartSLOduration=2.626582896 podStartE2EDuration="5.492973802s" totalImagesPullingTime="2.866390906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:53:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:53:33.491368682 +0000 UTC m=+166.282831404" watchObservedRunningTime="2026-09-15 07:53:33.492973802 +0000 UTC m=+166.284436526"
Sep 15 07:53:33.634111 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:33.630236    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:53:33.695680 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:33.695645    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:53:40.343271 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:40.343191    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:53:40.394918 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:40.394883    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:53:44.901544 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:44.901513    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:53:45.000319 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:45.000282    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:53:45.066175 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:53:45.066136    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:54:19.247616 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:54:19.247575    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:54:39.147458 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:54:39.147415    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:54:39.201330 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:54:39.201297    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:54:52.198268 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:54:52.198219    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:54:52.251107 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:54:52.251074    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:54:53.346206 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:54:53.346170    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:54:54.131834 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:54:54.131797    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:55:00.478952 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:55:00.478907    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:55:00.580691 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:55:00.580655    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:55:02.047431 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:55:02.047399    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:55:03.395846 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:55:03.395810    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:55:03.459980 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:55:03.459949    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:55:04.187347 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:55:04.187311    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:55:04.239597 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:55:04.239564    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:55:04.306132 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:55:04.306096    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:55:47.628232 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:55:47.628206    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cp9wl_a5527013-2ce3-48e3-b472-a593cbfbb55f/console-operator/1.log"
Sep 15 07:55:47.628950 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:55:47.628929    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cp9wl_a5527013-2ce3-48e3-b472-a593cbfbb55f/console-operator/1.log"
Sep 15 07:55:47.639266 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:55:47.639240    2586 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 07:56:08.958925 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:08.958893    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:56:27.420053 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:27.420017    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:56:27.470596 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:27.470567    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:56:43.471853 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:43.471770    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:56:43.572812 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:43.572776    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:56:44.150524 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:44.150492    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:56:44.153819 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:44.153794    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5c47bfcdb4-h44fp"]
Sep 15 07:56:44.156801 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:44.156785    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5c47bfcdb4-h44fp"
Sep 15 07:56:44.159234 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:44.159213    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Sep 15 07:56:44.160209 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:44.160191    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Sep 15 07:56:44.160349 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:44.160333    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-9l2nh\""
Sep 15 07:56:44.164993 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:44.164972    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5c47bfcdb4-h44fp"]
Sep 15 07:56:44.227812 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:44.227783    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss8rn\" (UniqueName: \"kubernetes.io/projected/3ab3ade1-2e38-4762-8eea-a507917e2aa6-kube-api-access-ss8rn\") pod \"feast-operator-controller-manager-5c47bfcdb4-h44fp\" (UID: \"3ab3ade1-2e38-4762-8eea-a507917e2aa6\") " pod="feast-operator-system/feast-operator-controller-manager-5c47bfcdb4-h44fp"
Sep 15 07:56:44.328195 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:44.328160    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss8rn\" (UniqueName: \"kubernetes.io/projected/3ab3ade1-2e38-4762-8eea-a507917e2aa6-kube-api-access-ss8rn\") pod \"feast-operator-controller-manager-5c47bfcdb4-h44fp\" (UID: \"3ab3ade1-2e38-4762-8eea-a507917e2aa6\") " pod="feast-operator-system/feast-operator-controller-manager-5c47bfcdb4-h44fp"
Sep 15 07:56:44.339125 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:44.339105    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss8rn\" (UniqueName: \"kubernetes.io/projected/3ab3ade1-2e38-4762-8eea-a507917e2aa6-kube-api-access-ss8rn\") pod \"feast-operator-controller-manager-5c47bfcdb4-h44fp\" (UID: \"3ab3ade1-2e38-4762-8eea-a507917e2aa6\") " pod="feast-operator-system/feast-operator-controller-manager-5c47bfcdb4-h44fp"
Sep 15 07:56:44.467792 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:44.467710    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5c47bfcdb4-h44fp"
Sep 15 07:56:44.734958 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:44.734933    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5c47bfcdb4-h44fp"]
Sep 15 07:56:44.737132 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:56:44.737106    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ab3ade1_2e38_4762_8eea_a507917e2aa6.slice/crio-d9ee1ca1dac6803841b619f74eff1da65d663a87757c9ac634c1c102f032049b WatchSource:0}: Error finding container d9ee1ca1dac6803841b619f74eff1da65d663a87757c9ac634c1c102f032049b: Status 404 returned error can't find the container with id d9ee1ca1dac6803841b619f74eff1da65d663a87757c9ac634c1c102f032049b
Sep 15 07:56:44.739005 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:44.738988    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 07:56:45.150971 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:45.150935    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5c47bfcdb4-h44fp" event={"ID":"3ab3ade1-2e38-4762-8eea-a507917e2aa6","Type":"ContainerStarted","Data":"d9ee1ca1dac6803841b619f74eff1da65d663a87757c9ac634c1c102f032049b"}
Sep 15 07:56:48.165488 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:48.165447    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5c47bfcdb4-h44fp" event={"ID":"3ab3ade1-2e38-4762-8eea-a507917e2aa6","Type":"ContainerStarted","Data":"a6af47ff3ea00a683727188280482a0a2dd8e4f0ade5d3740383a8f8946159d3"}
Sep 15 07:56:48.165892 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:48.165622    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-5c47bfcdb4-h44fp"
Sep 15 07:56:48.181455 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:48.181408    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-5c47bfcdb4-h44fp" podStartSLOduration=1.7540895760000002 podStartE2EDuration="4.181396023s" totalImagesPullingTime="2.427306447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:56:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:56:48.180964085 +0000 UTC m=+360.972426808" watchObservedRunningTime="2026-09-15 07:56:48.181396023 +0000 UTC m=+360.972858745"
Sep 15 07:56:59.171414 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:56:59.171386    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-5c47bfcdb4-h44fp"
Sep 15 07:57:10.065392 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:10.065357    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:57:10.118941 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:10.118905    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:57:20.726870 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:20.726837    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:57:20.828254 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:20.828221    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:57:20.961599 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:20.961565    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:57:22.120740 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:22.120701    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:57:22.221236 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:22.221201    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:57:22.847843 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:22.847810    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"]
Sep 15 07:57:22.854450 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:22.854431    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:57:22.856948 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:22.856906    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 15 07:57:22.857097 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:22.856985    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Sep 15 07:57:22.857097 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:22.857067    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 15 07:57:22.857376 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:22.857358    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 15 07:57:22.857458 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:22.857377    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 15 07:57:22.857458 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:22.857381    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 15 07:57:22.857839 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:22.857823    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-v5j4p\""
Sep 15 07:57:22.857900 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:22.857827    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 15 07:57:22.863257 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:22.863237    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"]
Sep 15 07:57:22.879345 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:22.879309    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:57:22.919592 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:22.919568    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dhjd\" (UniqueName: \"kubernetes.io/projected/61cc8390-0f0e-4797-9a46-396ee449e0e3-kube-api-access-9dhjd\") pod \"feast-simple-feast-setup-66bd755747-cwq9r\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:57:22.919696 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:22.919604    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-registry-tls\") pod \"feast-simple-feast-setup-66bd755747-cwq9r\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:57:22.919696 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:22.919623    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-offline-tls\") pod \"feast-simple-feast-setup-66bd755747-cwq9r\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:57:22.919794 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:22.919705    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-online-tls\") pod \"feast-simple-feast-setup-66bd755747-cwq9r\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:57:22.919794 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:22.919739    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-ui-tls\") pod \"feast-simple-feast-setup-66bd755747-cwq9r\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:57:22.919794 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:22.919774    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/61cc8390-0f0e-4797-9a46-396ee449e0e3-feast-data\") pod \"feast-simple-feast-setup-66bd755747-cwq9r\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:57:22.979557 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:22.979531    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:57:23.020890 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:23.020864    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-online-tls\") pod \"feast-simple-feast-setup-66bd755747-cwq9r\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:57:23.020994 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:23.020898    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-ui-tls\") pod \"feast-simple-feast-setup-66bd755747-cwq9r\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:57:23.020994 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:23.020925    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/61cc8390-0f0e-4797-9a46-396ee449e0e3-feast-data\") pod \"feast-simple-feast-setup-66bd755747-cwq9r\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:57:23.020994 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:23.020957    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dhjd\" (UniqueName: \"kubernetes.io/projected/61cc8390-0f0e-4797-9a46-396ee449e0e3-kube-api-access-9dhjd\") pod \"feast-simple-feast-setup-66bd755747-cwq9r\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:57:23.020994 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:23.020992    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-registry-tls\") pod \"feast-simple-feast-setup-66bd755747-cwq9r\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:57:23.021187 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:23.021005    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-offline-tls\") pod \"feast-simple-feast-setup-66bd755747-cwq9r\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:57:23.021187 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:57:23.021009    2586 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Sep 15 07:57:23.021187 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:57:23.021060    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-ui-tls podName:61cc8390-0f0e-4797-9a46-396ee449e0e3 nodeName:}" failed. No retries permitted until 2026-09-15 07:57:23.521045076 +0000 UTC m=+396.312507782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-ui-tls") pod "feast-simple-feast-setup-66bd755747-cwq9r" (UID: "61cc8390-0f0e-4797-9a46-396ee449e0e3") : secret "feast-simple-feast-setup-ui-tls" not found
Sep 15 07:57:23.021366 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:23.021344    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/61cc8390-0f0e-4797-9a46-396ee449e0e3-feast-data\") pod \"feast-simple-feast-setup-66bd755747-cwq9r\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:57:23.023434 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:23.023408    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-online-tls\") pod \"feast-simple-feast-setup-66bd755747-cwq9r\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:57:23.023519 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:23.023441    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-registry-tls\") pod \"feast-simple-feast-setup-66bd755747-cwq9r\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:57:23.023519 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:23.023467    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-offline-tls\") pod \"feast-simple-feast-setup-66bd755747-cwq9r\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:57:23.028677 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:23.028658    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dhjd\" (UniqueName: \"kubernetes.io/projected/61cc8390-0f0e-4797-9a46-396ee449e0e3-kube-api-access-9dhjd\") pod \"feast-simple-feast-setup-66bd755747-cwq9r\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:57:23.076128 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:23.076100    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:57:23.237082 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:23.236985    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:57:23.524816 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:23.524724    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-ui-tls\") pod \"feast-simple-feast-setup-66bd755747-cwq9r\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:57:23.527086 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:23.527063    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-ui-tls\") pod \"feast-simple-feast-setup-66bd755747-cwq9r\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:57:23.777234 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:23.777153    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:57:24.052940 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:24.052915    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"]
Sep 15 07:57:24.055034 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:57:24.055009    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61cc8390_0f0e_4797_9a46_396ee449e0e3.slice/crio-3f62e0d095821d86e4f08145b2b081b7edb7838fefad7e60219ade14c40bd50c WatchSource:0}: Error finding container 3f62e0d095821d86e4f08145b2b081b7edb7838fefad7e60219ade14c40bd50c: Status 404 returned error can't find the container with id 3f62e0d095821d86e4f08145b2b081b7edb7838fefad7e60219ade14c40bd50c
Sep 15 07:57:24.300988 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:24.300951    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" event={"ID":"61cc8390-0f0e-4797-9a46-396ee449e0e3","Type":"ContainerStarted","Data":"3f62e0d095821d86e4f08145b2b081b7edb7838fefad7e60219ade14c40bd50c"}
Sep 15 07:57:52.419105 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:52.419066    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" event={"ID":"61cc8390-0f0e-4797-9a46-396ee449e0e3","Type":"ContainerStarted","Data":"c6b731116a04c887073ddd446822a83cb0b3dcbe5a100431a06fed5690ec83f5"}
Sep 15 07:57:57.440263 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:57.440232    2586 generic.go:356] "Generic (PLEG): container finished" podID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerID="c6b731116a04c887073ddd446822a83cb0b3dcbe5a100431a06fed5690ec83f5" exitCode=0
Sep 15 07:57:57.440728 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:57.440310    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" event={"ID":"61cc8390-0f0e-4797-9a46-396ee449e0e3","Type":"ContainerDied","Data":"c6b731116a04c887073ddd446822a83cb0b3dcbe5a100431a06fed5690ec83f5"}
Sep 15 07:57:58.445926 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:57:58.445891    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" event={"ID":"61cc8390-0f0e-4797-9a46-396ee449e0e3","Type":"ContainerStarted","Data":"fcdf29e44be5001bc15d62cd430318566e828dafb64c0538c16f5137cdc9e329"}
Sep 15 07:58:03.466345 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:03.466269    2586 generic.go:356] "Generic (PLEG): container finished" podID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerID="fcdf29e44be5001bc15d62cd430318566e828dafb64c0538c16f5137cdc9e329" exitCode=0
Sep 15 07:58:03.466746 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:03.466340    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" event={"ID":"61cc8390-0f0e-4797-9a46-396ee449e0e3","Type":"ContainerDied","Data":"fcdf29e44be5001bc15d62cd430318566e828dafb64c0538c16f5137cdc9e329"}
Sep 15 07:58:03.475913 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:03.475893    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Sep 15 07:58:04.475896 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:04.475855    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" event={"ID":"61cc8390-0f0e-4797-9a46-396ee449e0e3","Type":"ContainerStarted","Data":"af0bc99d444931fb9e81d4d69a5f720ab2b2c372f76f6d04a909b20171f3f336"}
Sep 15 07:58:04.476426 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:04.475921    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" event={"ID":"61cc8390-0f0e-4797-9a46-396ee449e0e3","Type":"ContainerStarted","Data":"ab8f7aa3d2550610292d05d5c468899b62fe2702a6130cdab9b64eea2be7d685"}
Sep 15 07:58:04.476426 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:04.475947    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" event={"ID":"61cc8390-0f0e-4797-9a46-396ee449e0e3","Type":"ContainerStarted","Data":"bfe86c160d427b83e938d58fe97395737cfd57381826b9d778a6eab5ec29067b"}
Sep 15 07:58:04.476426 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:04.475966    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" event={"ID":"61cc8390-0f0e-4797-9a46-396ee449e0e3","Type":"ContainerStarted","Data":"843dd3b647ff1504d93aaaa5ba5d326f6821a5ede4a97cee63a2992a9b260cd4"}
Sep 15 07:58:04.499996 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:04.499918    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" podStartSLOduration=14.648960843 podStartE2EDuration="42.499893599s" totalImagesPullingTime="27.850932756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:58:04.497671012 +0000 UTC m=+437.289133737" watchObservedRunningTime="2026-09-15 07:58:04.499893599 +0000 UTC m=+437.291356325"
Sep 15 07:58:05.777737 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:05.777662    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:58:05.777737 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:05.777728    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:58:05.778262 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:05.777749    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:58:05.778262 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:05.777766    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:58:05.780008 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:05.779972    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.22:8816: connect: connection refused"
Sep 15 07:58:05.780296 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:05.779972    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
Sep 15 07:58:05.780401 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:05.779967    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
Sep 15 07:58:05.780401 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:05.780009    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.22:6571: connect: connection refused"
Sep 15 07:58:08.111317 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:08.111267    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:58:08.778605 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:08.778485    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
Sep 15 07:58:08.778605 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:08.778485    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.22:6571: connect: connection refused"
Sep 15 07:58:08.778605 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:08.778551    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.22:8816: connect: connection refused"
Sep 15 07:58:08.778605 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:08.778563    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
Sep 15 07:58:10.351889 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:10.351784    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:58:10.411298 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:10.411262    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:58:11.778207 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:11.778161    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
Sep 15 07:58:11.779353 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:11.779323    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:58:11.779470 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:11.779444    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:58:11.780077 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:11.780054    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:58:11.780266 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:11.780244    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:58:11.780378 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:11.780333    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:58:11.780482 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:11.780466    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:58:11.784776 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:11.784755    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:58:12.517196 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:12.517169    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:58:12.520364 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:12.520342    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:58:13.777906 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:13.777874    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:58:14.777865 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:14.777837    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:58:15.528789 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:15.528763    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:58:15.891581 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:58:15.891545    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:59:17.142932 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.142886    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:59:17.178740 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.178707    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"]
Sep 15 07:59:17.179302 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.179267    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="registry" containerID="cri-o://843dd3b647ff1504d93aaaa5ba5d326f6821a5ede4a97cee63a2992a9b260cd4" gracePeriod=30
Sep 15 07:59:17.179857 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.179820    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="ui" containerID="cri-o://af0bc99d444931fb9e81d4d69a5f720ab2b2c372f76f6d04a909b20171f3f336" gracePeriod=30
Sep 15 07:59:17.179981 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.179840    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="offline" containerID="cri-o://ab8f7aa3d2550610292d05d5c468899b62fe2702a6130cdab9b64eea2be7d685" gracePeriod=30
Sep 15 07:59:17.180069 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.180028    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="online" containerID="cri-o://bfe86c160d427b83e938d58fe97395737cfd57381826b9d778a6eab5ec29067b" gracePeriod=30
Sep 15 07:59:17.236501 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.236465    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:59:17.421421 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.421323    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:59:17.523660 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.523594    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"]
Sep 15 07:59:17.527479 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.527453    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:17.530690 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.530666    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-xzkrx\""
Sep 15 07:59:17.537436 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.537412    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:59:17.541176 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.541151    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"]
Sep 15 07:59:17.646654 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.646586    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-offline-tls\") pod \"feast-simple-feast-setup-66bd755747-vfbbf\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:17.646654 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.646644    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-registry-tls\") pod \"feast-simple-feast-setup-66bd755747-vfbbf\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:17.646914 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.646704    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp525\" (UniqueName: \"kubernetes.io/projected/60df0879-96ad-4a5c-ae78-586a5d3be9a3-kube-api-access-jp525\") pod \"feast-simple-feast-setup-66bd755747-vfbbf\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:17.646914 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.646729    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-ui-tls\") pod \"feast-simple-feast-setup-66bd755747-vfbbf\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:17.646914 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.646789    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-online-tls\") pod \"feast-simple-feast-setup-66bd755747-vfbbf\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:17.646914 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.646825    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/60df0879-96ad-4a5c-ae78-586a5d3be9a3-feast-data\") pod \"feast-simple-feast-setup-66bd755747-vfbbf\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:17.655320 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.655288    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:59:17.747526 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.747434    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-online-tls\") pod \"feast-simple-feast-setup-66bd755747-vfbbf\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:17.747526 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.747486    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/60df0879-96ad-4a5c-ae78-586a5d3be9a3-feast-data\") pod \"feast-simple-feast-setup-66bd755747-vfbbf\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:17.747784 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.747532    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-offline-tls\") pod \"feast-simple-feast-setup-66bd755747-vfbbf\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:17.747784 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.747582    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-registry-tls\") pod \"feast-simple-feast-setup-66bd755747-vfbbf\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:17.747784 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.747657    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp525\" (UniqueName: \"kubernetes.io/projected/60df0879-96ad-4a5c-ae78-586a5d3be9a3-kube-api-access-jp525\") pod \"feast-simple-feast-setup-66bd755747-vfbbf\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:17.747784 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.747706    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-ui-tls\") pod \"feast-simple-feast-setup-66bd755747-vfbbf\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:17.748004 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:59:17.747825    2586 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Sep 15 07:59:17.748004 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:59:17.747897    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-ui-tls podName:60df0879-96ad-4a5c-ae78-586a5d3be9a3 nodeName:}" failed. No retries permitted until 2026-09-15 07:59:18.24787745 +0000 UTC m=+511.039340154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-ui-tls") pod "feast-simple-feast-setup-66bd755747-vfbbf" (UID: "60df0879-96ad-4a5c-ae78-586a5d3be9a3") : secret "feast-simple-feast-setup-ui-tls" not found
Sep 15 07:59:17.748118 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.748006    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/60df0879-96ad-4a5c-ae78-586a5d3be9a3-feast-data\") pod \"feast-simple-feast-setup-66bd755747-vfbbf\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:17.750236 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.750209    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-offline-tls\") pod \"feast-simple-feast-setup-66bd755747-vfbbf\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:17.750375 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.750331    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-online-tls\") pod \"feast-simple-feast-setup-66bd755747-vfbbf\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:17.750711 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.750691    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-registry-tls\") pod \"feast-simple-feast-setup-66bd755747-vfbbf\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:17.755015 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.754988    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:59:17.756906 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:17.756883    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp525\" (UniqueName: \"kubernetes.io/projected/60df0879-96ad-4a5c-ae78-586a5d3be9a3-kube-api-access-jp525\") pod \"feast-simple-feast-setup-66bd755747-vfbbf\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:18.019268 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:18.019236    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:59:18.251858 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:18.251778    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-ui-tls\") pod \"feast-simple-feast-setup-66bd755747-vfbbf\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:18.254088 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:18.254069    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-ui-tls\") pod \"feast-simple-feast-setup-66bd755747-vfbbf\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") " pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:18.436852 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:18.436810    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:18.711162 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:18.711048    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"]
Sep 15 07:59:18.713770 ip-10-0-134-189 kubenswrapper[2586]: W0915 07:59:18.713747    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60df0879_96ad_4a5c_ae78_586a5d3be9a3.slice/crio-d1b7dbaaea6a820f2304c52f508a6be87da19bc79fbeba87f7c1a96b92fd7606 WatchSource:0}: Error finding container d1b7dbaaea6a820f2304c52f508a6be87da19bc79fbeba87f7c1a96b92fd7606: Status 404 returned error can't find the container with id d1b7dbaaea6a820f2304c52f508a6be87da19bc79fbeba87f7c1a96b92fd7606
Sep 15 07:59:18.759366 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:18.759337    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" event={"ID":"60df0879-96ad-4a5c-ae78-586a5d3be9a3","Type":"ContainerStarted","Data":"d1b7dbaaea6a820f2304c52f508a6be87da19bc79fbeba87f7c1a96b92fd7606"}
Sep 15 07:59:18.762603 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:18.762580    2586 generic.go:356] "Generic (PLEG): container finished" podID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerID="af0bc99d444931fb9e81d4d69a5f720ab2b2c372f76f6d04a909b20171f3f336" exitCode=0
Sep 15 07:59:18.762603 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:18.762603    2586 generic.go:356] "Generic (PLEG): container finished" podID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerID="bfe86c160d427b83e938d58fe97395737cfd57381826b9d778a6eab5ec29067b" exitCode=0
Sep 15 07:59:18.762749 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:18.762609    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" event={"ID":"61cc8390-0f0e-4797-9a46-396ee449e0e3","Type":"ContainerDied","Data":"af0bc99d444931fb9e81d4d69a5f720ab2b2c372f76f6d04a909b20171f3f336"}
Sep 15 07:59:18.762749 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:18.762674    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" event={"ID":"61cc8390-0f0e-4797-9a46-396ee449e0e3","Type":"ContainerDied","Data":"bfe86c160d427b83e938d58fe97395737cfd57381826b9d778a6eab5ec29067b"}
Sep 15 07:59:19.767421 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:19.767388    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" event={"ID":"60df0879-96ad-4a5c-ae78-586a5d3be9a3","Type":"ContainerStarted","Data":"9105544a514b03e04643669fceaeb69b630847c71cc2022cfbf43f29bc71fad1"}
Sep 15 07:59:22.517480 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:22.517439    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
Sep 15 07:59:23.782733 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:23.782649    2586 generic.go:356] "Generic (PLEG): container finished" podID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerID="9105544a514b03e04643669fceaeb69b630847c71cc2022cfbf43f29bc71fad1" exitCode=0
Sep 15 07:59:23.782733 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:23.782703    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" event={"ID":"60df0879-96ad-4a5c-ae78-586a5d3be9a3","Type":"ContainerDied","Data":"9105544a514b03e04643669fceaeb69b630847c71cc2022cfbf43f29bc71fad1"}
Sep 15 07:59:24.788536 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:24.788505    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" event={"ID":"60df0879-96ad-4a5c-ae78-586a5d3be9a3","Type":"ContainerStarted","Data":"7009df4e6eeb841f7537aa52df27ec98a8e591be474ac8fc6c7f16d378051a7f"}
Sep 15 07:59:25.528685 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:25.528616    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
Sep 15 07:59:29.810334 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:29.810253    2586 generic.go:356] "Generic (PLEG): container finished" podID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerID="7009df4e6eeb841f7537aa52df27ec98a8e591be474ac8fc6c7f16d378051a7f" exitCode=0
Sep 15 07:59:29.810334 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:29.810316    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" event={"ID":"60df0879-96ad-4a5c-ae78-586a5d3be9a3","Type":"ContainerDied","Data":"7009df4e6eeb841f7537aa52df27ec98a8e591be474ac8fc6c7f16d378051a7f"}
Sep 15 07:59:30.820740 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:30.820692    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" event={"ID":"60df0879-96ad-4a5c-ae78-586a5d3be9a3","Type":"ContainerStarted","Data":"45353857c6e6870ca7447f3fa777199bd38ec756749703c35bbc4c729e27980e"}
Sep 15 07:59:30.821304 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:30.820760    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" event={"ID":"60df0879-96ad-4a5c-ae78-586a5d3be9a3","Type":"ContainerStarted","Data":"6fd6e7e6523a0b8cdbf2c30a4c3252038de0d6cb0c014540a0104764b7808c2a"}
Sep 15 07:59:30.821304 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:30.820781    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" event={"ID":"60df0879-96ad-4a5c-ae78-586a5d3be9a3","Type":"ContainerStarted","Data":"ab014e6b2c67bcd0f91f012c9eb71006bc1a3446e9c2465b24bb8b22328721f7"}
Sep 15 07:59:30.821304 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:30.820800    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" event={"ID":"60df0879-96ad-4a5c-ae78-586a5d3be9a3","Type":"ContainerStarted","Data":"91d3533b753ae07354b627db7ffb54e8e4b2c5731f65d7230b55e5da01b81d76"}
Sep 15 07:59:30.844084 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:30.844021    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" podStartSLOduration=13.844000362 podStartE2EDuration="13.844000362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:59:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:59:30.842511584 +0000 UTC m=+523.633974314" watchObservedRunningTime="2026-09-15 07:59:30.844000362 +0000 UTC m=+523.635463086"
Sep 15 07:59:32.518378 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:32.518329    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
Sep 15 07:59:33.437135 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:33.437087    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:33.437435 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:33.437232    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:33.437435 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:33.437275    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:33.437435 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:33.437294    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:33.439710 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:33.439671    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
Sep 15 07:59:33.439876 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:33.439713    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.23:6571: connect: connection refused"
Sep 15 07:59:33.439876 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:33.439802    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.23:8816: connect: connection refused"
Sep 15 07:59:33.440049 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:33.440012    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
Sep 15 07:59:35.528715 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:35.528663    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
Sep 15 07:59:36.438033 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:36.437979    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.23:8816: connect: connection refused"
Sep 15 07:59:36.438033 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:36.438030    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.23:6571: connect: connection refused"
Sep 15 07:59:36.438290 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:36.437992    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
Sep 15 07:59:36.438290 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:36.437999    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
Sep 15 07:59:38.437447 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:38.437410    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:38.437837 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:38.437472    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:38.437837 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:38.437485    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:38.437837 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:38.437497    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:39.438234 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:39.438204    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:39.438706 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:39.438653    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:39.438839 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:39.438825    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:39.439342 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:39.439317    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:39.439442 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:39.439386    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:39.439442 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:39.439434    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:39.443822 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:39.443805    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:39.873462 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:39.873434    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 07:59:40.127763 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:40.127625    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 07:59:42.517878 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:42.517839    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
Sep 15 07:59:42.518235 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:42.517970    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:59:45.529291 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:45.529254    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
Sep 15 07:59:45.529757 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:45.529365    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:59:47.829777 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.829751    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:59:47.903743 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.903713    2586 generic.go:356] "Generic (PLEG): container finished" podID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerID="ab8f7aa3d2550610292d05d5c468899b62fe2702a6130cdab9b64eea2be7d685" exitCode=137
Sep 15 07:59:47.903743 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.903738    2586 generic.go:356] "Generic (PLEG): container finished" podID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerID="843dd3b647ff1504d93aaaa5ba5d326f6821a5ede4a97cee63a2992a9b260cd4" exitCode=137
Sep 15 07:59:47.903917 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.903782    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"
Sep 15 07:59:47.903917 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.903794    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" event={"ID":"61cc8390-0f0e-4797-9a46-396ee449e0e3","Type":"ContainerDied","Data":"ab8f7aa3d2550610292d05d5c468899b62fe2702a6130cdab9b64eea2be7d685"}
Sep 15 07:59:47.903917 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.903844    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" event={"ID":"61cc8390-0f0e-4797-9a46-396ee449e0e3","Type":"ContainerDied","Data":"843dd3b647ff1504d93aaaa5ba5d326f6821a5ede4a97cee63a2992a9b260cd4"}
Sep 15 07:59:47.903917 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.903865    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r" event={"ID":"61cc8390-0f0e-4797-9a46-396ee449e0e3","Type":"ContainerDied","Data":"3f62e0d095821d86e4f08145b2b081b7edb7838fefad7e60219ade14c40bd50c"}
Sep 15 07:59:47.903917 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.903890    2586 scope.go:117] "RemoveContainer" containerID="af0bc99d444931fb9e81d4d69a5f720ab2b2c372f76f6d04a909b20171f3f336"
Sep 15 07:59:47.911611 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.911600    2586 scope.go:117] "RemoveContainer" containerID="ab8f7aa3d2550610292d05d5c468899b62fe2702a6130cdab9b64eea2be7d685"
Sep 15 07:59:47.918763 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.918746    2586 scope.go:117] "RemoveContainer" containerID="bfe86c160d427b83e938d58fe97395737cfd57381826b9d778a6eab5ec29067b"
Sep 15 07:59:47.925709 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.925689    2586 scope.go:117] "RemoveContainer" containerID="843dd3b647ff1504d93aaaa5ba5d326f6821a5ede4a97cee63a2992a9b260cd4"
Sep 15 07:59:47.932603 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.932588    2586 scope.go:117] "RemoveContainer" containerID="fcdf29e44be5001bc15d62cd430318566e828dafb64c0538c16f5137cdc9e329"
Sep 15 07:59:47.939166 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.939151    2586 scope.go:117] "RemoveContainer" containerID="c6b731116a04c887073ddd446822a83cb0b3dcbe5a100431a06fed5690ec83f5"
Sep 15 07:59:47.945679 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.945663    2586 scope.go:117] "RemoveContainer" containerID="af0bc99d444931fb9e81d4d69a5f720ab2b2c372f76f6d04a909b20171f3f336"
Sep 15 07:59:47.945929 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:59:47.945911    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af0bc99d444931fb9e81d4d69a5f720ab2b2c372f76f6d04a909b20171f3f336\": container with ID starting with af0bc99d444931fb9e81d4d69a5f720ab2b2c372f76f6d04a909b20171f3f336 not found: ID does not exist" containerID="af0bc99d444931fb9e81d4d69a5f720ab2b2c372f76f6d04a909b20171f3f336"
Sep 15 07:59:47.946000 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.945943    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af0bc99d444931fb9e81d4d69a5f720ab2b2c372f76f6d04a909b20171f3f336"} err="failed to get container status \"af0bc99d444931fb9e81d4d69a5f720ab2b2c372f76f6d04a909b20171f3f336\": rpc error: code = NotFound desc = could not find container \"af0bc99d444931fb9e81d4d69a5f720ab2b2c372f76f6d04a909b20171f3f336\": container with ID starting with af0bc99d444931fb9e81d4d69a5f720ab2b2c372f76f6d04a909b20171f3f336 not found: ID does not exist"
Sep 15 07:59:47.946000 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.945966    2586 scope.go:117] "RemoveContainer" containerID="ab8f7aa3d2550610292d05d5c468899b62fe2702a6130cdab9b64eea2be7d685"
Sep 15 07:59:47.946222 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:59:47.946205    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab8f7aa3d2550610292d05d5c468899b62fe2702a6130cdab9b64eea2be7d685\": container with ID starting with ab8f7aa3d2550610292d05d5c468899b62fe2702a6130cdab9b64eea2be7d685 not found: ID does not exist" containerID="ab8f7aa3d2550610292d05d5c468899b62fe2702a6130cdab9b64eea2be7d685"
Sep 15 07:59:47.946265 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.946229    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab8f7aa3d2550610292d05d5c468899b62fe2702a6130cdab9b64eea2be7d685"} err="failed to get container status \"ab8f7aa3d2550610292d05d5c468899b62fe2702a6130cdab9b64eea2be7d685\": rpc error: code = NotFound desc = could not find container \"ab8f7aa3d2550610292d05d5c468899b62fe2702a6130cdab9b64eea2be7d685\": container with ID starting with ab8f7aa3d2550610292d05d5c468899b62fe2702a6130cdab9b64eea2be7d685 not found: ID does not exist"
Sep 15 07:59:47.946265 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.946245    2586 scope.go:117] "RemoveContainer" containerID="bfe86c160d427b83e938d58fe97395737cfd57381826b9d778a6eab5ec29067b"
Sep 15 07:59:47.946482 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:59:47.946465    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfe86c160d427b83e938d58fe97395737cfd57381826b9d778a6eab5ec29067b\": container with ID starting with bfe86c160d427b83e938d58fe97395737cfd57381826b9d778a6eab5ec29067b not found: ID does not exist" containerID="bfe86c160d427b83e938d58fe97395737cfd57381826b9d778a6eab5ec29067b"
Sep 15 07:59:47.946516 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.946488    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfe86c160d427b83e938d58fe97395737cfd57381826b9d778a6eab5ec29067b"} err="failed to get container status \"bfe86c160d427b83e938d58fe97395737cfd57381826b9d778a6eab5ec29067b\": rpc error: code = NotFound desc = could not find container \"bfe86c160d427b83e938d58fe97395737cfd57381826b9d778a6eab5ec29067b\": container with ID starting with bfe86c160d427b83e938d58fe97395737cfd57381826b9d778a6eab5ec29067b not found: ID does not exist"
Sep 15 07:59:47.946516 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.946505    2586 scope.go:117] "RemoveContainer" containerID="843dd3b647ff1504d93aaaa5ba5d326f6821a5ede4a97cee63a2992a9b260cd4"
Sep 15 07:59:47.946747 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:59:47.946728    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"843dd3b647ff1504d93aaaa5ba5d326f6821a5ede4a97cee63a2992a9b260cd4\": container with ID starting with 843dd3b647ff1504d93aaaa5ba5d326f6821a5ede4a97cee63a2992a9b260cd4 not found: ID does not exist" containerID="843dd3b647ff1504d93aaaa5ba5d326f6821a5ede4a97cee63a2992a9b260cd4"
Sep 15 07:59:47.946818 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.946754    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"843dd3b647ff1504d93aaaa5ba5d326f6821a5ede4a97cee63a2992a9b260cd4"} err="failed to get container status \"843dd3b647ff1504d93aaaa5ba5d326f6821a5ede4a97cee63a2992a9b260cd4\": rpc error: code = NotFound desc = could not find container \"843dd3b647ff1504d93aaaa5ba5d326f6821a5ede4a97cee63a2992a9b260cd4\": container with ID starting with 843dd3b647ff1504d93aaaa5ba5d326f6821a5ede4a97cee63a2992a9b260cd4 not found: ID does not exist"
Sep 15 07:59:47.946818 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.946775    2586 scope.go:117] "RemoveContainer" containerID="fcdf29e44be5001bc15d62cd430318566e828dafb64c0538c16f5137cdc9e329"
Sep 15 07:59:47.947000 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:59:47.946985    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcdf29e44be5001bc15d62cd430318566e828dafb64c0538c16f5137cdc9e329\": container with ID starting with fcdf29e44be5001bc15d62cd430318566e828dafb64c0538c16f5137cdc9e329 not found: ID does not exist" containerID="fcdf29e44be5001bc15d62cd430318566e828dafb64c0538c16f5137cdc9e329"
Sep 15 07:59:47.947055 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.947006    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcdf29e44be5001bc15d62cd430318566e828dafb64c0538c16f5137cdc9e329"} err="failed to get container status \"fcdf29e44be5001bc15d62cd430318566e828dafb64c0538c16f5137cdc9e329\": rpc error: code = NotFound desc = could not find container \"fcdf29e44be5001bc15d62cd430318566e828dafb64c0538c16f5137cdc9e329\": container with ID starting with fcdf29e44be5001bc15d62cd430318566e828dafb64c0538c16f5137cdc9e329 not found: ID does not exist"
Sep 15 07:59:47.947055 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.947023    2586 scope.go:117] "RemoveContainer" containerID="c6b731116a04c887073ddd446822a83cb0b3dcbe5a100431a06fed5690ec83f5"
Sep 15 07:59:47.947268 ip-10-0-134-189 kubenswrapper[2586]: E0915 07:59:47.947249    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6b731116a04c887073ddd446822a83cb0b3dcbe5a100431a06fed5690ec83f5\": container with ID starting with c6b731116a04c887073ddd446822a83cb0b3dcbe5a100431a06fed5690ec83f5 not found: ID does not exist" containerID="c6b731116a04c887073ddd446822a83cb0b3dcbe5a100431a06fed5690ec83f5"
Sep 15 07:59:47.947360 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.947273    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6b731116a04c887073ddd446822a83cb0b3dcbe5a100431a06fed5690ec83f5"} err="failed to get container status \"c6b731116a04c887073ddd446822a83cb0b3dcbe5a100431a06fed5690ec83f5\": rpc error: code = NotFound desc = could not find container \"c6b731116a04c887073ddd446822a83cb0b3dcbe5a100431a06fed5690ec83f5\": container with ID starting with c6b731116a04c887073ddd446822a83cb0b3dcbe5a100431a06fed5690ec83f5 not found: ID does not exist"
Sep 15 07:59:47.947360 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.947287    2586 scope.go:117] "RemoveContainer" containerID="af0bc99d444931fb9e81d4d69a5f720ab2b2c372f76f6d04a909b20171f3f336"
Sep 15 07:59:47.947523 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.947506    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af0bc99d444931fb9e81d4d69a5f720ab2b2c372f76f6d04a909b20171f3f336"} err="failed to get container status \"af0bc99d444931fb9e81d4d69a5f720ab2b2c372f76f6d04a909b20171f3f336\": rpc error: code = NotFound desc = could not find container \"af0bc99d444931fb9e81d4d69a5f720ab2b2c372f76f6d04a909b20171f3f336\": container with ID starting with af0bc99d444931fb9e81d4d69a5f720ab2b2c372f76f6d04a909b20171f3f336 not found: ID does not exist"
Sep 15 07:59:47.947567 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.947523    2586 scope.go:117] "RemoveContainer" containerID="ab8f7aa3d2550610292d05d5c468899b62fe2702a6130cdab9b64eea2be7d685"
Sep 15 07:59:47.947812 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.947795    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab8f7aa3d2550610292d05d5c468899b62fe2702a6130cdab9b64eea2be7d685"} err="failed to get container status \"ab8f7aa3d2550610292d05d5c468899b62fe2702a6130cdab9b64eea2be7d685\": rpc error: code = NotFound desc = could not find container \"ab8f7aa3d2550610292d05d5c468899b62fe2702a6130cdab9b64eea2be7d685\": container with ID starting with ab8f7aa3d2550610292d05d5c468899b62fe2702a6130cdab9b64eea2be7d685 not found: ID does not exist"
Sep 15 07:59:47.947875 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.947813    2586 scope.go:117] "RemoveContainer" containerID="bfe86c160d427b83e938d58fe97395737cfd57381826b9d778a6eab5ec29067b"
Sep 15 07:59:47.948022 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.948006    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfe86c160d427b83e938d58fe97395737cfd57381826b9d778a6eab5ec29067b"} err="failed to get container status \"bfe86c160d427b83e938d58fe97395737cfd57381826b9d778a6eab5ec29067b\": rpc error: code = NotFound desc = could not find container \"bfe86c160d427b83e938d58fe97395737cfd57381826b9d778a6eab5ec29067b\": container with ID starting with bfe86c160d427b83e938d58fe97395737cfd57381826b9d778a6eab5ec29067b not found: ID does not exist"
Sep 15 07:59:47.948078 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.948022    2586 scope.go:117] "RemoveContainer" containerID="843dd3b647ff1504d93aaaa5ba5d326f6821a5ede4a97cee63a2992a9b260cd4"
Sep 15 07:59:47.948270 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.948255    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"843dd3b647ff1504d93aaaa5ba5d326f6821a5ede4a97cee63a2992a9b260cd4"} err="failed to get container status \"843dd3b647ff1504d93aaaa5ba5d326f6821a5ede4a97cee63a2992a9b260cd4\": rpc error: code = NotFound desc = could not find container \"843dd3b647ff1504d93aaaa5ba5d326f6821a5ede4a97cee63a2992a9b260cd4\": container with ID starting with 843dd3b647ff1504d93aaaa5ba5d326f6821a5ede4a97cee63a2992a9b260cd4 not found: ID does not exist"
Sep 15 07:59:47.948270 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.948268    2586 scope.go:117] "RemoveContainer" containerID="fcdf29e44be5001bc15d62cd430318566e828dafb64c0538c16f5137cdc9e329"
Sep 15 07:59:47.948445 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.948429    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcdf29e44be5001bc15d62cd430318566e828dafb64c0538c16f5137cdc9e329"} err="failed to get container status \"fcdf29e44be5001bc15d62cd430318566e828dafb64c0538c16f5137cdc9e329\": rpc error: code = NotFound desc = could not find container \"fcdf29e44be5001bc15d62cd430318566e828dafb64c0538c16f5137cdc9e329\": container with ID starting with fcdf29e44be5001bc15d62cd430318566e828dafb64c0538c16f5137cdc9e329 not found: ID does not exist"
Sep 15 07:59:47.948526 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.948445    2586 scope.go:117] "RemoveContainer" containerID="c6b731116a04c887073ddd446822a83cb0b3dcbe5a100431a06fed5690ec83f5"
Sep 15 07:59:47.948705 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:47.948689    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6b731116a04c887073ddd446822a83cb0b3dcbe5a100431a06fed5690ec83f5"} err="failed to get container status \"c6b731116a04c887073ddd446822a83cb0b3dcbe5a100431a06fed5690ec83f5\": rpc error: code = NotFound desc = could not find container \"c6b731116a04c887073ddd446822a83cb0b3dcbe5a100431a06fed5690ec83f5\": container with ID starting with c6b731116a04c887073ddd446822a83cb0b3dcbe5a100431a06fed5690ec83f5 not found: ID does not exist"
Sep 15 07:59:48.010248 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:48.010225    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dhjd\" (UniqueName: \"kubernetes.io/projected/61cc8390-0f0e-4797-9a46-396ee449e0e3-kube-api-access-9dhjd\") pod \"61cc8390-0f0e-4797-9a46-396ee449e0e3\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") "
Sep 15 07:59:48.010364 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:48.010257    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-offline-tls\") pod \"61cc8390-0f0e-4797-9a46-396ee449e0e3\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") "
Sep 15 07:59:48.010364 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:48.010284    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-registry-tls\") pod \"61cc8390-0f0e-4797-9a46-396ee449e0e3\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") "
Sep 15 07:59:48.010502 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:48.010485    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-online-tls\") pod \"61cc8390-0f0e-4797-9a46-396ee449e0e3\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") "
Sep 15 07:59:48.010569 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:48.010542    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-ui-tls\") pod \"61cc8390-0f0e-4797-9a46-396ee449e0e3\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") "
Sep 15 07:59:48.010626 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:48.010579    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/61cc8390-0f0e-4797-9a46-396ee449e0e3-feast-data\") pod \"61cc8390-0f0e-4797-9a46-396ee449e0e3\" (UID: \"61cc8390-0f0e-4797-9a46-396ee449e0e3\") "
Sep 15 07:59:48.011167 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:48.011118    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61cc8390-0f0e-4797-9a46-396ee449e0e3-feast-data" (OuterVolumeSpecName: "feast-data") pod "61cc8390-0f0e-4797-9a46-396ee449e0e3" (UID: "61cc8390-0f0e-4797-9a46-396ee449e0e3"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 07:59:48.012610 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:48.012583    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61cc8390-0f0e-4797-9a46-396ee449e0e3-kube-api-access-9dhjd" (OuterVolumeSpecName: "kube-api-access-9dhjd") pod "61cc8390-0f0e-4797-9a46-396ee449e0e3" (UID: "61cc8390-0f0e-4797-9a46-396ee449e0e3"). InnerVolumeSpecName "kube-api-access-9dhjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 07:59:48.012732 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:48.012715    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "61cc8390-0f0e-4797-9a46-396ee449e0e3" (UID: "61cc8390-0f0e-4797-9a46-396ee449e0e3"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:59:48.012789 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:48.012736    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "61cc8390-0f0e-4797-9a46-396ee449e0e3" (UID: "61cc8390-0f0e-4797-9a46-396ee449e0e3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:59:48.012896 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:48.012868    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "61cc8390-0f0e-4797-9a46-396ee449e0e3" (UID: "61cc8390-0f0e-4797-9a46-396ee449e0e3"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:59:48.012956 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:48.012877    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-online-tls" (OuterVolumeSpecName: "online-tls") pod "61cc8390-0f0e-4797-9a46-396ee449e0e3" (UID: "61cc8390-0f0e-4797-9a46-396ee449e0e3"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 07:59:48.111577 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:48.111548    2586 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-ui-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 07:59:48.111577 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:48.111571    2586 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/61cc8390-0f0e-4797-9a46-396ee449e0e3-feast-data\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 07:59:48.111577 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:48.111582    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dhjd\" (UniqueName: \"kubernetes.io/projected/61cc8390-0f0e-4797-9a46-396ee449e0e3-kube-api-access-9dhjd\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 07:59:48.111808 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:48.111590    2586 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-offline-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 07:59:48.111808 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:48.111600    2586 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-registry-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 07:59:48.111808 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:48.111628    2586 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/61cc8390-0f0e-4797-9a46-396ee449e0e3-online-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 07:59:48.227976 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:48.227945    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"]
Sep 15 07:59:48.232476 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:48.232453    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-66bd755747-cwq9r"]
Sep 15 07:59:49.721143 ip-10-0-134-189 kubenswrapper[2586]: I0915 07:59:49.721104    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" path="/var/lib/kubelet/pods/61cc8390-0f0e-4797-9a46-396ee449e0e3/volumes"
Sep 15 08:00:42.125792 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.125758    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:00:42.226417 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.226377    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:00:42.561826 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.561725    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:00:42.654805 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.654776    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:00:42.658536 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.658503    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"]
Sep 15 08:00:42.658802 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.658790    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="offline"
Sep 15 08:00:42.658859 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.658804    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="offline"
Sep 15 08:00:42.658859 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.658816    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="feast-apply"
Sep 15 08:00:42.658859 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.658821    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="feast-apply"
Sep 15 08:00:42.658859 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.658829    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="feast-init"
Sep 15 08:00:42.658859 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.658835    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="feast-init"
Sep 15 08:00:42.658859 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.658854    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="registry"
Sep 15 08:00:42.658859 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.658860    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="registry"
Sep 15 08:00:42.659095 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.658866    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="online"
Sep 15 08:00:42.659095 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.658871    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="online"
Sep 15 08:00:42.659095 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.658877    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="ui"
Sep 15 08:00:42.659095 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.658882    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="ui"
Sep 15 08:00:42.659095 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.658948    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="online"
Sep 15 08:00:42.659095 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.658958    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="ui"
Sep 15 08:00:42.659095 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.658965    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="offline"
Sep 15 08:00:42.659095 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.658971    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="61cc8390-0f0e-4797-9a46-396ee449e0e3" containerName="registry"
Sep 15 08:00:42.662092 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.662072    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:42.664387 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.664361    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 15 08:00:42.664502 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.664407    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 15 08:00:42.664597 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.664580    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 15 08:00:42.664718 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.664700    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 15 08:00:42.664788 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.664720    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Sep 15 08:00:42.664847 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.664787    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 15 08:00:42.664847 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.664821    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 15 08:00:42.665031 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.665016    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-hshwl\""
Sep 15 08:00:42.676263 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.676241    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"]
Sep 15 08:00:42.810910 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.810870    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-online-tls\") pod \"feast-simple-feast-remote-setup-84b8f989b7-hjmz5\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:42.811081 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.810928    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/367ad695-24a7-43a6-bb7f-07992df535a8-registry-tls\") pod \"feast-simple-feast-remote-setup-84b8f989b7-hjmz5\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:42.811081 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.811052    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whxst\" (UniqueName: \"kubernetes.io/projected/367ad695-24a7-43a6-bb7f-07992df535a8-kube-api-access-whxst\") pod \"feast-simple-feast-remote-setup-84b8f989b7-hjmz5\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:42.811206 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.811100    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-ui-tls\") pod \"feast-simple-feast-remote-setup-84b8f989b7-hjmz5\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:42.811206 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.811156    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-offline-tls\") pod \"feast-simple-feast-remote-setup-84b8f989b7-hjmz5\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:42.811403 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.811378    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/367ad695-24a7-43a6-bb7f-07992df535a8-feast-data\") pod \"feast-simple-feast-remote-setup-84b8f989b7-hjmz5\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:42.911983 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.911948    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-online-tls\") pod \"feast-simple-feast-remote-setup-84b8f989b7-hjmz5\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:42.912159 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.912008    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/367ad695-24a7-43a6-bb7f-07992df535a8-registry-tls\") pod \"feast-simple-feast-remote-setup-84b8f989b7-hjmz5\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:42.912159 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.912035    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whxst\" (UniqueName: \"kubernetes.io/projected/367ad695-24a7-43a6-bb7f-07992df535a8-kube-api-access-whxst\") pod \"feast-simple-feast-remote-setup-84b8f989b7-hjmz5\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:42.912159 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.912060    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-ui-tls\") pod \"feast-simple-feast-remote-setup-84b8f989b7-hjmz5\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:42.912159 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:00:42.912088    2586 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
Sep 15 08:00:42.912159 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.912107    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-offline-tls\") pod \"feast-simple-feast-remote-setup-84b8f989b7-hjmz5\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:42.912405 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:00:42.912173    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-online-tls podName:367ad695-24a7-43a6-bb7f-07992df535a8 nodeName:}" failed. No retries permitted until 2026-09-15 08:00:43.412152291 +0000 UTC m=+596.203615009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-online-tls") pod "feast-simple-feast-remote-setup-84b8f989b7-hjmz5" (UID: "367ad695-24a7-43a6-bb7f-07992df535a8") : secret "feast-simple-feast-remote-setup-online-tls" not found
Sep 15 08:00:42.912405 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:00:42.912199    2586 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 15 08:00:42.912405 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.912212    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/367ad695-24a7-43a6-bb7f-07992df535a8-feast-data\") pod \"feast-simple-feast-remote-setup-84b8f989b7-hjmz5\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:42.912405 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:00:42.912220    2586 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
Sep 15 08:00:42.912405 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:00:42.912261    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-ui-tls podName:367ad695-24a7-43a6-bb7f-07992df535a8 nodeName:}" failed. No retries permitted until 2026-09-15 08:00:43.412243683 +0000 UTC m=+596.203706390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-ui-tls") pod "feast-simple-feast-remote-setup-84b8f989b7-hjmz5" (UID: "367ad695-24a7-43a6-bb7f-07992df535a8") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 15 08:00:42.912405 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:00:42.912290    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-offline-tls podName:367ad695-24a7-43a6-bb7f-07992df535a8 nodeName:}" failed. No retries permitted until 2026-09-15 08:00:43.412279704 +0000 UTC m=+596.203742418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-offline-tls") pod "feast-simple-feast-remote-setup-84b8f989b7-hjmz5" (UID: "367ad695-24a7-43a6-bb7f-07992df535a8") : secret "feast-simple-feast-remote-setup-offline-tls" not found
Sep 15 08:00:42.912655 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.912487    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/367ad695-24a7-43a6-bb7f-07992df535a8-feast-data\") pod \"feast-simple-feast-remote-setup-84b8f989b7-hjmz5\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:42.912752 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.912734    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/367ad695-24a7-43a6-bb7f-07992df535a8-registry-tls\") pod \"feast-simple-feast-remote-setup-84b8f989b7-hjmz5\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:42.920056 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.920036    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whxst\" (UniqueName: \"kubernetes.io/projected/367ad695-24a7-43a6-bb7f-07992df535a8-kube-api-access-whxst\") pod \"feast-simple-feast-remote-setup-84b8f989b7-hjmz5\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:42.983100 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:42.983066    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:00:43.082997 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:43.082963    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:00:43.417293 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:43.417254    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-online-tls\") pod \"feast-simple-feast-remote-setup-84b8f989b7-hjmz5\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:43.417781 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:43.417301    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-ui-tls\") pod \"feast-simple-feast-remote-setup-84b8f989b7-hjmz5\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:43.417781 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:43.417342    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-offline-tls\") pod \"feast-simple-feast-remote-setup-84b8f989b7-hjmz5\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:43.419834 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:43.419808    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-offline-tls\") pod \"feast-simple-feast-remote-setup-84b8f989b7-hjmz5\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:43.419946 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:43.419839    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-ui-tls\") pod \"feast-simple-feast-remote-setup-84b8f989b7-hjmz5\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:43.419946 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:43.419865    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-online-tls\") pod \"feast-simple-feast-remote-setup-84b8f989b7-hjmz5\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:43.571013 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:43.570962    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:00:43.849468 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:43.849445    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"]
Sep 15 08:00:43.851571 ip-10-0-134-189 kubenswrapper[2586]: W0915 08:00:43.851548    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod367ad695_24a7_43a6_bb7f_07992df535a8.slice/crio-f3ff2deeb2f472fac06ae4873f6b1d42cf9889dbee2c7c21ba24bb0a39c37e6b WatchSource:0}: Error finding container f3ff2deeb2f472fac06ae4873f6b1d42cf9889dbee2c7c21ba24bb0a39c37e6b: Status 404 returned error can't find the container with id f3ff2deeb2f472fac06ae4873f6b1d42cf9889dbee2c7c21ba24bb0a39c37e6b
Sep 15 08:00:44.118588 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:44.118495    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" event={"ID":"367ad695-24a7-43a6-bb7f-07992df535a8","Type":"ContainerStarted","Data":"2c6333c7500dac1b6f3fd30dcb7c1a7b40a0a7ea8cea9cb17d5b9bc87d6acc1e"}
Sep 15 08:00:44.118588 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:44.118553    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" event={"ID":"367ad695-24a7-43a6-bb7f-07992df535a8","Type":"ContainerStarted","Data":"f3ff2deeb2f472fac06ae4873f6b1d42cf9889dbee2c7c21ba24bb0a39c37e6b"}
Sep 15 08:00:47.656743 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:47.656711    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cp9wl_a5527013-2ce3-48e3-b472-a593cbfbb55f/console-operator/1.log"
Sep 15 08:00:47.657592 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:47.657564    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cp9wl_a5527013-2ce3-48e3-b472-a593cbfbb55f/console-operator/1.log"
Sep 15 08:00:49.141668 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:49.141618    2586 generic.go:356] "Generic (PLEG): container finished" podID="367ad695-24a7-43a6-bb7f-07992df535a8" containerID="2c6333c7500dac1b6f3fd30dcb7c1a7b40a0a7ea8cea9cb17d5b9bc87d6acc1e" exitCode=0
Sep 15 08:00:49.142034 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:49.141691    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" event={"ID":"367ad695-24a7-43a6-bb7f-07992df535a8","Type":"ContainerDied","Data":"2c6333c7500dac1b6f3fd30dcb7c1a7b40a0a7ea8cea9cb17d5b9bc87d6acc1e"}
Sep 15 08:00:50.152393 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:00:50.152359    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" event={"ID":"367ad695-24a7-43a6-bb7f-07992df535a8","Type":"ContainerStarted","Data":"b59b863bda6594d832f3590964631f2ab14c6e7b0d6461a0fddae2e156b4c81d"}
Sep 15 08:01:11.236407 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:11.236369    2586 generic.go:356] "Generic (PLEG): container finished" podID="367ad695-24a7-43a6-bb7f-07992df535a8" containerID="b59b863bda6594d832f3590964631f2ab14c6e7b0d6461a0fddae2e156b4c81d" exitCode=0
Sep 15 08:01:11.236812 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:11.236443    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" event={"ID":"367ad695-24a7-43a6-bb7f-07992df535a8","Type":"ContainerDied","Data":"b59b863bda6594d832f3590964631f2ab14c6e7b0d6461a0fddae2e156b4c81d"}
Sep 15 08:01:11.240494 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:11.240477    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Sep 15 08:01:12.245615 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:12.245569    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" event={"ID":"367ad695-24a7-43a6-bb7f-07992df535a8","Type":"ContainerStarted","Data":"b5681581192b6ace2947b9ee5c91126f6514a6fc3c76b6b53fcacd98f140e5df"}
Sep 15 08:01:12.246110 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:12.245650    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" event={"ID":"367ad695-24a7-43a6-bb7f-07992df535a8","Type":"ContainerStarted","Data":"c0bc4125b72d90c6911fc4698c23f4ede537a1d1b298db54cd6e96e43baa7ada"}
Sep 15 08:01:12.246110 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:12.245678    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" event={"ID":"367ad695-24a7-43a6-bb7f-07992df535a8","Type":"ContainerStarted","Data":"bc988fb983be63fb5a7dd5c8fc19bf4bfed5b19bd6270ee895ff74043fe06c89"}
Sep 15 08:01:12.294022 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:12.293947    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" podStartSLOduration=30.29392352 podStartE2EDuration="30.29392352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 08:00:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 08:01:12.291200263 +0000 UTC m=+625.082662987" watchObservedRunningTime="2026-09-15 08:01:12.29392352 +0000 UTC m=+625.085386243"
Sep 15 08:01:13.571086 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:13.571044    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:01:13.571547 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:13.571112    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:01:13.571547 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:13.571134    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:01:13.571547 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:13.571149    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:01:13.571547 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:13.571163    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:01:13.572111 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:13.572085    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:01:13.573152 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:13.573120    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.24:8816: connect: connection refused"
Sep 15 08:01:13.573152 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:13.573137    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused"
Sep 15 08:01:13.573346 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:13.573148    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused"
Sep 15 08:01:16.571847 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:16.571800    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.24:8816: connect: connection refused"
Sep 15 08:01:16.571847 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:16.571800    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused"
Sep 15 08:01:16.572392 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:16.571871    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused"
Sep 15 08:01:19.572525 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:19.572492    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:01:19.573073 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:19.572972    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:01:19.573372 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:19.573348    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:01:19.592497 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:19.592476    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:01:20.283819 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:20.283785    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:01:20.300860 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:20.300834    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:01:20.550801 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:01:20.550714    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:02:15.756052 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:15.756020    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:02:15.841467 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:15.841435    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:02:23.077786 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:23.077726    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:02:23.086778 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:23.086749    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"]
Sep 15 08:02:23.087022 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:23.086997    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="online" containerID="cri-o://bc988fb983be63fb5a7dd5c8fc19bf4bfed5b19bd6270ee895ff74043fe06c89" gracePeriod=30
Sep 15 08:02:23.087149 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:23.087094    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="ui" containerID="cri-o://b5681581192b6ace2947b9ee5c91126f6514a6fc3c76b6b53fcacd98f140e5df" gracePeriod=30
Sep 15 08:02:23.087240 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:23.087165    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="offline" containerID="cri-o://c0bc4125b72d90c6911fc4698c23f4ede537a1d1b298db54cd6e96e43baa7ada" gracePeriod=30
Sep 15 08:02:23.180199 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:23.180161    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:02:23.196805 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:23.196775    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"]
Sep 15 08:02:23.197055 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:23.197025    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="registry" containerID="cri-o://91d3533b753ae07354b627db7ffb54e8e4b2c5731f65d7230b55e5da01b81d76" gracePeriod=30
Sep 15 08:02:23.197161 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:23.197121    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="offline" containerID="cri-o://6fd6e7e6523a0b8cdbf2c30a4c3252038de0d6cb0c014540a0104764b7808c2a" gracePeriod=30
Sep 15 08:02:23.197218 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:23.197151    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="online" containerID="cri-o://ab014e6b2c67bcd0f91f012c9eb71006bc1a3446e9c2465b24bb8b22328721f7" gracePeriod=30
Sep 15 08:02:23.197218 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:23.197138    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="ui" containerID="cri-o://45353857c6e6870ca7447f3fa777199bd38ec756749703c35bbc4c729e27980e" gracePeriod=30
Sep 15 08:02:23.243611 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:23.243575    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:02:23.305676 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:23.305619    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:02:24.534944 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:24.534905    2586 generic.go:356] "Generic (PLEG): container finished" podID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerID="45353857c6e6870ca7447f3fa777199bd38ec756749703c35bbc4c729e27980e" exitCode=0
Sep 15 08:02:24.534944 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:24.534933    2586 generic.go:356] "Generic (PLEG): container finished" podID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerID="ab014e6b2c67bcd0f91f012c9eb71006bc1a3446e9c2465b24bb8b22328721f7" exitCode=0
Sep 15 08:02:24.535359 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:24.534978    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" event={"ID":"60df0879-96ad-4a5c-ae78-586a5d3be9a3","Type":"ContainerDied","Data":"45353857c6e6870ca7447f3fa777199bd38ec756749703c35bbc4c729e27980e"}
Sep 15 08:02:24.535359 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:24.535021    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" event={"ID":"60df0879-96ad-4a5c-ae78-586a5d3be9a3","Type":"ContainerDied","Data":"ab014e6b2c67bcd0f91f012c9eb71006bc1a3446e9c2465b24bb8b22328721f7"}
Sep 15 08:02:24.537538 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:24.537517    2586 generic.go:356] "Generic (PLEG): container finished" podID="367ad695-24a7-43a6-bb7f-07992df535a8" containerID="b5681581192b6ace2947b9ee5c91126f6514a6fc3c76b6b53fcacd98f140e5df" exitCode=0
Sep 15 08:02:24.537538 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:24.537535    2586 generic.go:356] "Generic (PLEG): container finished" podID="367ad695-24a7-43a6-bb7f-07992df535a8" containerID="bc988fb983be63fb5a7dd5c8fc19bf4bfed5b19bd6270ee895ff74043fe06c89" exitCode=0
Sep 15 08:02:24.537696 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:24.537586    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" event={"ID":"367ad695-24a7-43a6-bb7f-07992df535a8","Type":"ContainerDied","Data":"b5681581192b6ace2947b9ee5c91126f6514a6fc3c76b6b53fcacd98f140e5df"}
Sep 15 08:02:24.537696 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:24.537616    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" event={"ID":"367ad695-24a7-43a6-bb7f-07992df535a8","Type":"ContainerDied","Data":"bc988fb983be63fb5a7dd5c8fc19bf4bfed5b19bd6270ee895ff74043fe06c89"}
Sep 15 08:02:28.385014 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:28.384978    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:02:29.439277 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:29.439226    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
Sep 15 08:02:29.573563 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:29.573523    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused"
Sep 15 08:02:29.870417 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:29.870378    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
Sep 15 08:02:30.283510 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:30.283409    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused"
Sep 15 08:02:39.439838 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:39.439779    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
Sep 15 08:02:39.573401 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:39.573358    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused"
Sep 15 08:02:39.870980 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:39.870937    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
Sep 15 08:02:40.283578 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:40.283464    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused"
Sep 15 08:02:49.439891 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:49.439844    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
Sep 15 08:02:49.440428 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:49.439995    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 08:02:49.573810 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:49.573771    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused"
Sep 15 08:02:49.573979 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:49.573883    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:02:49.870823 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:49.870786    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
Sep 15 08:02:49.870980 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:49.870908    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 08:02:50.284211 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:50.284106    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused"
Sep 15 08:02:50.284374 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:50.284247    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:02:53.649496 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.649464    2586 generic.go:356] "Generic (PLEG): container finished" podID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerID="6fd6e7e6523a0b8cdbf2c30a4c3252038de0d6cb0c014540a0104764b7808c2a" exitCode=137
Sep 15 08:02:53.649496 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.649489    2586 generic.go:356] "Generic (PLEG): container finished" podID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerID="91d3533b753ae07354b627db7ffb54e8e4b2c5731f65d7230b55e5da01b81d76" exitCode=137
Sep 15 08:02:53.649967 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.649536    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" event={"ID":"60df0879-96ad-4a5c-ae78-586a5d3be9a3","Type":"ContainerDied","Data":"6fd6e7e6523a0b8cdbf2c30a4c3252038de0d6cb0c014540a0104764b7808c2a"}
Sep 15 08:02:53.649967 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.649582    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" event={"ID":"60df0879-96ad-4a5c-ae78-586a5d3be9a3","Type":"ContainerDied","Data":"91d3533b753ae07354b627db7ffb54e8e4b2c5731f65d7230b55e5da01b81d76"}
Sep 15 08:02:53.652474 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.652453    2586 generic.go:356] "Generic (PLEG): container finished" podID="367ad695-24a7-43a6-bb7f-07992df535a8" containerID="c0bc4125b72d90c6911fc4698c23f4ede537a1d1b298db54cd6e96e43baa7ada" exitCode=137
Sep 15 08:02:53.652589 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.652527    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" event={"ID":"367ad695-24a7-43a6-bb7f-07992df535a8","Type":"ContainerDied","Data":"c0bc4125b72d90c6911fc4698c23f4ede537a1d1b298db54cd6e96e43baa7ada"}
Sep 15 08:02:53.733225 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.733194    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:02:53.764820 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.764794    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-offline-tls\") pod \"367ad695-24a7-43a6-bb7f-07992df535a8\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") "
Sep 15 08:02:53.764950 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.764829    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/367ad695-24a7-43a6-bb7f-07992df535a8-feast-data\") pod \"367ad695-24a7-43a6-bb7f-07992df535a8\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") "
Sep 15 08:02:53.764950 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.764855    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-online-tls\") pod \"367ad695-24a7-43a6-bb7f-07992df535a8\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") "
Sep 15 08:02:53.764950 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.764900    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whxst\" (UniqueName: \"kubernetes.io/projected/367ad695-24a7-43a6-bb7f-07992df535a8-kube-api-access-whxst\") pod \"367ad695-24a7-43a6-bb7f-07992df535a8\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") "
Sep 15 08:02:53.764950 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.764948    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/367ad695-24a7-43a6-bb7f-07992df535a8-registry-tls\") pod \"367ad695-24a7-43a6-bb7f-07992df535a8\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") "
Sep 15 08:02:53.765177 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.764993    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-ui-tls\") pod \"367ad695-24a7-43a6-bb7f-07992df535a8\" (UID: \"367ad695-24a7-43a6-bb7f-07992df535a8\") "
Sep 15 08:02:53.765536 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.765378    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/367ad695-24a7-43a6-bb7f-07992df535a8-feast-data" (OuterVolumeSpecName: "feast-data") pod "367ad695-24a7-43a6-bb7f-07992df535a8" (UID: "367ad695-24a7-43a6-bb7f-07992df535a8"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 08:02:53.765973 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.765941    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/367ad695-24a7-43a6-bb7f-07992df535a8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "367ad695-24a7-43a6-bb7f-07992df535a8" (UID: "367ad695-24a7-43a6-bb7f-07992df535a8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 08:02:53.767772 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.767626    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/367ad695-24a7-43a6-bb7f-07992df535a8-kube-api-access-whxst" (OuterVolumeSpecName: "kube-api-access-whxst") pod "367ad695-24a7-43a6-bb7f-07992df535a8" (UID: "367ad695-24a7-43a6-bb7f-07992df535a8"). InnerVolumeSpecName "kube-api-access-whxst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 08:02:53.768021 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.767995    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "367ad695-24a7-43a6-bb7f-07992df535a8" (UID: "367ad695-24a7-43a6-bb7f-07992df535a8"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:02:53.768137 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.768120    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "367ad695-24a7-43a6-bb7f-07992df535a8" (UID: "367ad695-24a7-43a6-bb7f-07992df535a8"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:02:53.768284 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.768259    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-online-tls" (OuterVolumeSpecName: "online-tls") pod "367ad695-24a7-43a6-bb7f-07992df535a8" (UID: "367ad695-24a7-43a6-bb7f-07992df535a8"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:02:53.844137 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.844111    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 08:02:53.865526 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.865444    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp525\" (UniqueName: \"kubernetes.io/projected/60df0879-96ad-4a5c-ae78-586a5d3be9a3-kube-api-access-jp525\") pod \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") "
Sep 15 08:02:53.865526 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.865487    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/60df0879-96ad-4a5c-ae78-586a5d3be9a3-feast-data\") pod \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") "
Sep 15 08:02:53.865762 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.865588    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-offline-tls\") pod \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") "
Sep 15 08:02:53.865762 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.865618    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-registry-tls\") pod \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") "
Sep 15 08:02:53.865762 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.865665    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-online-tls\") pod \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") "
Sep 15 08:02:53.865762 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.865723    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-ui-tls\") pod \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\" (UID: \"60df0879-96ad-4a5c-ae78-586a5d3be9a3\") "
Sep 15 08:02:53.866039 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.865982    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whxst\" (UniqueName: \"kubernetes.io/projected/367ad695-24a7-43a6-bb7f-07992df535a8-kube-api-access-whxst\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:02:53.866039 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.866004    2586 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/367ad695-24a7-43a6-bb7f-07992df535a8-registry-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:02:53.866039 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.866017    2586 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-ui-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:02:53.866039 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.866029    2586 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-offline-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:02:53.866314 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.866112    2586 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/367ad695-24a7-43a6-bb7f-07992df535a8-feast-data\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:02:53.866314 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.866129    2586 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/367ad695-24a7-43a6-bb7f-07992df535a8-online-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:02:53.866930 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.866899    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60df0879-96ad-4a5c-ae78-586a5d3be9a3-feast-data" (OuterVolumeSpecName: "feast-data") pod "60df0879-96ad-4a5c-ae78-586a5d3be9a3" (UID: "60df0879-96ad-4a5c-ae78-586a5d3be9a3"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 08:02:53.868365 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.868338    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "60df0879-96ad-4a5c-ae78-586a5d3be9a3" (UID: "60df0879-96ad-4a5c-ae78-586a5d3be9a3"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:02:53.868461 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.868369    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60df0879-96ad-4a5c-ae78-586a5d3be9a3-kube-api-access-jp525" (OuterVolumeSpecName: "kube-api-access-jp525") pod "60df0879-96ad-4a5c-ae78-586a5d3be9a3" (UID: "60df0879-96ad-4a5c-ae78-586a5d3be9a3"). InnerVolumeSpecName "kube-api-access-jp525". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 08:02:53.868541 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.868522    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "60df0879-96ad-4a5c-ae78-586a5d3be9a3" (UID: "60df0879-96ad-4a5c-ae78-586a5d3be9a3"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:02:53.868832 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.868814    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-online-tls" (OuterVolumeSpecName: "online-tls") pod "60df0879-96ad-4a5c-ae78-586a5d3be9a3" (UID: "60df0879-96ad-4a5c-ae78-586a5d3be9a3"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:02:53.869108 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.869084    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "60df0879-96ad-4a5c-ae78-586a5d3be9a3" (UID: "60df0879-96ad-4a5c-ae78-586a5d3be9a3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:02:53.967208 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.967176    2586 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-offline-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:02:53.967208 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.967203    2586 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-registry-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:02:53.967208 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.967212    2586 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-online-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:02:53.967208 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.967220    2586 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/60df0879-96ad-4a5c-ae78-586a5d3be9a3-ui-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:02:53.967458 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.967229    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp525\" (UniqueName: \"kubernetes.io/projected/60df0879-96ad-4a5c-ae78-586a5d3be9a3-kube-api-access-jp525\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:02:53.967458 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:53.967237    2586 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/60df0879-96ad-4a5c-ae78-586a5d3be9a3-feast-data\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:02:54.658859 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:54.658828    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"
Sep 15 08:02:54.659304 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:54.658822    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf" event={"ID":"60df0879-96ad-4a5c-ae78-586a5d3be9a3","Type":"ContainerDied","Data":"d1b7dbaaea6a820f2304c52f508a6be87da19bc79fbeba87f7c1a96b92fd7606"}
Sep 15 08:02:54.659304 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:54.658960    2586 scope.go:117] "RemoveContainer" containerID="45353857c6e6870ca7447f3fa777199bd38ec756749703c35bbc4c729e27980e"
Sep 15 08:02:54.661721 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:54.661700    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"
Sep 15 08:02:54.661858 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:54.661703    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5" event={"ID":"367ad695-24a7-43a6-bb7f-07992df535a8","Type":"ContainerDied","Data":"f3ff2deeb2f472fac06ae4873f6b1d42cf9889dbee2c7c21ba24bb0a39c37e6b"}
Sep 15 08:02:54.668545 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:54.668451    2586 scope.go:117] "RemoveContainer" containerID="6fd6e7e6523a0b8cdbf2c30a4c3252038de0d6cb0c014540a0104764b7808c2a"
Sep 15 08:02:54.676052 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:54.676037    2586 scope.go:117] "RemoveContainer" containerID="ab014e6b2c67bcd0f91f012c9eb71006bc1a3446e9c2465b24bb8b22328721f7"
Sep 15 08:02:54.683802 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:54.683780    2586 scope.go:117] "RemoveContainer" containerID="91d3533b753ae07354b627db7ffb54e8e4b2c5731f65d7230b55e5da01b81d76"
Sep 15 08:02:54.684396 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:54.684374    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"]
Sep 15 08:02:54.689365 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:54.689346    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-66bd755747-vfbbf"]
Sep 15 08:02:54.691948 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:54.691933    2586 scope.go:117] "RemoveContainer" containerID="7009df4e6eeb841f7537aa52df27ec98a8e591be474ac8fc6c7f16d378051a7f"
Sep 15 08:02:54.698689 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:54.698671    2586 scope.go:117] "RemoveContainer" containerID="9105544a514b03e04643669fceaeb69b630847c71cc2022cfbf43f29bc71fad1"
Sep 15 08:02:54.701323 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:54.701303    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"]
Sep 15 08:02:54.706329 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:54.706310    2586 scope.go:117] "RemoveContainer" containerID="b5681581192b6ace2947b9ee5c91126f6514a6fc3c76b6b53fcacd98f140e5df"
Sep 15 08:02:54.706974 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:54.706948    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-84b8f989b7-hjmz5"]
Sep 15 08:02:54.712958 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:54.712941    2586 scope.go:117] "RemoveContainer" containerID="c0bc4125b72d90c6911fc4698c23f4ede537a1d1b298db54cd6e96e43baa7ada"
Sep 15 08:02:54.719866 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:54.719848    2586 scope.go:117] "RemoveContainer" containerID="bc988fb983be63fb5a7dd5c8fc19bf4bfed5b19bd6270ee895ff74043fe06c89"
Sep 15 08:02:54.726529 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:54.726513    2586 scope.go:117] "RemoveContainer" containerID="b59b863bda6594d832f3590964631f2ab14c6e7b0d6461a0fddae2e156b4c81d"
Sep 15 08:02:54.732947 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:54.732932    2586 scope.go:117] "RemoveContainer" containerID="2c6333c7500dac1b6f3fd30dcb7c1a7b40a0a7ea8cea9cb17d5b9bc87d6acc1e"
Sep 15 08:02:55.723963 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:55.721186    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" path="/var/lib/kubelet/pods/367ad695-24a7-43a6-bb7f-07992df535a8/volumes"
Sep 15 08:02:55.723963 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:02:55.721969    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" path="/var/lib/kubelet/pods/60df0879-96ad-4a5c-ae78-586a5d3be9a3/volumes"
Sep 15 08:03:06.033069 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.033031    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:03:06.267415 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267381    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-wtq4p"]
Sep 15 08:03:06.267759 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267740    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="feast-init"
Sep 15 08:03:06.267858 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267760    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="feast-init"
Sep 15 08:03:06.267858 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267773    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="feast-apply"
Sep 15 08:03:06.267858 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267781    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="feast-apply"
Sep 15 08:03:06.267858 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267791    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="offline"
Sep 15 08:03:06.267858 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267800    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="offline"
Sep 15 08:03:06.267858 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267813    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="online"
Sep 15 08:03:06.267858 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267821    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="online"
Sep 15 08:03:06.267858 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267835    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="feast-init"
Sep 15 08:03:06.267858 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267843    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="feast-init"
Sep 15 08:03:06.267858 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267851    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="ui"
Sep 15 08:03:06.267858 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267859    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="ui"
Sep 15 08:03:06.268361 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267874    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="feast-apply"
Sep 15 08:03:06.268361 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267883    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="feast-apply"
Sep 15 08:03:06.268361 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267891    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="registry"
Sep 15 08:03:06.268361 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267899    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="registry"
Sep 15 08:03:06.268361 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267912    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="online"
Sep 15 08:03:06.268361 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267920    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="online"
Sep 15 08:03:06.268361 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267930    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="ui"
Sep 15 08:03:06.268361 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267938    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="ui"
Sep 15 08:03:06.268361 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267954    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="offline"
Sep 15 08:03:06.268361 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.267962    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="offline"
Sep 15 08:03:06.268361 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.268040    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="offline"
Sep 15 08:03:06.268361 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.268050    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="online"
Sep 15 08:03:06.268361 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.268061    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="registry"
Sep 15 08:03:06.268361 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.268070    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="online"
Sep 15 08:03:06.268361 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.268080    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="ui"
Sep 15 08:03:06.268361 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.268089    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="367ad695-24a7-43a6-bb7f-07992df535a8" containerName="ui"
Sep 15 08:03:06.268361 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.268099    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="60df0879-96ad-4a5c-ae78-586a5d3be9a3" containerName="offline"
Sep 15 08:03:06.273029 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.273000    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-wtq4p"
Sep 15 08:03:06.275430 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.275406    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Sep 15 08:03:06.275542 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.275406    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 15 08:03:06.276661 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.276443    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 15 08:03:06.276661 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.276449    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-sgmm5\""
Sep 15 08:03:06.278364 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.278340    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-wtq4p"]
Sep 15 08:03:06.300292 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.300232    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:03:06.354262 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.354233    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/79d635fe-8f96-41b6-8689-c571d8f76d26-postgresdata\") pod \"postgres-864846d4f5-wtq4p\" (UID: \"79d635fe-8f96-41b6-8689-c571d8f76d26\") " pod="test-ns-feast/postgres-864846d4f5-wtq4p"
Sep 15 08:03:06.354392 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.354265    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2hzh\" (UniqueName: \"kubernetes.io/projected/79d635fe-8f96-41b6-8689-c571d8f76d26-kube-api-access-d2hzh\") pod \"postgres-864846d4f5-wtq4p\" (UID: \"79d635fe-8f96-41b6-8689-c571d8f76d26\") " pod="test-ns-feast/postgres-864846d4f5-wtq4p"
Sep 15 08:03:06.397564 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.397531    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:03:06.455724 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.455699    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/79d635fe-8f96-41b6-8689-c571d8f76d26-postgresdata\") pod \"postgres-864846d4f5-wtq4p\" (UID: \"79d635fe-8f96-41b6-8689-c571d8f76d26\") " pod="test-ns-feast/postgres-864846d4f5-wtq4p"
Sep 15 08:03:06.455824 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.455731    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2hzh\" (UniqueName: \"kubernetes.io/projected/79d635fe-8f96-41b6-8689-c571d8f76d26-kube-api-access-d2hzh\") pod \"postgres-864846d4f5-wtq4p\" (UID: \"79d635fe-8f96-41b6-8689-c571d8f76d26\") " pod="test-ns-feast/postgres-864846d4f5-wtq4p"
Sep 15 08:03:06.456047 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.456031    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/79d635fe-8f96-41b6-8689-c571d8f76d26-postgresdata\") pod \"postgres-864846d4f5-wtq4p\" (UID: \"79d635fe-8f96-41b6-8689-c571d8f76d26\") " pod="test-ns-feast/postgres-864846d4f5-wtq4p"
Sep 15 08:03:06.463906 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.463886    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2hzh\" (UniqueName: \"kubernetes.io/projected/79d635fe-8f96-41b6-8689-c571d8f76d26-kube-api-access-d2hzh\") pod \"postgres-864846d4f5-wtq4p\" (UID: \"79d635fe-8f96-41b6-8689-c571d8f76d26\") " pod="test-ns-feast/postgres-864846d4f5-wtq4p"
Sep 15 08:03:06.594224 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.594199    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-wtq4p"
Sep 15 08:03:06.859866 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.859788    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-wtq4p"]
Sep 15 08:03:06.862696 ip-10-0-134-189 kubenswrapper[2586]: W0915 08:03:06.862668    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79d635fe_8f96_41b6_8689_c571d8f76d26.slice/crio-99fadfa45b5cbe9058c1ff02c5d529d9420c2702b215a591c2af3dc335f1bb93 WatchSource:0}: Error finding container 99fadfa45b5cbe9058c1ff02c5d529d9420c2702b215a591c2af3dc335f1bb93: Status 404 returned error can't find the container with id 99fadfa45b5cbe9058c1ff02c5d529d9420c2702b215a591c2af3dc335f1bb93
Sep 15 08:03:06.864558 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:06.864541    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 08:03:07.711532 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:07.711482    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-wtq4p" event={"ID":"79d635fe-8f96-41b6-8689-c571d8f76d26","Type":"ContainerStarted","Data":"99fadfa45b5cbe9058c1ff02c5d529d9420c2702b215a591c2af3dc335f1bb93"}
Sep 15 08:03:11.730258 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:11.730174    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-wtq4p" event={"ID":"79d635fe-8f96-41b6-8689-c571d8f76d26","Type":"ContainerStarted","Data":"da617e96f6f2ec248237f20a1c1bdfb5a07043a95e058404d72b71e31c90ea19"}
Sep 15 08:03:11.745363 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:11.745305    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-wtq4p" podStartSLOduration=1.267185183 podStartE2EDuration="5.745284698s" totalImagesPullingTime="4.478099515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 08:03:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 08:03:11.743245488 +0000 UTC m=+744.534708212" watchObservedRunningTime="2026-09-15 08:03:11.745284698 +0000 UTC m=+744.536747422"
Sep 15 08:03:14.973423 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:14.973372    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:03:15.060682 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.060646    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:03:15.065289 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.065262    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-667557fff8-x98pm"]
Sep 15 08:03:15.070942 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.070924    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:15.073441 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.073420    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Sep 15 08:03:15.073545 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.073422    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Sep 15 08:03:15.073545 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.073421    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-2cvw8\""
Sep 15 08:03:15.073545 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.073482    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Sep 15 08:03:15.073795 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.073781    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Sep 15 08:03:15.080504 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.080483    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-667557fff8-x98pm"]
Sep 15 08:03:15.124024 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.123987    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6704c61c-facb-4c2e-8605-f96377e03b0d-offline-tls\") pod \"feast-credit-scoring-667557fff8-x98pm\" (UID: \"6704c61c-facb-4c2e-8605-f96377e03b0d\") " pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:15.124024 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.124029    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6704c61c-facb-4c2e-8605-f96377e03b0d-feast-data\") pod \"feast-credit-scoring-667557fff8-x98pm\" (UID: \"6704c61c-facb-4c2e-8605-f96377e03b0d\") " pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:15.124218 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.124071    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ffbq\" (UniqueName: \"kubernetes.io/projected/6704c61c-facb-4c2e-8605-f96377e03b0d-kube-api-access-6ffbq\") pod \"feast-credit-scoring-667557fff8-x98pm\" (UID: \"6704c61c-facb-4c2e-8605-f96377e03b0d\") " pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:15.124218 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.124094    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6704c61c-facb-4c2e-8605-f96377e03b0d-registry-tls\") pod \"feast-credit-scoring-667557fff8-x98pm\" (UID: \"6704c61c-facb-4c2e-8605-f96377e03b0d\") " pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:15.124218 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.124120    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6704c61c-facb-4c2e-8605-f96377e03b0d-online-tls\") pod \"feast-credit-scoring-667557fff8-x98pm\" (UID: \"6704c61c-facb-4c2e-8605-f96377e03b0d\") " pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:15.131420 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.131386    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:03:15.225019 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.224936    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6704c61c-facb-4c2e-8605-f96377e03b0d-feast-data\") pod \"feast-credit-scoring-667557fff8-x98pm\" (UID: \"6704c61c-facb-4c2e-8605-f96377e03b0d\") " pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:15.225019 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.224991    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ffbq\" (UniqueName: \"kubernetes.io/projected/6704c61c-facb-4c2e-8605-f96377e03b0d-kube-api-access-6ffbq\") pod \"feast-credit-scoring-667557fff8-x98pm\" (UID: \"6704c61c-facb-4c2e-8605-f96377e03b0d\") " pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:15.225228 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.225038    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6704c61c-facb-4c2e-8605-f96377e03b0d-registry-tls\") pod \"feast-credit-scoring-667557fff8-x98pm\" (UID: \"6704c61c-facb-4c2e-8605-f96377e03b0d\") " pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:15.225228 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.225076    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6704c61c-facb-4c2e-8605-f96377e03b0d-online-tls\") pod \"feast-credit-scoring-667557fff8-x98pm\" (UID: \"6704c61c-facb-4c2e-8605-f96377e03b0d\") " pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:15.225228 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.225129    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6704c61c-facb-4c2e-8605-f96377e03b0d-offline-tls\") pod \"feast-credit-scoring-667557fff8-x98pm\" (UID: \"6704c61c-facb-4c2e-8605-f96377e03b0d\") " pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:15.225359 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:03:15.225224    2586 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
Sep 15 08:03:15.225359 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:03:15.225305    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6704c61c-facb-4c2e-8605-f96377e03b0d-online-tls podName:6704c61c-facb-4c2e-8605-f96377e03b0d nodeName:}" failed. No retries permitted until 2026-09-15 08:03:15.725284184 +0000 UTC m=+748.516746908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/6704c61c-facb-4c2e-8605-f96377e03b0d-online-tls") pod "feast-credit-scoring-667557fff8-x98pm" (UID: "6704c61c-facb-4c2e-8605-f96377e03b0d") : secret "feast-credit-scoring-online-tls" not found
Sep 15 08:03:15.225478 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.225390    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6704c61c-facb-4c2e-8605-f96377e03b0d-feast-data\") pod \"feast-credit-scoring-667557fff8-x98pm\" (UID: \"6704c61c-facb-4c2e-8605-f96377e03b0d\") " pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:15.227698 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.227671    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6704c61c-facb-4c2e-8605-f96377e03b0d-registry-tls\") pod \"feast-credit-scoring-667557fff8-x98pm\" (UID: \"6704c61c-facb-4c2e-8605-f96377e03b0d\") " pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:15.227771 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.227671    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6704c61c-facb-4c2e-8605-f96377e03b0d-offline-tls\") pod \"feast-credit-scoring-667557fff8-x98pm\" (UID: \"6704c61c-facb-4c2e-8605-f96377e03b0d\") " pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:15.234700 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.234668    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:03:15.236077 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.236056    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ffbq\" (UniqueName: \"kubernetes.io/projected/6704c61c-facb-4c2e-8605-f96377e03b0d-kube-api-access-6ffbq\") pod \"feast-credit-scoring-667557fff8-x98pm\" (UID: \"6704c61c-facb-4c2e-8605-f96377e03b0d\") " pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:15.651572 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.651537    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:03:15.730146 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.730117    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6704c61c-facb-4c2e-8605-f96377e03b0d-online-tls\") pod \"feast-credit-scoring-667557fff8-x98pm\" (UID: \"6704c61c-facb-4c2e-8605-f96377e03b0d\") " pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:15.732463 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.732436    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6704c61c-facb-4c2e-8605-f96377e03b0d-online-tls\") pod \"feast-credit-scoring-667557fff8-x98pm\" (UID: \"6704c61c-facb-4c2e-8605-f96377e03b0d\") " pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:15.980470 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:15.980382    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:16.256047 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:16.256015    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-667557fff8-x98pm"]
Sep 15 08:03:16.257865 ip-10-0-134-189 kubenswrapper[2586]: W0915 08:03:16.257836    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6704c61c_facb_4c2e_8605_f96377e03b0d.slice/crio-a912bbb8bcb3ce62e5fc19312f666b6638c7fa57a36a70c8811aa32317931a98 WatchSource:0}: Error finding container a912bbb8bcb3ce62e5fc19312f666b6638c7fa57a36a70c8811aa32317931a98: Status 404 returned error can't find the container with id a912bbb8bcb3ce62e5fc19312f666b6638c7fa57a36a70c8811aa32317931a98
Sep 15 08:03:16.749774 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:16.749729    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" event={"ID":"6704c61c-facb-4c2e-8605-f96377e03b0d","Type":"ContainerStarted","Data":"3f232c72d537a7293f6ca40fbaa6d91ad45c0d07e55d2e2b80b81507f1d80c8e"}
Sep 15 08:03:16.749971 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:16.749795    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" event={"ID":"6704c61c-facb-4c2e-8605-f96377e03b0d","Type":"ContainerStarted","Data":"a912bbb8bcb3ce62e5fc19312f666b6638c7fa57a36a70c8811aa32317931a98"}
Sep 15 08:03:17.754391 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:17.754309    2586 generic.go:356] "Generic (PLEG): container finished" podID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerID="3f232c72d537a7293f6ca40fbaa6d91ad45c0d07e55d2e2b80b81507f1d80c8e" exitCode=0
Sep 15 08:03:17.754391 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:17.754362    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" event={"ID":"6704c61c-facb-4c2e-8605-f96377e03b0d","Type":"ContainerDied","Data":"3f232c72d537a7293f6ca40fbaa6d91ad45c0d07e55d2e2b80b81507f1d80c8e"}
Sep 15 08:03:18.760576 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:18.760530    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" event={"ID":"6704c61c-facb-4c2e-8605-f96377e03b0d","Type":"ContainerStarted","Data":"de94107e07f6ffbcd4de1767343e20181c1c374dfae70dc7651fcae4e2eb4dfc"}
Sep 15 08:03:24.784767 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:24.784728    2586 generic.go:356] "Generic (PLEG): container finished" podID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerID="de94107e07f6ffbcd4de1767343e20181c1c374dfae70dc7651fcae4e2eb4dfc" exitCode=0
Sep 15 08:03:24.785185 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:24.784793    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" event={"ID":"6704c61c-facb-4c2e-8605-f96377e03b0d","Type":"ContainerDied","Data":"de94107e07f6ffbcd4de1767343e20181c1c374dfae70dc7651fcae4e2eb4dfc"}
Sep 15 08:03:25.792917 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:25.792884    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" event={"ID":"6704c61c-facb-4c2e-8605-f96377e03b0d","Type":"ContainerStarted","Data":"67a2565058774f90d1519fdbed7a2115079ab81ea6b5eddd2bcfadfc39281ea3"}
Sep 15 08:03:25.793496 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:25.792943    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" event={"ID":"6704c61c-facb-4c2e-8605-f96377e03b0d","Type":"ContainerStarted","Data":"f78ceed34d0cd32fd062abfa8fc090868f28627b560d943ecc3228f33401452f"}
Sep 15 08:03:25.793496 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:25.792962    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" event={"ID":"6704c61c-facb-4c2e-8605-f96377e03b0d","Type":"ContainerStarted","Data":"f495f77531a532b84415647a0ae96f34b442c6b3760691616db4d2c62a707f9c"}
Sep 15 08:03:25.818469 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:25.818399    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" podStartSLOduration=10.818377591 podStartE2EDuration="10.818377591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 08:03:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 08:03:25.817588335 +0000 UTC m=+758.609051059" watchObservedRunningTime="2026-09-15 08:03:25.818377591 +0000 UTC m=+758.609840316"
Sep 15 08:03:25.981266 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:25.981228    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:25.981421 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:25.981311    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:25.981421 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:25.981339    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:27.980901 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:27.980840    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:27.981350 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:27.980922    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:27.981350 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:27.980949    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:27.982557 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:27.982522    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused"
Sep 15 08:03:27.982557 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:27.982532    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused"
Sep 15 08:03:27.982794 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:27.982548    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Sep 15 08:03:30.980813 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:30.980765    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused"
Sep 15 08:03:30.980813 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:30.980805    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Sep 15 08:03:30.981361 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:30.980765    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused"
Sep 15 08:03:33.980932 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:33.980886    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused"
Sep 15 08:03:33.981874 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:33.981844    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:33.982793 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:33.982770    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:33.987170 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:33.987148    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:34.842727 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:34.842691    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:36.981779 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:36.981728    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused"
Sep 15 08:03:39.981514 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:39.981484    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:39.982369 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:39.982343    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:03:40.268786 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:03:40.268698    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:04:38.475999 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:38.475963    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:04:43.457092 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:43.457053    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-667557fff8-x98pm"]
Sep 15 08:04:43.457465 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:43.457282    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="registry" containerID="cri-o://f495f77531a532b84415647a0ae96f34b442c6b3760691616db4d2c62a707f9c" gracePeriod=30
Sep 15 08:04:43.457465 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:43.457357    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="offline" containerID="cri-o://67a2565058774f90d1519fdbed7a2115079ab81ea6b5eddd2bcfadfc39281ea3" gracePeriod=30
Sep 15 08:04:43.457465 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:43.457351    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="online" containerID="cri-o://f78ceed34d0cd32fd062abfa8fc090868f28627b560d943ecc3228f33401452f" gracePeriod=30
Sep 15 08:04:43.474872 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:43.474848    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-wtq4p"]
Sep 15 08:04:43.475032 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:43.474996    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-wtq4p" podUID="79d635fe-8f96-41b6-8689-c571d8f76d26" containerName="postgres" containerID="cri-o://da617e96f6f2ec248237f20a1c1bdfb5a07043a95e058404d72b71e31c90ea19" gracePeriod=30
Sep 15 08:04:43.715550 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:43.715494    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-wtq4p"
Sep 15 08:04:43.856220 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:43.856181    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/79d635fe-8f96-41b6-8689-c571d8f76d26-postgresdata\") pod \"79d635fe-8f96-41b6-8689-c571d8f76d26\" (UID: \"79d635fe-8f96-41b6-8689-c571d8f76d26\") "
Sep 15 08:04:43.856398 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:43.856229    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2hzh\" (UniqueName: \"kubernetes.io/projected/79d635fe-8f96-41b6-8689-c571d8f76d26-kube-api-access-d2hzh\") pod \"79d635fe-8f96-41b6-8689-c571d8f76d26\" (UID: \"79d635fe-8f96-41b6-8689-c571d8f76d26\") "
Sep 15 08:04:43.858277 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:43.858243    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79d635fe-8f96-41b6-8689-c571d8f76d26-kube-api-access-d2hzh" (OuterVolumeSpecName: "kube-api-access-d2hzh") pod "79d635fe-8f96-41b6-8689-c571d8f76d26" (UID: "79d635fe-8f96-41b6-8689-c571d8f76d26"). InnerVolumeSpecName "kube-api-access-d2hzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 08:04:43.888607 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:43.888576    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79d635fe-8f96-41b6-8689-c571d8f76d26-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "79d635fe-8f96-41b6-8689-c571d8f76d26" (UID: "79d635fe-8f96-41b6-8689-c571d8f76d26"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 08:04:43.956970 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:43.956920    2586 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/79d635fe-8f96-41b6-8689-c571d8f76d26-postgresdata\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:04:43.956970 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:43.956968    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2hzh\" (UniqueName: \"kubernetes.io/projected/79d635fe-8f96-41b6-8689-c571d8f76d26-kube-api-access-d2hzh\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:04:44.108840 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:44.108803    2586 generic.go:356] "Generic (PLEG): container finished" podID="79d635fe-8f96-41b6-8689-c571d8f76d26" containerID="da617e96f6f2ec248237f20a1c1bdfb5a07043a95e058404d72b71e31c90ea19" exitCode=0
Sep 15 08:04:44.108840 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:44.108838    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-wtq4p"
Sep 15 08:04:44.109201 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:44.108864    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-wtq4p" event={"ID":"79d635fe-8f96-41b6-8689-c571d8f76d26","Type":"ContainerDied","Data":"da617e96f6f2ec248237f20a1c1bdfb5a07043a95e058404d72b71e31c90ea19"}
Sep 15 08:04:44.109201 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:44.108903    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-wtq4p" event={"ID":"79d635fe-8f96-41b6-8689-c571d8f76d26","Type":"ContainerDied","Data":"99fadfa45b5cbe9058c1ff02c5d529d9420c2702b215a591c2af3dc335f1bb93"}
Sep 15 08:04:44.109201 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:44.108921    2586 scope.go:117] "RemoveContainer" containerID="da617e96f6f2ec248237f20a1c1bdfb5a07043a95e058404d72b71e31c90ea19"
Sep 15 08:04:44.120027 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:44.119991    2586 scope.go:117] "RemoveContainer" containerID="da617e96f6f2ec248237f20a1c1bdfb5a07043a95e058404d72b71e31c90ea19"
Sep 15 08:04:44.120498 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:04:44.120471    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da617e96f6f2ec248237f20a1c1bdfb5a07043a95e058404d72b71e31c90ea19\": container with ID starting with da617e96f6f2ec248237f20a1c1bdfb5a07043a95e058404d72b71e31c90ea19 not found: ID does not exist" containerID="da617e96f6f2ec248237f20a1c1bdfb5a07043a95e058404d72b71e31c90ea19"
Sep 15 08:04:44.120597 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:44.120504    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da617e96f6f2ec248237f20a1c1bdfb5a07043a95e058404d72b71e31c90ea19"} err="failed to get container status \"da617e96f6f2ec248237f20a1c1bdfb5a07043a95e058404d72b71e31c90ea19\": rpc error: code = NotFound desc = could not find container \"da617e96f6f2ec248237f20a1c1bdfb5a07043a95e058404d72b71e31c90ea19\": container with ID starting with da617e96f6f2ec248237f20a1c1bdfb5a07043a95e058404d72b71e31c90ea19 not found: ID does not exist"
Sep 15 08:04:44.128856 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:44.128829    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-wtq4p"]
Sep 15 08:04:44.132410 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:44.132385    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-wtq4p"]
Sep 15 08:04:44.196432 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:44.196369    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:04:44.839805 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:44.839768    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Sep 15 08:04:45.115674 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:45.115588    2586 generic.go:356] "Generic (PLEG): container finished" podID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerID="f78ceed34d0cd32fd062abfa8fc090868f28627b560d943ecc3228f33401452f" exitCode=0
Sep 15 08:04:45.115674 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:45.115664    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" event={"ID":"6704c61c-facb-4c2e-8605-f96377e03b0d","Type":"ContainerDied","Data":"f78ceed34d0cd32fd062abfa8fc090868f28627b560d943ecc3228f33401452f"}
Sep 15 08:04:45.720363 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:45.720333    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79d635fe-8f96-41b6-8689-c571d8f76d26" path="/var/lib/kubelet/pods/79d635fe-8f96-41b6-8689-c571d8f76d26/volumes"
Sep 15 08:04:46.966959 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:46.966912    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:04:54.839527 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:04:54.839483    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Sep 15 08:05:04.839478 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:04.839433    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Sep 15 08:05:04.839923 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:04.839574    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:05:05.108619 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:05.108527    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:05:13.982921 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:13.982886    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused"
Sep 15 08:05:14.093779 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.093751    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:05:14.168224 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.168190    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ffbq\" (UniqueName: \"kubernetes.io/projected/6704c61c-facb-4c2e-8605-f96377e03b0d-kube-api-access-6ffbq\") pod \"6704c61c-facb-4c2e-8605-f96377e03b0d\" (UID: \"6704c61c-facb-4c2e-8605-f96377e03b0d\") "
Sep 15 08:05:14.168417 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.168247    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6704c61c-facb-4c2e-8605-f96377e03b0d-offline-tls\") pod \"6704c61c-facb-4c2e-8605-f96377e03b0d\" (UID: \"6704c61c-facb-4c2e-8605-f96377e03b0d\") "
Sep 15 08:05:14.168417 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.168281    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6704c61c-facb-4c2e-8605-f96377e03b0d-registry-tls\") pod \"6704c61c-facb-4c2e-8605-f96377e03b0d\" (UID: \"6704c61c-facb-4c2e-8605-f96377e03b0d\") "
Sep 15 08:05:14.168417 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.168301    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6704c61c-facb-4c2e-8605-f96377e03b0d-feast-data\") pod \"6704c61c-facb-4c2e-8605-f96377e03b0d\" (UID: \"6704c61c-facb-4c2e-8605-f96377e03b0d\") "
Sep 15 08:05:14.168417 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.168321    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6704c61c-facb-4c2e-8605-f96377e03b0d-online-tls\") pod \"6704c61c-facb-4c2e-8605-f96377e03b0d\" (UID: \"6704c61c-facb-4c2e-8605-f96377e03b0d\") "
Sep 15 08:05:14.170467 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.170429    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6704c61c-facb-4c2e-8605-f96377e03b0d-online-tls" (OuterVolumeSpecName: "online-tls") pod "6704c61c-facb-4c2e-8605-f96377e03b0d" (UID: "6704c61c-facb-4c2e-8605-f96377e03b0d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:05:14.170590 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.170495    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6704c61c-facb-4c2e-8605-f96377e03b0d-kube-api-access-6ffbq" (OuterVolumeSpecName: "kube-api-access-6ffbq") pod "6704c61c-facb-4c2e-8605-f96377e03b0d" (UID: "6704c61c-facb-4c2e-8605-f96377e03b0d"). InnerVolumeSpecName "kube-api-access-6ffbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 08:05:14.170803 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.170779    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6704c61c-facb-4c2e-8605-f96377e03b0d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6704c61c-facb-4c2e-8605-f96377e03b0d" (UID: "6704c61c-facb-4c2e-8605-f96377e03b0d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:05:14.170915 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.170877    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6704c61c-facb-4c2e-8605-f96377e03b0d-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "6704c61c-facb-4c2e-8605-f96377e03b0d" (UID: "6704c61c-facb-4c2e-8605-f96377e03b0d"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:05:14.175940 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.175920    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6704c61c-facb-4c2e-8605-f96377e03b0d-feast-data" (OuterVolumeSpecName: "feast-data") pod "6704c61c-facb-4c2e-8605-f96377e03b0d" (UID: "6704c61c-facb-4c2e-8605-f96377e03b0d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 08:05:14.232616 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.232537    2586 generic.go:356] "Generic (PLEG): container finished" podID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerID="67a2565058774f90d1519fdbed7a2115079ab81ea6b5eddd2bcfadfc39281ea3" exitCode=137
Sep 15 08:05:14.232616 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.232562    2586 generic.go:356] "Generic (PLEG): container finished" podID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerID="f495f77531a532b84415647a0ae96f34b442c6b3760691616db4d2c62a707f9c" exitCode=137
Sep 15 08:05:14.232616 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.232606    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm"
Sep 15 08:05:14.232850 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.232623    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" event={"ID":"6704c61c-facb-4c2e-8605-f96377e03b0d","Type":"ContainerDied","Data":"67a2565058774f90d1519fdbed7a2115079ab81ea6b5eddd2bcfadfc39281ea3"}
Sep 15 08:05:14.232850 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.232703    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" event={"ID":"6704c61c-facb-4c2e-8605-f96377e03b0d","Type":"ContainerDied","Data":"f495f77531a532b84415647a0ae96f34b442c6b3760691616db4d2c62a707f9c"}
Sep 15 08:05:14.232850 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.232729    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-667557fff8-x98pm" event={"ID":"6704c61c-facb-4c2e-8605-f96377e03b0d","Type":"ContainerDied","Data":"a912bbb8bcb3ce62e5fc19312f666b6638c7fa57a36a70c8811aa32317931a98"}
Sep 15 08:05:14.232850 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.232761    2586 scope.go:117] "RemoveContainer" containerID="67a2565058774f90d1519fdbed7a2115079ab81ea6b5eddd2bcfadfc39281ea3"
Sep 15 08:05:14.240959 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.240942    2586 scope.go:117] "RemoveContainer" containerID="f78ceed34d0cd32fd062abfa8fc090868f28627b560d943ecc3228f33401452f"
Sep 15 08:05:14.248195 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.248177    2586 scope.go:117] "RemoveContainer" containerID="f495f77531a532b84415647a0ae96f34b442c6b3760691616db4d2c62a707f9c"
Sep 15 08:05:14.253904 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.253879    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-667557fff8-x98pm"]
Sep 15 08:05:14.258990 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.258969    2586 scope.go:117] "RemoveContainer" containerID="de94107e07f6ffbcd4de1767343e20181c1c374dfae70dc7651fcae4e2eb4dfc"
Sep 15 08:05:14.259072 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.259003    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-667557fff8-x98pm"]
Sep 15 08:05:14.265588 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.265572    2586 scope.go:117] "RemoveContainer" containerID="3f232c72d537a7293f6ca40fbaa6d91ad45c0d07e55d2e2b80b81507f1d80c8e"
Sep 15 08:05:14.268903 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.268881    2586 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6704c61c-facb-4c2e-8605-f96377e03b0d-registry-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:05:14.268903 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.268903    2586 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6704c61c-facb-4c2e-8605-f96377e03b0d-feast-data\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:05:14.269015 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.268912    2586 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6704c61c-facb-4c2e-8605-f96377e03b0d-online-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:05:14.269015 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.268921    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ffbq\" (UniqueName: \"kubernetes.io/projected/6704c61c-facb-4c2e-8605-f96377e03b0d-kube-api-access-6ffbq\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:05:14.269015 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.268931    2586 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6704c61c-facb-4c2e-8605-f96377e03b0d-offline-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:05:14.272327 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.272309    2586 scope.go:117] "RemoveContainer" containerID="67a2565058774f90d1519fdbed7a2115079ab81ea6b5eddd2bcfadfc39281ea3"
Sep 15 08:05:14.272594 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:05:14.272576    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67a2565058774f90d1519fdbed7a2115079ab81ea6b5eddd2bcfadfc39281ea3\": container with ID starting with 67a2565058774f90d1519fdbed7a2115079ab81ea6b5eddd2bcfadfc39281ea3 not found: ID does not exist" containerID="67a2565058774f90d1519fdbed7a2115079ab81ea6b5eddd2bcfadfc39281ea3"
Sep 15 08:05:14.272657 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.272604    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67a2565058774f90d1519fdbed7a2115079ab81ea6b5eddd2bcfadfc39281ea3"} err="failed to get container status \"67a2565058774f90d1519fdbed7a2115079ab81ea6b5eddd2bcfadfc39281ea3\": rpc error: code = NotFound desc = could not find container \"67a2565058774f90d1519fdbed7a2115079ab81ea6b5eddd2bcfadfc39281ea3\": container with ID starting with 67a2565058774f90d1519fdbed7a2115079ab81ea6b5eddd2bcfadfc39281ea3 not found: ID does not exist"
Sep 15 08:05:14.272657 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.272622    2586 scope.go:117] "RemoveContainer" containerID="f78ceed34d0cd32fd062abfa8fc090868f28627b560d943ecc3228f33401452f"
Sep 15 08:05:14.272891 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:05:14.272874    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f78ceed34d0cd32fd062abfa8fc090868f28627b560d943ecc3228f33401452f\": container with ID starting with f78ceed34d0cd32fd062abfa8fc090868f28627b560d943ecc3228f33401452f not found: ID does not exist" containerID="f78ceed34d0cd32fd062abfa8fc090868f28627b560d943ecc3228f33401452f"
Sep 15 08:05:14.272952 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.272900    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f78ceed34d0cd32fd062abfa8fc090868f28627b560d943ecc3228f33401452f"} err="failed to get container status \"f78ceed34d0cd32fd062abfa8fc090868f28627b560d943ecc3228f33401452f\": rpc error: code = NotFound desc = could not find container \"f78ceed34d0cd32fd062abfa8fc090868f28627b560d943ecc3228f33401452f\": container with ID starting with f78ceed34d0cd32fd062abfa8fc090868f28627b560d943ecc3228f33401452f not found: ID does not exist"
Sep 15 08:05:14.272952 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.272923    2586 scope.go:117] "RemoveContainer" containerID="f495f77531a532b84415647a0ae96f34b442c6b3760691616db4d2c62a707f9c"
Sep 15 08:05:14.273156 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:05:14.273140    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f495f77531a532b84415647a0ae96f34b442c6b3760691616db4d2c62a707f9c\": container with ID starting with f495f77531a532b84415647a0ae96f34b442c6b3760691616db4d2c62a707f9c not found: ID does not exist" containerID="f495f77531a532b84415647a0ae96f34b442c6b3760691616db4d2c62a707f9c"
Sep 15 08:05:14.273198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.273160    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f495f77531a532b84415647a0ae96f34b442c6b3760691616db4d2c62a707f9c"} err="failed to get container status \"f495f77531a532b84415647a0ae96f34b442c6b3760691616db4d2c62a707f9c\": rpc error: code = NotFound desc = could not find container \"f495f77531a532b84415647a0ae96f34b442c6b3760691616db4d2c62a707f9c\": container with ID starting with f495f77531a532b84415647a0ae96f34b442c6b3760691616db4d2c62a707f9c not found: ID does not exist"
Sep 15 08:05:14.273198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.273175    2586 scope.go:117] "RemoveContainer" containerID="de94107e07f6ffbcd4de1767343e20181c1c374dfae70dc7651fcae4e2eb4dfc"
Sep 15 08:05:14.273371 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:05:14.273357    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de94107e07f6ffbcd4de1767343e20181c1c374dfae70dc7651fcae4e2eb4dfc\": container with ID starting with de94107e07f6ffbcd4de1767343e20181c1c374dfae70dc7651fcae4e2eb4dfc not found: ID does not exist" containerID="de94107e07f6ffbcd4de1767343e20181c1c374dfae70dc7651fcae4e2eb4dfc"
Sep 15 08:05:14.273412 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.273374    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de94107e07f6ffbcd4de1767343e20181c1c374dfae70dc7651fcae4e2eb4dfc"} err="failed to get container status \"de94107e07f6ffbcd4de1767343e20181c1c374dfae70dc7651fcae4e2eb4dfc\": rpc error: code = NotFound desc = could not find container \"de94107e07f6ffbcd4de1767343e20181c1c374dfae70dc7651fcae4e2eb4dfc\": container with ID starting with de94107e07f6ffbcd4de1767343e20181c1c374dfae70dc7651fcae4e2eb4dfc not found: ID does not exist"
Sep 15 08:05:14.273412 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.273388    2586 scope.go:117] "RemoveContainer" containerID="3f232c72d537a7293f6ca40fbaa6d91ad45c0d07e55d2e2b80b81507f1d80c8e"
Sep 15 08:05:14.273595 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:05:14.273580    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f232c72d537a7293f6ca40fbaa6d91ad45c0d07e55d2e2b80b81507f1d80c8e\": container with ID starting with 3f232c72d537a7293f6ca40fbaa6d91ad45c0d07e55d2e2b80b81507f1d80c8e not found: ID does not exist" containerID="3f232c72d537a7293f6ca40fbaa6d91ad45c0d07e55d2e2b80b81507f1d80c8e"
Sep 15 08:05:14.273769 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.273599    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f232c72d537a7293f6ca40fbaa6d91ad45c0d07e55d2e2b80b81507f1d80c8e"} err="failed to get container status \"3f232c72d537a7293f6ca40fbaa6d91ad45c0d07e55d2e2b80b81507f1d80c8e\": rpc error: code = NotFound desc = could not find container \"3f232c72d537a7293f6ca40fbaa6d91ad45c0d07e55d2e2b80b81507f1d80c8e\": container with ID starting with 3f232c72d537a7293f6ca40fbaa6d91ad45c0d07e55d2e2b80b81507f1d80c8e not found: ID does not exist"
Sep 15 08:05:14.273769 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.273611    2586 scope.go:117] "RemoveContainer" containerID="67a2565058774f90d1519fdbed7a2115079ab81ea6b5eddd2bcfadfc39281ea3"
Sep 15 08:05:14.273886 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.273828    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67a2565058774f90d1519fdbed7a2115079ab81ea6b5eddd2bcfadfc39281ea3"} err="failed to get container status \"67a2565058774f90d1519fdbed7a2115079ab81ea6b5eddd2bcfadfc39281ea3\": rpc error: code = NotFound desc = could not find container \"67a2565058774f90d1519fdbed7a2115079ab81ea6b5eddd2bcfadfc39281ea3\": container with ID starting with 67a2565058774f90d1519fdbed7a2115079ab81ea6b5eddd2bcfadfc39281ea3 not found: ID does not exist"
Sep 15 08:05:14.273886 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.273840    2586 scope.go:117] "RemoveContainer" containerID="f78ceed34d0cd32fd062abfa8fc090868f28627b560d943ecc3228f33401452f"
Sep 15 08:05:14.274108 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.274089    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f78ceed34d0cd32fd062abfa8fc090868f28627b560d943ecc3228f33401452f"} err="failed to get container status \"f78ceed34d0cd32fd062abfa8fc090868f28627b560d943ecc3228f33401452f\": rpc error: code = NotFound desc = could not find container \"f78ceed34d0cd32fd062abfa8fc090868f28627b560d943ecc3228f33401452f\": container with ID starting with f78ceed34d0cd32fd062abfa8fc090868f28627b560d943ecc3228f33401452f not found: ID does not exist"
Sep 15 08:05:14.274148 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.274116    2586 scope.go:117] "RemoveContainer" containerID="f495f77531a532b84415647a0ae96f34b442c6b3760691616db4d2c62a707f9c"
Sep 15 08:05:14.274331 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.274313    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f495f77531a532b84415647a0ae96f34b442c6b3760691616db4d2c62a707f9c"} err="failed to get container status \"f495f77531a532b84415647a0ae96f34b442c6b3760691616db4d2c62a707f9c\": rpc error: code = NotFound desc = could not find container \"f495f77531a532b84415647a0ae96f34b442c6b3760691616db4d2c62a707f9c\": container with ID starting with f495f77531a532b84415647a0ae96f34b442c6b3760691616db4d2c62a707f9c not found: ID does not exist"
Sep 15 08:05:14.274372 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.274333    2586 scope.go:117] "RemoveContainer" containerID="de94107e07f6ffbcd4de1767343e20181c1c374dfae70dc7651fcae4e2eb4dfc"
Sep 15 08:05:14.274553 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.274537    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de94107e07f6ffbcd4de1767343e20181c1c374dfae70dc7651fcae4e2eb4dfc"} err="failed to get container status \"de94107e07f6ffbcd4de1767343e20181c1c374dfae70dc7651fcae4e2eb4dfc\": rpc error: code = NotFound desc = could not find container \"de94107e07f6ffbcd4de1767343e20181c1c374dfae70dc7651fcae4e2eb4dfc\": container with ID starting with de94107e07f6ffbcd4de1767343e20181c1c374dfae70dc7651fcae4e2eb4dfc not found: ID does not exist"
Sep 15 08:05:14.274593 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.274552    2586 scope.go:117] "RemoveContainer" containerID="3f232c72d537a7293f6ca40fbaa6d91ad45c0d07e55d2e2b80b81507f1d80c8e"
Sep 15 08:05:14.274774 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:14.274757    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f232c72d537a7293f6ca40fbaa6d91ad45c0d07e55d2e2b80b81507f1d80c8e"} err="failed to get container status \"3f232c72d537a7293f6ca40fbaa6d91ad45c0d07e55d2e2b80b81507f1d80c8e\": rpc error: code = NotFound desc = could not find container \"3f232c72d537a7293f6ca40fbaa6d91ad45c0d07e55d2e2b80b81507f1d80c8e\": container with ID starting with 3f232c72d537a7293f6ca40fbaa6d91ad45c0d07e55d2e2b80b81507f1d80c8e not found: ID does not exist"
Sep 15 08:05:15.719989 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:15.719955    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" path="/var/lib/kubelet/pods/6704c61c-facb-4c2e-8605-f96377e03b0d/volumes"
Sep 15 08:05:20.946347 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:20.946306    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:05:21.045697 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:21.045666    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:05:21.356831 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:21.356789    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:05:21.580246 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:21.580215    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:05:47.680622 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:47.680522    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cp9wl_a5527013-2ce3-48e3-b472-a593cbfbb55f/console-operator/1.log"
Sep 15 08:05:47.684114 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:47.684094    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cp9wl_a5527013-2ce3-48e3-b472-a593cbfbb55f/console-operator/1.log"
Sep 15 08:05:57.692160 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:05:57.692122    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:10:11.611204 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.611121    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:10:11.754458 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.754416    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-gv5pj"]
Sep 15 08:10:11.754721 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.754708    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="online"
Sep 15 08:10:11.754774 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.754722    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="online"
Sep 15 08:10:11.754774 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.754733    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79d635fe-8f96-41b6-8689-c571d8f76d26" containerName="postgres"
Sep 15 08:10:11.754774 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.754738    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="79d635fe-8f96-41b6-8689-c571d8f76d26" containerName="postgres"
Sep 15 08:10:11.754774 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.754746    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="feast-apply"
Sep 15 08:10:11.754774 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.754751    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="feast-apply"
Sep 15 08:10:11.754774 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.754765    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="feast-init"
Sep 15 08:10:11.754774 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.754770    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="feast-init"
Sep 15 08:10:11.755017 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.754778    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="registry"
Sep 15 08:10:11.755017 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.754784    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="registry"
Sep 15 08:10:11.755017 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.754789    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="offline"
Sep 15 08:10:11.755017 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.754796    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="offline"
Sep 15 08:10:11.755017 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.754845    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="offline"
Sep 15 08:10:11.755017 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.754852    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="online"
Sep 15 08:10:11.755017 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.754858    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="79d635fe-8f96-41b6-8689-c571d8f76d26" containerName="postgres"
Sep 15 08:10:11.755017 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.754865    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="6704c61c-facb-4c2e-8605-f96377e03b0d" containerName="registry"
Sep 15 08:10:11.757470 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.757454    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-gv5pj"
Sep 15 08:10:11.759734 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.759709    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-4bfx8\""
Sep 15 08:10:11.759866 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.759801    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Sep 15 08:10:11.760579 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.760556    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Sep 15 08:10:11.770857 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.770835    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-gv5pj"]
Sep 15 08:10:11.887031 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.886941    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjqq2\" (UniqueName: \"kubernetes.io/projected/de17e4b2-5e31-40d3-ae65-0e5bf28c9f64-kube-api-access-vjqq2\") pod \"redis-69bbd798b6-gv5pj\" (UID: \"de17e4b2-5e31-40d3-ae65-0e5bf28c9f64\") " pod="test-ns-feast-rest/redis-69bbd798b6-gv5pj"
Sep 15 08:10:11.987801 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.987767    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjqq2\" (UniqueName: \"kubernetes.io/projected/de17e4b2-5e31-40d3-ae65-0e5bf28c9f64-kube-api-access-vjqq2\") pod \"redis-69bbd798b6-gv5pj\" (UID: \"de17e4b2-5e31-40d3-ae65-0e5bf28c9f64\") " pod="test-ns-feast-rest/redis-69bbd798b6-gv5pj"
Sep 15 08:10:11.996126 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:11.996097    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjqq2\" (UniqueName: \"kubernetes.io/projected/de17e4b2-5e31-40d3-ae65-0e5bf28c9f64-kube-api-access-vjqq2\") pod \"redis-69bbd798b6-gv5pj\" (UID: \"de17e4b2-5e31-40d3-ae65-0e5bf28c9f64\") " pod="test-ns-feast-rest/redis-69bbd798b6-gv5pj"
Sep 15 08:10:12.081754 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:12.081718    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-gv5pj"
Sep 15 08:10:12.347669 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:12.347617    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-gv5pj"]
Sep 15 08:10:12.350600 ip-10-0-134-189 kubenswrapper[2586]: W0915 08:10:12.350572    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde17e4b2_5e31_40d3_ae65_0e5bf28c9f64.slice/crio-85e081ba7e12c0f1091a1c2620fe70987bdcd31648db9b2d9a77cf24a0242738 WatchSource:0}: Error finding container 85e081ba7e12c0f1091a1c2620fe70987bdcd31648db9b2d9a77cf24a0242738: Status 404 returned error can't find the container with id 85e081ba7e12c0f1091a1c2620fe70987bdcd31648db9b2d9a77cf24a0242738
Sep 15 08:10:12.352425 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:12.352411    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 08:10:13.325888 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:13.325848    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-gv5pj" event={"ID":"de17e4b2-5e31-40d3-ae65-0e5bf28c9f64","Type":"ContainerStarted","Data":"85e081ba7e12c0f1091a1c2620fe70987bdcd31648db9b2d9a77cf24a0242738"}
Sep 15 08:10:14.336343 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:14.336300    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-gv5pj" event={"ID":"de17e4b2-5e31-40d3-ae65-0e5bf28c9f64","Type":"ContainerStarted","Data":"a94db75fcdabab91c478936327c9c2d0a4264b3590202f6eeae57f4ed017e950"}
Sep 15 08:10:14.350460 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:14.350412    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-gv5pj" podStartSLOduration=2.074746101 podStartE2EDuration="3.350397193s" totalImagesPullingTime="1.275651092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 08:10:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 08:10:14.349232807 +0000 UTC m=+1167.140695532" watchObservedRunningTime="2026-09-15 08:10:14.350397193 +0000 UTC m=+1167.141859916"
Sep 15 08:10:16.113608 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:16.113571    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:10:17.189037 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:17.188997    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-d58mk"]
Sep 15 08:10:17.192611 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:17.192586    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-d58mk"
Sep 15 08:10:17.195207 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:17.195187    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Sep 15 08:10:17.200342 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:17.200083    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-d58mk"]
Sep 15 08:10:17.222883 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:17.222852    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:10:17.331977 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:17.331942    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f4st\" (UniqueName: \"kubernetes.io/projected/ddbc4a6c-21ab-47ce-9100-d8325c9e01ba-kube-api-access-6f4st\") pod \"postgres-864846d4f5-d58mk\" (UID: \"ddbc4a6c-21ab-47ce-9100-d8325c9e01ba\") " pod="test-ns-feast-rest/postgres-864846d4f5-d58mk"
Sep 15 08:10:17.331977 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:17.331985    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ddbc4a6c-21ab-47ce-9100-d8325c9e01ba-postgresdata\") pod \"postgres-864846d4f5-d58mk\" (UID: \"ddbc4a6c-21ab-47ce-9100-d8325c9e01ba\") " pod="test-ns-feast-rest/postgres-864846d4f5-d58mk"
Sep 15 08:10:17.433443 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:17.433388    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f4st\" (UniqueName: \"kubernetes.io/projected/ddbc4a6c-21ab-47ce-9100-d8325c9e01ba-kube-api-access-6f4st\") pod \"postgres-864846d4f5-d58mk\" (UID: \"ddbc4a6c-21ab-47ce-9100-d8325c9e01ba\") " pod="test-ns-feast-rest/postgres-864846d4f5-d58mk"
Sep 15 08:10:17.433443 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:17.433444    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ddbc4a6c-21ab-47ce-9100-d8325c9e01ba-postgresdata\") pod \"postgres-864846d4f5-d58mk\" (UID: \"ddbc4a6c-21ab-47ce-9100-d8325c9e01ba\") " pod="test-ns-feast-rest/postgres-864846d4f5-d58mk"
Sep 15 08:10:17.433825 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:17.433809    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ddbc4a6c-21ab-47ce-9100-d8325c9e01ba-postgresdata\") pod \"postgres-864846d4f5-d58mk\" (UID: \"ddbc4a6c-21ab-47ce-9100-d8325c9e01ba\") " pod="test-ns-feast-rest/postgres-864846d4f5-d58mk"
Sep 15 08:10:17.441781 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:17.441730    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f4st\" (UniqueName: \"kubernetes.io/projected/ddbc4a6c-21ab-47ce-9100-d8325c9e01ba-kube-api-access-6f4st\") pod \"postgres-864846d4f5-d58mk\" (UID: \"ddbc4a6c-21ab-47ce-9100-d8325c9e01ba\") " pod="test-ns-feast-rest/postgres-864846d4f5-d58mk"
Sep 15 08:10:17.503502 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:17.503473    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-d58mk"
Sep 15 08:10:17.771064 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:17.770977    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-d58mk"]
Sep 15 08:10:17.773601 ip-10-0-134-189 kubenswrapper[2586]: W0915 08:10:17.773575    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podddbc4a6c_21ab_47ce_9100_d8325c9e01ba.slice/crio-ab6609b4eb766333f0579ffef12c1d6ce8383bef819189567f41d6e0f6d21227 WatchSource:0}: Error finding container ab6609b4eb766333f0579ffef12c1d6ce8383bef819189567f41d6e0f6d21227: Status 404 returned error can't find the container with id ab6609b4eb766333f0579ffef12c1d6ce8383bef819189567f41d6e0f6d21227
Sep 15 08:10:18.354134 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:18.354104    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-d58mk" event={"ID":"ddbc4a6c-21ab-47ce-9100-d8325c9e01ba","Type":"ContainerStarted","Data":"9a3f64dd08342adb86c6e0d6e8fab6d53b00fe140d03a6851da65b9f246593d8"}
Sep 15 08:10:18.354509 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:18.354149    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-d58mk" event={"ID":"ddbc4a6c-21ab-47ce-9100-d8325c9e01ba","Type":"ContainerStarted","Data":"ab6609b4eb766333f0579ffef12c1d6ce8383bef819189567f41d6e0f6d21227"}
Sep 15 08:10:18.369530 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:18.369473    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-d58mk" podStartSLOduration=1.369449663 podStartE2EDuration="1.369449663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 08:10:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 08:10:18.368032605 +0000 UTC m=+1171.159495330" watchObservedRunningTime="2026-09-15 08:10:18.369449663 +0000 UTC m=+1171.160912388"
Sep 15 08:10:22.651887 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:22.651845    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:10:22.729942 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:22.729909    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:10:22.734084 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:22.734057    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"]
Sep 15 08:10:22.737430 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:22.737415    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:22.739844 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:22.739821    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-nm7pc\""
Sep 15 08:10:22.739962 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:22.739849    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Sep 15 08:10:22.739962 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:22.739865    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Sep 15 08:10:22.739962 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:22.739819    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Sep 15 08:10:22.747486 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:22.747469    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"]
Sep 15 08:10:22.873598 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:22.873562    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8e22c973-4bcb-4f80-bf1b-f858ccd44308-online-tls\") pod \"feast-credit-scoring-6749fd6d9-vh8kx\" (UID: \"8e22c973-4bcb-4f80-bf1b-f858ccd44308\") " pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:22.873770 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:22.873606    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p64cv\" (UniqueName: \"kubernetes.io/projected/8e22c973-4bcb-4f80-bf1b-f858ccd44308-kube-api-access-p64cv\") pod \"feast-credit-scoring-6749fd6d9-vh8kx\" (UID: \"8e22c973-4bcb-4f80-bf1b-f858ccd44308\") " pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:22.873770 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:22.873667    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8e22c973-4bcb-4f80-bf1b-f858ccd44308-registry-tls\") pod \"feast-credit-scoring-6749fd6d9-vh8kx\" (UID: \"8e22c973-4bcb-4f80-bf1b-f858ccd44308\") " pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:22.873770 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:22.873699    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8e22c973-4bcb-4f80-bf1b-f858ccd44308-feast-data\") pod \"feast-credit-scoring-6749fd6d9-vh8kx\" (UID: \"8e22c973-4bcb-4f80-bf1b-f858ccd44308\") " pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:22.925792 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:22.925678    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:10:22.974841 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:22.974809    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8e22c973-4bcb-4f80-bf1b-f858ccd44308-online-tls\") pod \"feast-credit-scoring-6749fd6d9-vh8kx\" (UID: \"8e22c973-4bcb-4f80-bf1b-f858ccd44308\") " pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:22.974975 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:22.974851    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p64cv\" (UniqueName: \"kubernetes.io/projected/8e22c973-4bcb-4f80-bf1b-f858ccd44308-kube-api-access-p64cv\") pod \"feast-credit-scoring-6749fd6d9-vh8kx\" (UID: \"8e22c973-4bcb-4f80-bf1b-f858ccd44308\") " pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:22.974975 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:22.974883    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8e22c973-4bcb-4f80-bf1b-f858ccd44308-registry-tls\") pod \"feast-credit-scoring-6749fd6d9-vh8kx\" (UID: \"8e22c973-4bcb-4f80-bf1b-f858ccd44308\") " pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:22.974975 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:22.974908    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8e22c973-4bcb-4f80-bf1b-f858ccd44308-feast-data\") pod \"feast-credit-scoring-6749fd6d9-vh8kx\" (UID: \"8e22c973-4bcb-4f80-bf1b-f858ccd44308\") " pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:22.974975 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:10:22.974956    2586 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
Sep 15 08:10:22.975115 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:10:22.975027    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e22c973-4bcb-4f80-bf1b-f858ccd44308-online-tls podName:8e22c973-4bcb-4f80-bf1b-f858ccd44308 nodeName:}" failed. No retries permitted until 2026-09-15 08:10:23.475007846 +0000 UTC m=+1176.266470567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/8e22c973-4bcb-4f80-bf1b-f858ccd44308-online-tls") pod "feast-credit-scoring-6749fd6d9-vh8kx" (UID: "8e22c973-4bcb-4f80-bf1b-f858ccd44308") : secret "feast-credit-scoring-online-tls" not found
Sep 15 08:10:22.975318 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:22.975301    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8e22c973-4bcb-4f80-bf1b-f858ccd44308-feast-data\") pod \"feast-credit-scoring-6749fd6d9-vh8kx\" (UID: \"8e22c973-4bcb-4f80-bf1b-f858ccd44308\") " pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:22.977345 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:22.977326    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8e22c973-4bcb-4f80-bf1b-f858ccd44308-registry-tls\") pod \"feast-credit-scoring-6749fd6d9-vh8kx\" (UID: \"8e22c973-4bcb-4f80-bf1b-f858ccd44308\") " pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:22.983344 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:22.983311    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p64cv\" (UniqueName: \"kubernetes.io/projected/8e22c973-4bcb-4f80-bf1b-f858ccd44308-kube-api-access-p64cv\") pod \"feast-credit-scoring-6749fd6d9-vh8kx\" (UID: \"8e22c973-4bcb-4f80-bf1b-f858ccd44308\") " pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:23.105818 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:23.105785    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:10:23.480096 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:23.480046    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8e22c973-4bcb-4f80-bf1b-f858ccd44308-online-tls\") pod \"feast-credit-scoring-6749fd6d9-vh8kx\" (UID: \"8e22c973-4bcb-4f80-bf1b-f858ccd44308\") " pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:23.482428 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:23.482402    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8e22c973-4bcb-4f80-bf1b-f858ccd44308-online-tls\") pod \"feast-credit-scoring-6749fd6d9-vh8kx\" (UID: \"8e22c973-4bcb-4f80-bf1b-f858ccd44308\") " pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:23.646103 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:23.646062    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:23.920941 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:23.920916    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"]
Sep 15 08:10:23.922353 ip-10-0-134-189 kubenswrapper[2586]: W0915 08:10:23.922329    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e22c973_4bcb_4f80_bf1b_f858ccd44308.slice/crio-3c1113514931866b2e866d59c2d40c6c79a533ea58090f33a7a81b6ea9db9cbb WatchSource:0}: Error finding container 3c1113514931866b2e866d59c2d40c6c79a533ea58090f33a7a81b6ea9db9cbb: Status 404 returned error can't find the container with id 3c1113514931866b2e866d59c2d40c6c79a533ea58090f33a7a81b6ea9db9cbb
Sep 15 08:10:24.377529 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:24.377491    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" event={"ID":"8e22c973-4bcb-4f80-bf1b-f858ccd44308","Type":"ContainerStarted","Data":"ed6bf6a544d815c228d339e6ca6bf53be41ceb8d9de18882cda5fd106e227f31"}
Sep 15 08:10:24.377713 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:24.377551    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" event={"ID":"8e22c973-4bcb-4f80-bf1b-f858ccd44308","Type":"ContainerStarted","Data":"3c1113514931866b2e866d59c2d40c6c79a533ea58090f33a7a81b6ea9db9cbb"}
Sep 15 08:10:26.385958 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:26.385927    2586 generic.go:356] "Generic (PLEG): container finished" podID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerID="ed6bf6a544d815c228d339e6ca6bf53be41ceb8d9de18882cda5fd106e227f31" exitCode=0
Sep 15 08:10:26.386392 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:26.385984    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" event={"ID":"8e22c973-4bcb-4f80-bf1b-f858ccd44308","Type":"ContainerDied","Data":"ed6bf6a544d815c228d339e6ca6bf53be41ceb8d9de18882cda5fd106e227f31"}
Sep 15 08:10:27.392187 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:27.392150    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" event={"ID":"8e22c973-4bcb-4f80-bf1b-f858ccd44308","Type":"ContainerStarted","Data":"3cf0ace06cf044040629aabb34067e7d3fcc3f9bb21d9611d214aec4b066b555"}
Sep 15 08:10:33.420090 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:33.420050    2586 generic.go:356] "Generic (PLEG): container finished" podID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerID="3cf0ace06cf044040629aabb34067e7d3fcc3f9bb21d9611d214aec4b066b555" exitCode=0
Sep 15 08:10:33.420414 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:33.420119    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" event={"ID":"8e22c973-4bcb-4f80-bf1b-f858ccd44308","Type":"ContainerDied","Data":"3cf0ace06cf044040629aabb34067e7d3fcc3f9bb21d9611d214aec4b066b555"}
Sep 15 08:10:34.427544 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:34.427509    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" event={"ID":"8e22c973-4bcb-4f80-bf1b-f858ccd44308","Type":"ContainerStarted","Data":"09f34e1734cf4fa8fab6b79638611d284d3b913139d5389dd15803ebc45628cc"}
Sep 15 08:10:34.427951 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:34.427567    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" event={"ID":"8e22c973-4bcb-4f80-bf1b-f858ccd44308","Type":"ContainerStarted","Data":"79a3580bc008c2d2aa59ba0c0318a2194076400f0e8cdd1c8d45cb8bb2284166"}
Sep 15 08:10:34.450566 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:34.450519    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" podStartSLOduration=12.450505061 podStartE2EDuration="12.450505061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 08:10:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 08:10:34.447939393 +0000 UTC m=+1187.239402116" watchObservedRunningTime="2026-09-15 08:10:34.450505061 +0000 UTC m=+1187.241967783"
Sep 15 08:10:35.646232 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:35.646187    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:35.646663 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:35.646264    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:35.648057 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:35.648022    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused"
Sep 15 08:10:35.648057 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:35.648041    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Sep 15 08:10:38.646523 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:38.646473    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused"
Sep 15 08:10:38.646523 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:38.646504    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Sep 15 08:10:41.647018 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:41.646967    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused"
Sep 15 08:10:41.653458 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:41.653430    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:41.653882 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:41.653857    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:41.656959 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:41.656936    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:43.646192 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:43.646150    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:44.646921 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:44.646865    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused"
Sep 15 08:10:47.647791 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:47.647759    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:47.648656 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:47.648617    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:10:47.707307 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:47.707265    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cp9wl_a5527013-2ce3-48e3-b472-a593cbfbb55f/console-operator/1.log"
Sep 15 08:10:47.712446 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:47.712420    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cp9wl_a5527013-2ce3-48e3-b472-a593cbfbb55f/console-operator/1.log"
Sep 15 08:10:47.928213 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:47.928132    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:10:48.465525 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:48.465489    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:10:48.554384 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:48.554351    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"]
Sep 15 08:10:48.556949 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:48.556927    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:10:48.558006 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:48.557990    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:10:48.560435 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:48.560411    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-5k2rq\""
Sep 15 08:10:48.560435 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:48.560427    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Sep 15 08:10:48.560618 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:48.560440    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Sep 15 08:10:48.560708 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:48.560679    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Sep 15 08:10:48.569743 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:48.569723    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"]
Sep 15 08:10:48.575755 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:48.575734    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7982c9f0-9ae6-4849-8fea-7203954427d4-online-tls\") pod \"feast-driver-ranking-df795b458-58lcz\" (UID: \"7982c9f0-9ae6-4849-8fea-7203954427d4\") " pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:10:48.575854 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:48.575822    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8xd6\" (UniqueName: \"kubernetes.io/projected/7982c9f0-9ae6-4849-8fea-7203954427d4-kube-api-access-l8xd6\") pod \"feast-driver-ranking-df795b458-58lcz\" (UID: \"7982c9f0-9ae6-4849-8fea-7203954427d4\") " pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:10:48.575927 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:48.575907    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7982c9f0-9ae6-4849-8fea-7203954427d4-feast-data\") pod \"feast-driver-ranking-df795b458-58lcz\" (UID: \"7982c9f0-9ae6-4849-8fea-7203954427d4\") " pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:10:48.575994 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:48.575943    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7982c9f0-9ae6-4849-8fea-7203954427d4-registry-tls\") pod \"feast-driver-ranking-df795b458-58lcz\" (UID: \"7982c9f0-9ae6-4849-8fea-7203954427d4\") " pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:10:48.676783 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:48.676750    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7982c9f0-9ae6-4849-8fea-7203954427d4-online-tls\") pod \"feast-driver-ranking-df795b458-58lcz\" (UID: \"7982c9f0-9ae6-4849-8fea-7203954427d4\") " pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:10:48.677208 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:48.676795    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8xd6\" (UniqueName: \"kubernetes.io/projected/7982c9f0-9ae6-4849-8fea-7203954427d4-kube-api-access-l8xd6\") pod \"feast-driver-ranking-df795b458-58lcz\" (UID: \"7982c9f0-9ae6-4849-8fea-7203954427d4\") " pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:10:48.677208 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:10:48.676915    2586 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-online-tls: secret "feast-driver-ranking-online-tls" not found
Sep 15 08:10:48.677208 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:48.676967    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7982c9f0-9ae6-4849-8fea-7203954427d4-feast-data\") pod \"feast-driver-ranking-df795b458-58lcz\" (UID: \"7982c9f0-9ae6-4849-8fea-7203954427d4\") " pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:10:48.677208 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:10:48.676999    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7982c9f0-9ae6-4849-8fea-7203954427d4-online-tls podName:7982c9f0-9ae6-4849-8fea-7203954427d4 nodeName:}" failed. No retries permitted until 2026-09-15 08:10:49.1769776 +0000 UTC m=+1201.968440301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/7982c9f0-9ae6-4849-8fea-7203954427d4-online-tls") pod "feast-driver-ranking-df795b458-58lcz" (UID: "7982c9f0-9ae6-4849-8fea-7203954427d4") : secret "feast-driver-ranking-online-tls" not found
Sep 15 08:10:48.677208 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:48.677042    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7982c9f0-9ae6-4849-8fea-7203954427d4-registry-tls\") pod \"feast-driver-ranking-df795b458-58lcz\" (UID: \"7982c9f0-9ae6-4849-8fea-7203954427d4\") " pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:10:48.677208 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:10:48.677100    2586 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-registry-tls: secret "feast-driver-ranking-registry-tls" not found
Sep 15 08:10:48.677208 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:10:48.677160    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7982c9f0-9ae6-4849-8fea-7203954427d4-registry-tls podName:7982c9f0-9ae6-4849-8fea-7203954427d4 nodeName:}" failed. No retries permitted until 2026-09-15 08:10:49.17714727 +0000 UTC m=+1201.968609971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/7982c9f0-9ae6-4849-8fea-7203954427d4-registry-tls") pod "feast-driver-ranking-df795b458-58lcz" (UID: "7982c9f0-9ae6-4849-8fea-7203954427d4") : secret "feast-driver-ranking-registry-tls" not found
Sep 15 08:10:48.677461 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:48.677290    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7982c9f0-9ae6-4849-8fea-7203954427d4-feast-data\") pod \"feast-driver-ranking-df795b458-58lcz\" (UID: \"7982c9f0-9ae6-4849-8fea-7203954427d4\") " pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:10:48.685048 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:48.685021    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8xd6\" (UniqueName: \"kubernetes.io/projected/7982c9f0-9ae6-4849-8fea-7203954427d4-kube-api-access-l8xd6\") pod \"feast-driver-ranking-df795b458-58lcz\" (UID: \"7982c9f0-9ae6-4849-8fea-7203954427d4\") " pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:10:48.987885 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:48.987850    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:10:49.088743 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:49.088705    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:10:49.180590 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:49.180557    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7982c9f0-9ae6-4849-8fea-7203954427d4-registry-tls\") pod \"feast-driver-ranking-df795b458-58lcz\" (UID: \"7982c9f0-9ae6-4849-8fea-7203954427d4\") " pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:10:49.180792 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:49.180597    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7982c9f0-9ae6-4849-8fea-7203954427d4-online-tls\") pod \"feast-driver-ranking-df795b458-58lcz\" (UID: \"7982c9f0-9ae6-4849-8fea-7203954427d4\") " pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:10:49.183030 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:49.183004    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7982c9f0-9ae6-4849-8fea-7203954427d4-registry-tls\") pod \"feast-driver-ranking-df795b458-58lcz\" (UID: \"7982c9f0-9ae6-4849-8fea-7203954427d4\") " pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:10:49.183175 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:49.183153    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7982c9f0-9ae6-4849-8fea-7203954427d4-online-tls\") pod \"feast-driver-ranking-df795b458-58lcz\" (UID: \"7982c9f0-9ae6-4849-8fea-7203954427d4\") " pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:10:49.467394 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:49.467342    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:10:49.750438 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:49.750411    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"]
Sep 15 08:10:49.751883 ip-10-0-134-189 kubenswrapper[2586]: W0915 08:10:49.751860    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7982c9f0_9ae6_4849_8fea_7203954427d4.slice/crio-1667ffd458553978c0877d00dba65892d4d22a574d315ec56a7734fa7b986a56 WatchSource:0}: Error finding container 1667ffd458553978c0877d00dba65892d4d22a574d315ec56a7734fa7b986a56: Status 404 returned error can't find the container with id 1667ffd458553978c0877d00dba65892d4d22a574d315ec56a7734fa7b986a56
Sep 15 08:10:50.502937 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:50.502902    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" event={"ID":"7982c9f0-9ae6-4849-8fea-7203954427d4","Type":"ContainerStarted","Data":"73610525df511f4b6245758fa6210725a9e40d6659b3ca8acae910eeef39a496"}
Sep 15 08:10:50.503106 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:50.502959    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" event={"ID":"7982c9f0-9ae6-4849-8fea-7203954427d4","Type":"ContainerStarted","Data":"1667ffd458553978c0877d00dba65892d4d22a574d315ec56a7734fa7b986a56"}
Sep 15 08:10:55.523866 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:55.523833    2586 generic.go:356] "Generic (PLEG): container finished" podID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerID="73610525df511f4b6245758fa6210725a9e40d6659b3ca8acae910eeef39a496" exitCode=0
Sep 15 08:10:55.524262 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:55.523918    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" event={"ID":"7982c9f0-9ae6-4849-8fea-7203954427d4","Type":"ContainerDied","Data":"73610525df511f4b6245758fa6210725a9e40d6659b3ca8acae910eeef39a496"}
Sep 15 08:10:56.530460 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:10:56.530424    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" event={"ID":"7982c9f0-9ae6-4849-8fea-7203954427d4","Type":"ContainerStarted","Data":"16d5263fc8d0a541e2826b9b0c08b2fb30ec02c8b9a33cf45d2e748e5556089a"}
Sep 15 08:11:02.557343 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:11:02.557308    2586 generic.go:356] "Generic (PLEG): container finished" podID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerID="16d5263fc8d0a541e2826b9b0c08b2fb30ec02c8b9a33cf45d2e748e5556089a" exitCode=0
Sep 15 08:11:02.557733 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:11:02.557383    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" event={"ID":"7982c9f0-9ae6-4849-8fea-7203954427d4","Type":"ContainerDied","Data":"16d5263fc8d0a541e2826b9b0c08b2fb30ec02c8b9a33cf45d2e748e5556089a"}
Sep 15 08:11:03.564218 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:11:03.564178    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" event={"ID":"7982c9f0-9ae6-4849-8fea-7203954427d4","Type":"ContainerStarted","Data":"d878fafe893062fc78b72ec7b746b575c3181974e72ac1d89cf34f4fe18ba3e6"}
Sep 15 08:11:03.564590 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:11:03.564264    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" event={"ID":"7982c9f0-9ae6-4849-8fea-7203954427d4","Type":"ContainerStarted","Data":"72394fb147a80bad819d0d3551b0f8382058d7df2794b8d6acf56d10833de2b6"}
Sep 15 08:11:03.585498 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:11:03.585448    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" podStartSLOduration=15.585430514 podStartE2EDuration="15.585430514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 08:10:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 08:11:03.583332534 +0000 UTC m=+1216.374795286" watchObservedRunningTime="2026-09-15 08:11:03.585430514 +0000 UTC m=+1216.376893237"
Sep 15 08:11:04.468447 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:11:04.468406    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:11:04.468672 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:11:04.468485    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:11:04.470050 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:11:04.470013    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
Sep 15 08:11:04.470193 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:11:04.470020    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Sep 15 08:11:06.085356 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:11:06.085318    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:11:07.467703 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:11:07.467663    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Sep 15 08:11:07.468138 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:11:07.467657    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
Sep 15 08:11:09.468365 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:11:09.468325    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:11:09.468887 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:11:09.468399    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:11:10.468395 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:11:10.468349    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
Sep 15 08:11:10.474508 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:11:10.474482    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:11:10.477905 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:11:10.477884    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:11:13.468488 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:11:13.468442    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
Sep 15 08:11:16.468361 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:11:16.468325    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:11:16.469106 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:11:16.469086    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:11:45.606924 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:11:45.606836    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:12:34.267831 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:34.267794    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:12:37.440873 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:37.440837    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:12:37.740600 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:37.740516    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5c47bfcdb4-h44fp"]
Sep 15 08:12:37.740760 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:37.740704    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-5c47bfcdb4-h44fp" podUID="3ab3ade1-2e38-4762-8eea-a507917e2aa6" containerName="manager" containerID="cri-o://a6af47ff3ea00a683727188280482a0a2dd8e4f0ade5d3740383a8f8946159d3" gracePeriod=10
Sep 15 08:12:37.745066 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:37.745036    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:12:37.964892 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:37.964853    2586 generic.go:356] "Generic (PLEG): container finished" podID="3ab3ade1-2e38-4762-8eea-a507917e2aa6" containerID="a6af47ff3ea00a683727188280482a0a2dd8e4f0ade5d3740383a8f8946159d3" exitCode=0
Sep 15 08:12:37.965087 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:37.964925    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5c47bfcdb4-h44fp" event={"ID":"3ab3ade1-2e38-4762-8eea-a507917e2aa6","Type":"ContainerDied","Data":"a6af47ff3ea00a683727188280482a0a2dd8e4f0ade5d3740383a8f8946159d3"}
Sep 15 08:12:37.986092 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:37.985286    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:12:38.010723 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:38.010694    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5c47bfcdb4-h44fp"
Sep 15 08:12:38.016410 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:38.016375    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"]
Sep 15 08:12:38.018398 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:38.016693    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerName="registry" containerID="cri-o://79a3580bc008c2d2aa59ba0c0318a2194076400f0e8cdd1c8d45cb8bb2284166" gracePeriod=30
Sep 15 08:12:38.018398 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:38.016903    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerName="online" containerID="cri-o://09f34e1734cf4fa8fab6b79638611d284d3b913139d5389dd15803ebc45628cc" gracePeriod=30
Sep 15 08:12:38.021313 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:38.021283    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"]
Sep 15 08:12:38.021574 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:38.021547    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerName="registry" containerID="cri-o://72394fb147a80bad819d0d3551b0f8382058d7df2794b8d6acf56d10833de2b6" gracePeriod=30
Sep 15 08:12:38.021699 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:38.021588    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerName="online" containerID="cri-o://d878fafe893062fc78b72ec7b746b575c3181974e72ac1d89cf34f4fe18ba3e6" gracePeriod=30
Sep 15 08:12:38.068652 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:38.068604    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:12:38.184563 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:38.184527    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ss8rn\" (UniqueName: \"kubernetes.io/projected/3ab3ade1-2e38-4762-8eea-a507917e2aa6-kube-api-access-ss8rn\") pod \"3ab3ade1-2e38-4762-8eea-a507917e2aa6\" (UID: \"3ab3ade1-2e38-4762-8eea-a507917e2aa6\") "
Sep 15 08:12:38.186628 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:38.186600    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ab3ade1-2e38-4762-8eea-a507917e2aa6-kube-api-access-ss8rn" (OuterVolumeSpecName: "kube-api-access-ss8rn") pod "3ab3ade1-2e38-4762-8eea-a507917e2aa6" (UID: "3ab3ade1-2e38-4762-8eea-a507917e2aa6"). InnerVolumeSpecName "kube-api-access-ss8rn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 08:12:38.285376 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:38.285285    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ss8rn\" (UniqueName: \"kubernetes.io/projected/3ab3ade1-2e38-4762-8eea-a507917e2aa6-kube-api-access-ss8rn\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:12:38.969369 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:38.969340    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5c47bfcdb4-h44fp" event={"ID":"3ab3ade1-2e38-4762-8eea-a507917e2aa6","Type":"ContainerDied","Data":"d9ee1ca1dac6803841b619f74eff1da65d663a87757c9ac634c1c102f032049b"}
Sep 15 08:12:38.969756 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:38.969406    2586 scope.go:117] "RemoveContainer" containerID="a6af47ff3ea00a683727188280482a0a2dd8e4f0ade5d3740383a8f8946159d3"
Sep 15 08:12:38.969756 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:38.969347    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5c47bfcdb4-h44fp"
Sep 15 08:12:38.971905 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:38.971881    2586 generic.go:356] "Generic (PLEG): container finished" podID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerID="09f34e1734cf4fa8fab6b79638611d284d3b913139d5389dd15803ebc45628cc" exitCode=0
Sep 15 08:12:38.971998 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:38.971929    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" event={"ID":"8e22c973-4bcb-4f80-bf1b-f858ccd44308","Type":"ContainerDied","Data":"09f34e1734cf4fa8fab6b79638611d284d3b913139d5389dd15803ebc45628cc"}
Sep 15 08:12:38.974770 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:38.974750    2586 generic.go:356] "Generic (PLEG): container finished" podID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerID="d878fafe893062fc78b72ec7b746b575c3181974e72ac1d89cf34f4fe18ba3e6" exitCode=0
Sep 15 08:12:38.974862 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:38.974793    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" event={"ID":"7982c9f0-9ae6-4849-8fea-7203954427d4","Type":"ContainerDied","Data":"d878fafe893062fc78b72ec7b746b575c3181974e72ac1d89cf34f4fe18ba3e6"}
Sep 15 08:12:38.991058 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:38.991037    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5c47bfcdb4-h44fp"]
Sep 15 08:12:38.994349 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:38.994328    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5c47bfcdb4-h44fp"]
Sep 15 08:12:39.249788 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.249755    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-d58mk"]
Sep 15 08:12:39.249982 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.249960    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-d58mk" podUID="ddbc4a6c-21ab-47ce-9100-d8325c9e01ba" containerName="postgres" containerID="cri-o://9a3f64dd08342adb86c6e0d6e8fab6d53b00fe140d03a6851da65b9f246593d8" gracePeriod=30
Sep 15 08:12:39.255310 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.255288    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-gv5pj"]
Sep 15 08:12:39.255455 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.255437    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-gv5pj" podUID="de17e4b2-5e31-40d3-ae65-0e5bf28c9f64" containerName="redis" containerID="cri-o://a94db75fcdabab91c478936327c9c2d0a4264b3590202f6eeae57f4ed017e950" gracePeriod=30
Sep 15 08:12:39.338312 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.338279    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:12:39.508164 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.508138    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-d58mk"
Sep 15 08:12:39.511356 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.511319    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-gv5pj"
Sep 15 08:12:39.697486 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.697448    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjqq2\" (UniqueName: \"kubernetes.io/projected/de17e4b2-5e31-40d3-ae65-0e5bf28c9f64-kube-api-access-vjqq2\") pod \"de17e4b2-5e31-40d3-ae65-0e5bf28c9f64\" (UID: \"de17e4b2-5e31-40d3-ae65-0e5bf28c9f64\") "
Sep 15 08:12:39.697699 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.697521    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f4st\" (UniqueName: \"kubernetes.io/projected/ddbc4a6c-21ab-47ce-9100-d8325c9e01ba-kube-api-access-6f4st\") pod \"ddbc4a6c-21ab-47ce-9100-d8325c9e01ba\" (UID: \"ddbc4a6c-21ab-47ce-9100-d8325c9e01ba\") "
Sep 15 08:12:39.697699 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.697653    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ddbc4a6c-21ab-47ce-9100-d8325c9e01ba-postgresdata\") pod \"ddbc4a6c-21ab-47ce-9100-d8325c9e01ba\" (UID: \"ddbc4a6c-21ab-47ce-9100-d8325c9e01ba\") "
Sep 15 08:12:39.699816 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.699785    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de17e4b2-5e31-40d3-ae65-0e5bf28c9f64-kube-api-access-vjqq2" (OuterVolumeSpecName: "kube-api-access-vjqq2") pod "de17e4b2-5e31-40d3-ae65-0e5bf28c9f64" (UID: "de17e4b2-5e31-40d3-ae65-0e5bf28c9f64"). InnerVolumeSpecName "kube-api-access-vjqq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 08:12:39.699816 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.699806    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddbc4a6c-21ab-47ce-9100-d8325c9e01ba-kube-api-access-6f4st" (OuterVolumeSpecName: "kube-api-access-6f4st") pod "ddbc4a6c-21ab-47ce-9100-d8325c9e01ba" (UID: "ddbc4a6c-21ab-47ce-9100-d8325c9e01ba"). InnerVolumeSpecName "kube-api-access-6f4st". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 08:12:39.719912 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.719886    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ab3ade1-2e38-4762-8eea-a507917e2aa6" path="/var/lib/kubelet/pods/3ab3ade1-2e38-4762-8eea-a507917e2aa6/volumes"
Sep 15 08:12:39.727696 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.727668    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddbc4a6c-21ab-47ce-9100-d8325c9e01ba-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "ddbc4a6c-21ab-47ce-9100-d8325c9e01ba" (UID: "ddbc4a6c-21ab-47ce-9100-d8325c9e01ba"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 08:12:39.798851 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.798787    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjqq2\" (UniqueName: \"kubernetes.io/projected/de17e4b2-5e31-40d3-ae65-0e5bf28c9f64-kube-api-access-vjqq2\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:12:39.798851 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.798813    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f4st\" (UniqueName: \"kubernetes.io/projected/ddbc4a6c-21ab-47ce-9100-d8325c9e01ba-kube-api-access-6f4st\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:12:39.798851 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.798822    2586 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ddbc4a6c-21ab-47ce-9100-d8325c9e01ba-postgresdata\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:12:39.979849 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.979817    2586 generic.go:356] "Generic (PLEG): container finished" podID="ddbc4a6c-21ab-47ce-9100-d8325c9e01ba" containerID="9a3f64dd08342adb86c6e0d6e8fab6d53b00fe140d03a6851da65b9f246593d8" exitCode=0
Sep 15 08:12:39.980273 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.979864    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-d58mk"
Sep 15 08:12:39.980273 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.979865    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-d58mk" event={"ID":"ddbc4a6c-21ab-47ce-9100-d8325c9e01ba","Type":"ContainerDied","Data":"9a3f64dd08342adb86c6e0d6e8fab6d53b00fe140d03a6851da65b9f246593d8"}
Sep 15 08:12:39.980273 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.979974    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-d58mk" event={"ID":"ddbc4a6c-21ab-47ce-9100-d8325c9e01ba","Type":"ContainerDied","Data":"ab6609b4eb766333f0579ffef12c1d6ce8383bef819189567f41d6e0f6d21227"}
Sep 15 08:12:39.980273 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.980010    2586 scope.go:117] "RemoveContainer" containerID="9a3f64dd08342adb86c6e0d6e8fab6d53b00fe140d03a6851da65b9f246593d8"
Sep 15 08:12:39.981292 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.981222    2586 generic.go:356] "Generic (PLEG): container finished" podID="de17e4b2-5e31-40d3-ae65-0e5bf28c9f64" containerID="a94db75fcdabab91c478936327c9c2d0a4264b3590202f6eeae57f4ed017e950" exitCode=0
Sep 15 08:12:39.981292 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.981264    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-gv5pj"
Sep 15 08:12:39.981400 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.981315    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-gv5pj" event={"ID":"de17e4b2-5e31-40d3-ae65-0e5bf28c9f64","Type":"ContainerDied","Data":"a94db75fcdabab91c478936327c9c2d0a4264b3590202f6eeae57f4ed017e950"}
Sep 15 08:12:39.981400 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.981341    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-gv5pj" event={"ID":"de17e4b2-5e31-40d3-ae65-0e5bf28c9f64","Type":"ContainerDied","Data":"85e081ba7e12c0f1091a1c2620fe70987bdcd31648db9b2d9a77cf24a0242738"}
Sep 15 08:12:39.988744 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.988724    2586 scope.go:117] "RemoveContainer" containerID="9a3f64dd08342adb86c6e0d6e8fab6d53b00fe140d03a6851da65b9f246593d8"
Sep 15 08:12:39.989047 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:12:39.989026    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a3f64dd08342adb86c6e0d6e8fab6d53b00fe140d03a6851da65b9f246593d8\": container with ID starting with 9a3f64dd08342adb86c6e0d6e8fab6d53b00fe140d03a6851da65b9f246593d8 not found: ID does not exist" containerID="9a3f64dd08342adb86c6e0d6e8fab6d53b00fe140d03a6851da65b9f246593d8"
Sep 15 08:12:39.989142 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.989058    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a3f64dd08342adb86c6e0d6e8fab6d53b00fe140d03a6851da65b9f246593d8"} err="failed to get container status \"9a3f64dd08342adb86c6e0d6e8fab6d53b00fe140d03a6851da65b9f246593d8\": rpc error: code = NotFound desc = could not find container \"9a3f64dd08342adb86c6e0d6e8fab6d53b00fe140d03a6851da65b9f246593d8\": container with ID starting with 9a3f64dd08342adb86c6e0d6e8fab6d53b00fe140d03a6851da65b9f246593d8 not found: ID does not exist"
Sep 15 08:12:39.989142 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.989082    2586 scope.go:117] "RemoveContainer" containerID="a94db75fcdabab91c478936327c9c2d0a4264b3590202f6eeae57f4ed017e950"
Sep 15 08:12:39.996265 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.996100    2586 scope.go:117] "RemoveContainer" containerID="a94db75fcdabab91c478936327c9c2d0a4264b3590202f6eeae57f4ed017e950"
Sep 15 08:12:39.996518 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:12:39.996495    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a94db75fcdabab91c478936327c9c2d0a4264b3590202f6eeae57f4ed017e950\": container with ID starting with a94db75fcdabab91c478936327c9c2d0a4264b3590202f6eeae57f4ed017e950 not found: ID does not exist" containerID="a94db75fcdabab91c478936327c9c2d0a4264b3590202f6eeae57f4ed017e950"
Sep 15 08:12:39.996574 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.996529    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a94db75fcdabab91c478936327c9c2d0a4264b3590202f6eeae57f4ed017e950"} err="failed to get container status \"a94db75fcdabab91c478936327c9c2d0a4264b3590202f6eeae57f4ed017e950\": rpc error: code = NotFound desc = could not find container \"a94db75fcdabab91c478936327c9c2d0a4264b3590202f6eeae57f4ed017e950\": container with ID starting with a94db75fcdabab91c478936327c9c2d0a4264b3590202f6eeae57f4ed017e950 not found: ID does not exist"
Sep 15 08:12:39.997820 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:39.997802    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-gv5pj"]
Sep 15 08:12:40.004269 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:40.004247    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-gv5pj"]
Sep 15 08:12:40.014501 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:40.014477    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-d58mk"]
Sep 15 08:12:40.016968 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:40.016950    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-d58mk"]
Sep 15 08:12:40.475948 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:40.475910    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Sep 15 08:12:41.654099 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:41.654060    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Sep 15 08:12:41.719790 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:41.719744    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddbc4a6c-21ab-47ce-9100-d8325c9e01ba" path="/var/lib/kubelet/pods/ddbc4a6c-21ab-47ce-9100-d8325c9e01ba/volumes"
Sep 15 08:12:41.720146 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:41.720127    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de17e4b2-5e31-40d3-ae65-0e5bf28c9f64" path="/var/lib/kubelet/pods/de17e4b2-5e31-40d3-ae65-0e5bf28c9f64/volumes"
Sep 15 08:12:42.969434 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:42.969400    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:12:43.025708 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:43.025679    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:12:49.162349 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:49.162314    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-g72mw"]
Sep 15 08:12:49.162748 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:49.162616    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddbc4a6c-21ab-47ce-9100-d8325c9e01ba" containerName="postgres"
Sep 15 08:12:49.162748 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:49.162626    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddbc4a6c-21ab-47ce-9100-d8325c9e01ba" containerName="postgres"
Sep 15 08:12:49.162748 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:49.162655    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ab3ade1-2e38-4762-8eea-a507917e2aa6" containerName="manager"
Sep 15 08:12:49.162748 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:49.162661    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ab3ade1-2e38-4762-8eea-a507917e2aa6" containerName="manager"
Sep 15 08:12:49.162748 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:49.162672    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de17e4b2-5e31-40d3-ae65-0e5bf28c9f64" containerName="redis"
Sep 15 08:12:49.162748 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:49.162678    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="de17e4b2-5e31-40d3-ae65-0e5bf28c9f64" containerName="redis"
Sep 15 08:12:49.162748 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:49.162721    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddbc4a6c-21ab-47ce-9100-d8325c9e01ba" containerName="postgres"
Sep 15 08:12:49.162748 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:49.162728    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="de17e4b2-5e31-40d3-ae65-0e5bf28c9f64" containerName="redis"
Sep 15 08:12:49.162748 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:49.162736    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ab3ade1-2e38-4762-8eea-a507917e2aa6" containerName="manager"
Sep 15 08:12:49.166778 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:49.166749    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g72mw"
Sep 15 08:12:49.171778 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:49.171759    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Sep 15 08:12:49.171885 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:49.171760    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-sjjmp\""
Sep 15 08:12:49.172772 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:49.172447    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Sep 15 08:12:49.190934 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:49.190910    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-g72mw"]
Sep 15 08:12:49.266250 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:49.266215    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69sgq\" (UniqueName: \"kubernetes.io/projected/0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27-kube-api-access-69sgq\") pod \"feast-operator-controller-manager-689b877b4b-g72mw\" (UID: \"0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g72mw"
Sep 15 08:12:49.367230 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:49.367198    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69sgq\" (UniqueName: \"kubernetes.io/projected/0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27-kube-api-access-69sgq\") pod \"feast-operator-controller-manager-689b877b4b-g72mw\" (UID: \"0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g72mw"
Sep 15 08:12:49.375997 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:49.375969    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69sgq\" (UniqueName: \"kubernetes.io/projected/0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27-kube-api-access-69sgq\") pod \"feast-operator-controller-manager-689b877b4b-g72mw\" (UID: \"0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g72mw"
Sep 15 08:12:49.476265 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:49.476184    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g72mw"
Sep 15 08:12:49.745526 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:49.745498    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-g72mw"]
Sep 15 08:12:49.747892 ip-10-0-134-189 kubenswrapper[2586]: W0915 08:12:49.747864    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b8cc0ac_88ee_41d3_918e_ab0b3f8cda27.slice/crio-f6740489dbf70a68284509b893682d1df9ac87638d50351618caf8998ebdf292 WatchSource:0}: Error finding container f6740489dbf70a68284509b893682d1df9ac87638d50351618caf8998ebdf292: Status 404 returned error can't find the container with id f6740489dbf70a68284509b893682d1df9ac87638d50351618caf8998ebdf292
Sep 15 08:12:50.025953 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:50.025867    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g72mw" event={"ID":"0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27","Type":"ContainerStarted","Data":"f6740489dbf70a68284509b893682d1df9ac87638d50351618caf8998ebdf292"}
Sep 15 08:12:50.443654 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:50.443608    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:12:50.475602 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:50.475565    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Sep 15 08:12:50.495979 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:50.495933    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:12:51.654479 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:51.654441    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Sep 15 08:12:53.040473 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:53.040429    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g72mw" event={"ID":"0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27","Type":"ContainerStarted","Data":"ddb1285546481c0016fcd6ffe0dd094ffd758f9567edc6be9d084b9f7bf68676"}
Sep 15 08:12:53.040933 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:53.040573    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g72mw"
Sep 15 08:12:53.058225 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:12:53.058180    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g72mw" podStartSLOduration=1.7537568970000001 podStartE2EDuration="4.058165282s" totalImagesPullingTime="2.304408385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 08:12:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 08:12:53.056770822 +0000 UTC m=+1325.848233546" watchObservedRunningTime="2026-09-15 08:12:53.058165282 +0000 UTC m=+1325.849628005"
Sep 15 08:13:00.475903 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:00.475862    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Sep 15 08:13:00.476303 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:00.475986    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:13:01.655022 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:01.654976    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Sep 15 08:13:01.655400 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:01.655111    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:13:04.047860 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:04.047828    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g72mw"
Sep 15 08:13:05.390305 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:05.390272    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:13:05.491350 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:05.491316    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:13:08.100923 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.100894    2586 generic.go:356] "Generic (PLEG): container finished" podID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerID="79a3580bc008c2d2aa59ba0c0318a2194076400f0e8cdd1c8d45cb8bb2284166" exitCode=137
Sep 15 08:13:08.101216 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.100963    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" event={"ID":"8e22c973-4bcb-4f80-bf1b-f858ccd44308","Type":"ContainerDied","Data":"79a3580bc008c2d2aa59ba0c0318a2194076400f0e8cdd1c8d45cb8bb2284166"}
Sep 15 08:13:08.103343 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.103322    2586 generic.go:356] "Generic (PLEG): container finished" podID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerID="72394fb147a80bad819d0d3551b0f8382058d7df2794b8d6acf56d10833de2b6" exitCode=137
Sep 15 08:13:08.103430 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.103393    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" event={"ID":"7982c9f0-9ae6-4849-8fea-7203954427d4","Type":"ContainerDied","Data":"72394fb147a80bad819d0d3551b0f8382058d7df2794b8d6acf56d10833de2b6"}
Sep 15 08:13:08.693417 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.693393    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:13:08.695941 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.695923    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:13:08.820151 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.820059    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8e22c973-4bcb-4f80-bf1b-f858ccd44308-feast-data\") pod \"8e22c973-4bcb-4f80-bf1b-f858ccd44308\" (UID: \"8e22c973-4bcb-4f80-bf1b-f858ccd44308\") "
Sep 15 08:13:08.820151 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.820110    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7982c9f0-9ae6-4849-8fea-7203954427d4-online-tls\") pod \"7982c9f0-9ae6-4849-8fea-7203954427d4\" (UID: \"7982c9f0-9ae6-4849-8fea-7203954427d4\") "
Sep 15 08:13:08.820151 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.820137    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8xd6\" (UniqueName: \"kubernetes.io/projected/7982c9f0-9ae6-4849-8fea-7203954427d4-kube-api-access-l8xd6\") pod \"7982c9f0-9ae6-4849-8fea-7203954427d4\" (UID: \"7982c9f0-9ae6-4849-8fea-7203954427d4\") "
Sep 15 08:13:08.820435 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.820162    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p64cv\" (UniqueName: \"kubernetes.io/projected/8e22c973-4bcb-4f80-bf1b-f858ccd44308-kube-api-access-p64cv\") pod \"8e22c973-4bcb-4f80-bf1b-f858ccd44308\" (UID: \"8e22c973-4bcb-4f80-bf1b-f858ccd44308\") "
Sep 15 08:13:08.820435 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.820182    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7982c9f0-9ae6-4849-8fea-7203954427d4-feast-data\") pod \"7982c9f0-9ae6-4849-8fea-7203954427d4\" (UID: \"7982c9f0-9ae6-4849-8fea-7203954427d4\") "
Sep 15 08:13:08.820435 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.820202    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7982c9f0-9ae6-4849-8fea-7203954427d4-registry-tls\") pod \"7982c9f0-9ae6-4849-8fea-7203954427d4\" (UID: \"7982c9f0-9ae6-4849-8fea-7203954427d4\") "
Sep 15 08:13:08.820435 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.820232    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8e22c973-4bcb-4f80-bf1b-f858ccd44308-registry-tls\") pod \"8e22c973-4bcb-4f80-bf1b-f858ccd44308\" (UID: \"8e22c973-4bcb-4f80-bf1b-f858ccd44308\") "
Sep 15 08:13:08.820435 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.820261    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8e22c973-4bcb-4f80-bf1b-f858ccd44308-online-tls\") pod \"8e22c973-4bcb-4f80-bf1b-f858ccd44308\" (UID: \"8e22c973-4bcb-4f80-bf1b-f858ccd44308\") "
Sep 15 08:13:08.820793 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.820765    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7982c9f0-9ae6-4849-8fea-7203954427d4-feast-data" (OuterVolumeSpecName: "feast-data") pod "7982c9f0-9ae6-4849-8fea-7203954427d4" (UID: "7982c9f0-9ae6-4849-8fea-7203954427d4"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 08:13:08.822587 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.822555    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7982c9f0-9ae6-4849-8fea-7203954427d4-kube-api-access-l8xd6" (OuterVolumeSpecName: "kube-api-access-l8xd6") pod "7982c9f0-9ae6-4849-8fea-7203954427d4" (UID: "7982c9f0-9ae6-4849-8fea-7203954427d4"). InnerVolumeSpecName "kube-api-access-l8xd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 08:13:08.822912 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.822873    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7982c9f0-9ae6-4849-8fea-7203954427d4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7982c9f0-9ae6-4849-8fea-7203954427d4" (UID: "7982c9f0-9ae6-4849-8fea-7203954427d4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:13:08.822912 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.822894    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7982c9f0-9ae6-4849-8fea-7203954427d4-online-tls" (OuterVolumeSpecName: "online-tls") pod "7982c9f0-9ae6-4849-8fea-7203954427d4" (UID: "7982c9f0-9ae6-4849-8fea-7203954427d4"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:13:08.823055 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.822886    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e22c973-4bcb-4f80-bf1b-f858ccd44308-kube-api-access-p64cv" (OuterVolumeSpecName: "kube-api-access-p64cv") pod "8e22c973-4bcb-4f80-bf1b-f858ccd44308" (UID: "8e22c973-4bcb-4f80-bf1b-f858ccd44308"). InnerVolumeSpecName "kube-api-access-p64cv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 08:13:08.823055 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.823034    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e22c973-4bcb-4f80-bf1b-f858ccd44308-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8e22c973-4bcb-4f80-bf1b-f858ccd44308" (UID: "8e22c973-4bcb-4f80-bf1b-f858ccd44308"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:13:08.823130 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.823058    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e22c973-4bcb-4f80-bf1b-f858ccd44308-online-tls" (OuterVolumeSpecName: "online-tls") pod "8e22c973-4bcb-4f80-bf1b-f858ccd44308" (UID: "8e22c973-4bcb-4f80-bf1b-f858ccd44308"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:13:08.829329 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.829309    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e22c973-4bcb-4f80-bf1b-f858ccd44308-feast-data" (OuterVolumeSpecName: "feast-data") pod "8e22c973-4bcb-4f80-bf1b-f858ccd44308" (UID: "8e22c973-4bcb-4f80-bf1b-f858ccd44308"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 08:13:08.921897 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.921863    2586 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8e22c973-4bcb-4f80-bf1b-f858ccd44308-feast-data\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:13:08.921897 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.921893    2586 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7982c9f0-9ae6-4849-8fea-7203954427d4-online-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:13:08.922088 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.921905    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8xd6\" (UniqueName: \"kubernetes.io/projected/7982c9f0-9ae6-4849-8fea-7203954427d4-kube-api-access-l8xd6\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:13:08.922088 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.921920    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p64cv\" (UniqueName: \"kubernetes.io/projected/8e22c973-4bcb-4f80-bf1b-f858ccd44308-kube-api-access-p64cv\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:13:08.922088 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.921932    2586 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7982c9f0-9ae6-4849-8fea-7203954427d4-feast-data\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:13:08.922088 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.921943    2586 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7982c9f0-9ae6-4849-8fea-7203954427d4-registry-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:13:08.922088 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.921953    2586 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8e22c973-4bcb-4f80-bf1b-f858ccd44308-registry-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:13:08.922088 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:08.921963    2586 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8e22c973-4bcb-4f80-bf1b-f858ccd44308-online-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:13:09.109797 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:09.109771    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"
Sep 15 08:13:09.109797 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:09.109776    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx" event={"ID":"8e22c973-4bcb-4f80-bf1b-f858ccd44308","Type":"ContainerDied","Data":"3c1113514931866b2e866d59c2d40c6c79a533ea58090f33a7a81b6ea9db9cbb"}
Sep 15 08:13:09.110298 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:09.109837    2586 scope.go:117] "RemoveContainer" containerID="09f34e1734cf4fa8fab6b79638611d284d3b913139d5389dd15803ebc45628cc"
Sep 15 08:13:09.112116 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:09.112096    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz" event={"ID":"7982c9f0-9ae6-4849-8fea-7203954427d4","Type":"ContainerDied","Data":"1667ffd458553978c0877d00dba65892d4d22a574d315ec56a7734fa7b986a56"}
Sep 15 08:13:09.112219 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:09.112115    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"
Sep 15 08:13:09.121739 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:09.121719    2586 scope.go:117] "RemoveContainer" containerID="79a3580bc008c2d2aa59ba0c0318a2194076400f0e8cdd1c8d45cb8bb2284166"
Sep 15 08:13:09.129840 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:09.129822    2586 scope.go:117] "RemoveContainer" containerID="3cf0ace06cf044040629aabb34067e7d3fcc3f9bb21d9611d214aec4b066b555"
Sep 15 08:13:09.136837 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:09.136817    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"]
Sep 15 08:13:09.137192 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:09.137179    2586 scope.go:117] "RemoveContainer" containerID="ed6bf6a544d815c228d339e6ca6bf53be41ceb8d9de18882cda5fd106e227f31"
Sep 15 08:13:09.142931 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:09.142908    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-df795b458-58lcz"]
Sep 15 08:13:09.144696 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:09.144679    2586 scope.go:117] "RemoveContainer" containerID="d878fafe893062fc78b72ec7b746b575c3181974e72ac1d89cf34f4fe18ba3e6"
Sep 15 08:13:09.151884 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:09.151863    2586 scope.go:117] "RemoveContainer" containerID="72394fb147a80bad819d0d3551b0f8382058d7df2794b8d6acf56d10833de2b6"
Sep 15 08:13:09.158620 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:09.158583    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"]
Sep 15 08:13:09.159379 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:09.159360    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6749fd6d9-vh8kx"]
Sep 15 08:13:09.165622 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:09.165593    2586 scope.go:117] "RemoveContainer" containerID="16d5263fc8d0a541e2826b9b0c08b2fb30ec02c8b9a33cf45d2e748e5556089a"
Sep 15 08:13:09.172560 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:09.172543    2586 scope.go:117] "RemoveContainer" containerID="73610525df511f4b6245758fa6210725a9e40d6659b3ca8acae910eeef39a496"
Sep 15 08:13:09.720694 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:09.720658    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" path="/var/lib/kubelet/pods/7982c9f0-9ae6-4849-8fea-7203954427d4/volumes"
Sep 15 08:13:09.721161 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:09.721148    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" path="/var/lib/kubelet/pods/8e22c973-4bcb-4f80-bf1b-f858ccd44308/volumes"
Sep 15 08:13:11.465295 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.465263    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:13:11.564104 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.564071    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:13:11.576108 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.576077    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"]
Sep 15 08:13:11.576355 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.576343    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerName="feast-apply"
Sep 15 08:13:11.576405 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.576357    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerName="feast-apply"
Sep 15 08:13:11.576405 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.576368    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerName="feast-apply"
Sep 15 08:13:11.576405 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.576374    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerName="feast-apply"
Sep 15 08:13:11.576405 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.576381    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerName="online"
Sep 15 08:13:11.576405 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.576386    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerName="online"
Sep 15 08:13:11.576405 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.576398    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerName="feast-init"
Sep 15 08:13:11.576405 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.576403    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerName="feast-init"
Sep 15 08:13:11.576610 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.576413    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerName="registry"
Sep 15 08:13:11.576610 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.576419    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerName="registry"
Sep 15 08:13:11.576610 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.576429    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerName="online"
Sep 15 08:13:11.576610 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.576434    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerName="online"
Sep 15 08:13:11.576610 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.576441    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerName="feast-init"
Sep 15 08:13:11.576610 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.576447    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerName="feast-init"
Sep 15 08:13:11.576610 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.576453    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerName="registry"
Sep 15 08:13:11.576610 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.576457    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerName="registry"
Sep 15 08:13:11.576610 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.576500    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerName="registry"
Sep 15 08:13:11.576610 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.576509    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="7982c9f0-9ae6-4849-8fea-7203954427d4" containerName="online"
Sep 15 08:13:11.576610 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.576515    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerName="online"
Sep 15 08:13:11.576610 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.576520    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e22c973-4bcb-4f80-bf1b-f858ccd44308" containerName="registry"
Sep 15 08:13:11.581250 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.581232    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:11.583605 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.583582    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 15 08:13:11.583744 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.583660    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 15 08:13:11.583814 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.583754    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 15 08:13:11.583909 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.583882    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-bp2gf\""
Sep 15 08:13:11.584004 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.583989    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 15 08:13:11.584450 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.584438    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 15 08:13:11.584508 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.584443    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 15 08:13:11.593527 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.593506    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"]
Sep 15 08:13:11.642805 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.642773    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:13:11.645850 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.645828    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pg675\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:11.645960 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.645854    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pg675\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:11.645960 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.645884    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9xqr\" (UniqueName: \"kubernetes.io/projected/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-kube-api-access-s9xqr\") pod \"feast-simple-feast-setup-57576b8fcf-pg675\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:11.645960 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.645951    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-pg675\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:11.646069 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.645985    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pg675\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:11.646069 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.646003    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pg675\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:11.736684 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.736583    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:13:11.746745 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.746719    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9xqr\" (UniqueName: \"kubernetes.io/projected/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-kube-api-access-s9xqr\") pod \"feast-simple-feast-setup-57576b8fcf-pg675\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:11.746817 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.746763    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-pg675\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:11.746817 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.746792    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pg675\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:11.746817 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.746808    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pg675\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:11.746967 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.746841    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pg675\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:11.746967 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.746854    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pg675\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:11.747327 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.747296    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-pg675\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:11.749349 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.749319    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pg675\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:11.749472 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.749453    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pg675\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:11.749610 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.749591    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pg675\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:11.749676 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.749591    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pg675\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:11.754740 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.754718    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9xqr\" (UniqueName: \"kubernetes.io/projected/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-kube-api-access-s9xqr\") pod \"feast-simple-feast-setup-57576b8fcf-pg675\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:11.838172 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.838139    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:13:11.902257 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:11.902224    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:12.177156 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:12.177124    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"]
Sep 15 08:13:12.179951 ip-10-0-134-189 kubenswrapper[2586]: W0915 08:13:12.179927    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ffd7dab_f2dc_4af2_94a6_4a271ba2894b.slice/crio-fec0df459f75c044d1ce27c58723c801a08195c153cd42b81e84dcdd42ee738e WatchSource:0}: Error finding container fec0df459f75c044d1ce27c58723c801a08195c153cd42b81e84dcdd42ee738e: Status 404 returned error can't find the container with id fec0df459f75c044d1ce27c58723c801a08195c153cd42b81e84dcdd42ee738e
Sep 15 08:13:13.130222 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:13.130189    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" event={"ID":"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b","Type":"ContainerStarted","Data":"fec0df459f75c044d1ce27c58723c801a08195c153cd42b81e84dcdd42ee738e"}
Sep 15 08:13:16.467525 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:16.467487    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:13:17.847788 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:17.847752    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:13:17.906339 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:17.906301    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:13:27.202067 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:27.202031    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" event={"ID":"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b","Type":"ContainerStarted","Data":"d8674bce9e338789510136efc6b1b28ee14afd5af250ab0e1aa0f0df5d2e5026"}
Sep 15 08:13:31.218047 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:31.218013    2586 generic.go:356] "Generic (PLEG): container finished" podID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerID="d8674bce9e338789510136efc6b1b28ee14afd5af250ab0e1aa0f0df5d2e5026" exitCode=0
Sep 15 08:13:31.218447 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:31.218052    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" event={"ID":"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b","Type":"ContainerDied","Data":"d8674bce9e338789510136efc6b1b28ee14afd5af250ab0e1aa0f0df5d2e5026"}
Sep 15 08:13:32.224144 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:32.224108    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" event={"ID":"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b","Type":"ContainerStarted","Data":"dc7420309156f5372b4d8e8bd8dc5cc9f194f20d82426b6fa48389020bc4e225"}
Sep 15 08:13:35.132389 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:35.132351    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:13:37.246504 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:37.246471    2586 generic.go:356] "Generic (PLEG): container finished" podID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerID="dc7420309156f5372b4d8e8bd8dc5cc9f194f20d82426b6fa48389020bc4e225" exitCode=0
Sep 15 08:13:37.246504 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:37.246510    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" event={"ID":"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b","Type":"ContainerDied","Data":"dc7420309156f5372b4d8e8bd8dc5cc9f194f20d82426b6fa48389020bc4e225"}
Sep 15 08:13:38.258152 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:38.258111    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" event={"ID":"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b","Type":"ContainerStarted","Data":"9cb33e64f4841d51e490f15b6431b5d6c08d8e04c0ef5446156b32f2a9a12e1c"}
Sep 15 08:13:38.258663 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:38.258170    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" event={"ID":"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b","Type":"ContainerStarted","Data":"248869a118e0dc1c90e78196a098a23ad1b7e618f89b828d1da72d852509bcb8"}
Sep 15 08:13:38.258663 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:38.258196    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" event={"ID":"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b","Type":"ContainerStarted","Data":"af1232530f1cc8bdc9499497b18c3984f3dde0cc67753acd7a9ce30022f2355c"}
Sep 15 08:13:38.258663 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:38.258214    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" event={"ID":"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b","Type":"ContainerStarted","Data":"38b766ccee66f09cd96c2de4639b54be17878525a93aa0fb804c484cf3c41581"}
Sep 15 08:13:38.285364 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:38.285277    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podStartSLOduration=13.284591311 podStartE2EDuration="27.285254507s" totalImagesPullingTime="14.000663196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 08:13:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 08:13:38.284194571 +0000 UTC m=+1371.075657296" watchObservedRunningTime="2026-09-15 08:13:38.285254507 +0000 UTC m=+1371.076717235"
Sep 15 08:13:38.902917 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:38.902873    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:38.903128 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:38.902962    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:38.903128 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:38.902987    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:38.903128 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:38.903017    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:38.905204 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:38.905152    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.32:8816: connect: connection refused"
Sep 15 08:13:38.905204 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:38.905185    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused"
Sep 15 08:13:38.905424 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:38.905217    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Sep 15 08:13:38.905424 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:38.905300    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Sep 15 08:13:41.903156 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:41.903112    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:41.903706 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:41.903428    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused"
Sep 15 08:13:41.903954 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:41.903473    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Sep 15 08:13:41.904118 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:41.903681    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.32:8816: connect: connection refused"
Sep 15 08:13:41.904326 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:41.903705    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:41.904435 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:41.904352    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:41.904435 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:41.904375    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:41.904435 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:41.903714    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Sep 15 08:13:44.903335 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:44.903281    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.32:8816: connect: connection refused"
Sep 15 08:13:44.903871 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:44.903349    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Sep 15 08:13:44.903871 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:44.903300    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Sep 15 08:13:44.903871 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:44.903283    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused"
Sep 15 08:13:47.904434 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:47.904405    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:47.904807 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:47.904568    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:47.904807 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:47.904782    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:47.905400 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:47.905376    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:47.905505 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:47.905449    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:47.905761 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:47.905745    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:47.909448 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:47.909432    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:13:48.309624 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:13:48.309593    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:14:50.292488 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.292387    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:14:50.302131 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.302098    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"]
Sep 15 08:14:50.302442 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.302404    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="offline" containerID="cri-o://248869a118e0dc1c90e78196a098a23ad1b7e618f89b828d1da72d852509bcb8" gracePeriod=30
Sep 15 08:14:50.302915 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.302402    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="ui" containerID="cri-o://9cb33e64f4841d51e490f15b6431b5d6c08d8e04c0ef5446156b32f2a9a12e1c" gracePeriod=30
Sep 15 08:14:50.302915 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.302786    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="registry" containerID="cri-o://38b766ccee66f09cd96c2de4639b54be17878525a93aa0fb804c484cf3c41581" gracePeriod=30
Sep 15 08:14:50.302915 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.302482    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="online" containerID="cri-o://af1232530f1cc8bdc9499497b18c3984f3dde0cc67753acd7a9ce30022f2355c" gracePeriod=30
Sep 15 08:14:50.392551 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.392493    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:14:50.591975 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.591936    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:14:50.693487 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.693453    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:14:50.697615 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.697584    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"]
Sep 15 08:14:50.701298 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.701281    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:50.703521 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.703498    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-wv4rq\""
Sep 15 08:14:50.712968 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.712942    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"]
Sep 15 08:14:50.768703 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.768665    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jhkwq\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:50.768904 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.768713    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jhkwq\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:50.768904 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.768732    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jhkwq\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:50.768904 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.768747    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/534489ba-579b-4133-bb4c-d4ce8b546a66-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-jhkwq\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:50.768904 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.768796    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqxl4\" (UniqueName: \"kubernetes.io/projected/534489ba-579b-4133-bb4c-d4ce8b546a66-kube-api-access-zqxl4\") pod \"feast-simple-feast-setup-57576b8fcf-jhkwq\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:50.769094 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.768900    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jhkwq\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:50.862838 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.862745    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:14:50.869666 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.869618    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jhkwq\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:50.869842 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.869726    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jhkwq\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:50.869842 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:14:50.869749    2586 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Sep 15 08:14:50.869842 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.869789    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jhkwq\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:50.869842 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:14:50.869817    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-online-tls podName:534489ba-579b-4133-bb4c-d4ce8b546a66 nodeName:}" failed. No retries permitted until 2026-09-15 08:14:51.369797778 +0000 UTC m=+1444.161260505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-online-tls") pod "feast-simple-feast-setup-57576b8fcf-jhkwq" (UID: "534489ba-579b-4133-bb4c-d4ce8b546a66") : secret "feast-simple-feast-setup-online-tls" not found
Sep 15 08:14:50.870067 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.869854    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jhkwq\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:50.870067 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.869879    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/534489ba-579b-4133-bb4c-d4ce8b546a66-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-jhkwq\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:50.870067 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.869916    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqxl4\" (UniqueName: \"kubernetes.io/projected/534489ba-579b-4133-bb4c-d4ce8b546a66-kube-api-access-zqxl4\") pod \"feast-simple-feast-setup-57576b8fcf-jhkwq\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:50.870067 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:14:50.869959    2586 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Sep 15 08:14:50.870067 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:14:50.870027    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-offline-tls podName:534489ba-579b-4133-bb4c-d4ce8b546a66 nodeName:}" failed. No retries permitted until 2026-09-15 08:14:51.370009527 +0000 UTC m=+1444.161472245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-offline-tls") pod "feast-simple-feast-setup-57576b8fcf-jhkwq" (UID: "534489ba-579b-4133-bb4c-d4ce8b546a66") : secret "feast-simple-feast-setup-offline-tls" not found
Sep 15 08:14:50.870435 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.870402    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/534489ba-579b-4133-bb4c-d4ce8b546a66-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-jhkwq\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:50.872405 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.872369    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jhkwq\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:50.872616 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.872595    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jhkwq\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:50.880287 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.880265    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqxl4\" (UniqueName: \"kubernetes.io/projected/534489ba-579b-4133-bb4c-d4ce8b546a66-kube-api-access-zqxl4\") pod \"feast-simple-feast-setup-57576b8fcf-jhkwq\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:50.963181 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:50.963149    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:14:51.063464 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:51.063426    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:14:51.120395 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:51.120327    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:14:51.374847 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:51.374748    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jhkwq\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:51.375231 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:51.374863    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jhkwq\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:51.377260 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:51.377237    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jhkwq\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:51.377340 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:51.377271    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-jhkwq\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:51.556979 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:51.556942    2586 generic.go:356] "Generic (PLEG): container finished" podID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerID="9cb33e64f4841d51e490f15b6431b5d6c08d8e04c0ef5446156b32f2a9a12e1c" exitCode=0
Sep 15 08:14:51.556979 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:51.556970    2586 generic.go:356] "Generic (PLEG): container finished" podID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerID="af1232530f1cc8bdc9499497b18c3984f3dde0cc67753acd7a9ce30022f2355c" exitCode=0
Sep 15 08:14:51.557186 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:51.557012    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" event={"ID":"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b","Type":"ContainerDied","Data":"9cb33e64f4841d51e490f15b6431b5d6c08d8e04c0ef5446156b32f2a9a12e1c"}
Sep 15 08:14:51.557186 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:51.557054    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" event={"ID":"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b","Type":"ContainerDied","Data":"af1232530f1cc8bdc9499497b18c3984f3dde0cc67753acd7a9ce30022f2355c"}
Sep 15 08:14:51.610616 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:51.610578    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:14:51.888932 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:51.888907    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"]
Sep 15 08:14:51.890350 ip-10-0-134-189 kubenswrapper[2586]: W0915 08:14:51.890326    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod534489ba_579b_4133_bb4c_d4ce8b546a66.slice/crio-be5e91e52e6f0d61c1a6409acf0b31527cdb4623f3ac867ebe605194cb9096f5 WatchSource:0}: Error finding container be5e91e52e6f0d61c1a6409acf0b31527cdb4623f3ac867ebe605194cb9096f5: Status 404 returned error can't find the container with id be5e91e52e6f0d61c1a6409acf0b31527cdb4623f3ac867ebe605194cb9096f5
Sep 15 08:14:52.563370 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:52.563332    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" event={"ID":"534489ba-579b-4133-bb4c-d4ce8b546a66","Type":"ContainerStarted","Data":"d3a8ed5b4179e375f62a4eef64e5286a5665c59bead07eb89008635349cda4ea"}
Sep 15 08:14:52.563782 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:52.563379    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" event={"ID":"534489ba-579b-4133-bb4c-d4ce8b546a66","Type":"ContainerStarted","Data":"be5e91e52e6f0d61c1a6409acf0b31527cdb4623f3ac867ebe605194cb9096f5"}
Sep 15 08:14:57.584955 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:57.584920    2586 generic.go:356] "Generic (PLEG): container finished" podID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerID="d3a8ed5b4179e375f62a4eef64e5286a5665c59bead07eb89008635349cda4ea" exitCode=0
Sep 15 08:14:57.585395 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:57.584983    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" event={"ID":"534489ba-579b-4133-bb4c-d4ce8b546a66","Type":"ContainerDied","Data":"d3a8ed5b4179e375f62a4eef64e5286a5665c59bead07eb89008635349cda4ea"}
Sep 15 08:14:57.905728 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:57.905601    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Sep 15 08:14:58.307534 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:58.307443    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Sep 15 08:14:58.591667 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:14:58.591617    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" event={"ID":"534489ba-579b-4133-bb4c-d4ce8b546a66","Type":"ContainerStarted","Data":"6c1fba9695adf753b960f8461d5187133ea3c76e0c4f73d7b489a13a9debc42a"}
Sep 15 08:15:03.614772 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:03.614741    2586 generic.go:356] "Generic (PLEG): container finished" podID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerID="6c1fba9695adf753b960f8461d5187133ea3c76e0c4f73d7b489a13a9debc42a" exitCode=0
Sep 15 08:15:03.615149 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:03.614815    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" event={"ID":"534489ba-579b-4133-bb4c-d4ce8b546a66","Type":"ContainerDied","Data":"6c1fba9695adf753b960f8461d5187133ea3c76e0c4f73d7b489a13a9debc42a"}
Sep 15 08:15:04.624860 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:04.624813    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" event={"ID":"534489ba-579b-4133-bb4c-d4ce8b546a66","Type":"ContainerStarted","Data":"d475861a12c8a9ca97ffb6cee35fbdd20bdc8d5313f48d198a0bc28bfd15b5a9"}
Sep 15 08:15:04.625327 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:04.624883    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" event={"ID":"534489ba-579b-4133-bb4c-d4ce8b546a66","Type":"ContainerStarted","Data":"19dda0c0c6588394bea7ed4c9002ba1585e9a97d39c193b41571fea0279a63f0"}
Sep 15 08:15:04.625327 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:04.624905    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" event={"ID":"534489ba-579b-4133-bb4c-d4ce8b546a66","Type":"ContainerStarted","Data":"dad5be8de8558f3f3dc9481c4bcc6a41c811f87dcb20c70e502b924a18000122"}
Sep 15 08:15:04.625327 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:04.624922    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" event={"ID":"534489ba-579b-4133-bb4c-d4ce8b546a66","Type":"ContainerStarted","Data":"ee9c8dc5b3d9e89af3dfdcd942ac0d483d44a2a956e86e44f4d313d04320c35a"}
Sep 15 08:15:04.650479 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:04.650416    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" podStartSLOduration=14.65039687 podStartE2EDuration="14.65039687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 08:14:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 08:15:04.646783246 +0000 UTC m=+1457.438245994" watchObservedRunningTime="2026-09-15 08:15:04.65039687 +0000 UTC m=+1457.441859594"
Sep 15 08:15:06.611738 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:06.611697    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:15:06.612201 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:06.611759    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:15:06.612201 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:06.611779    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:15:06.612201 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:06.611797    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:15:06.614270 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:06.614149    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.33:6571: connect: connection refused"
Sep 15 08:15:06.614270 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:06.614173    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.33:8816: connect: connection refused"
Sep 15 08:15:06.614270 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:06.614178    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused"
Sep 15 08:15:06.614270 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:06.614239    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 15 08:15:07.905572 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:07.905511    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Sep 15 08:15:08.307566 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:08.307453    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Sep 15 08:15:09.611194 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:09.611139    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.33:8816: connect: connection refused"
Sep 15 08:15:09.611709 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:09.611210    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 15 08:15:09.611709 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:09.611139    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused"
Sep 15 08:15:09.611709 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:09.611139    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.33:6571: connect: connection refused"
Sep 15 08:15:11.611480 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:11.611441    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:15:11.611930 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:11.611500    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:15:11.611930 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:11.611518    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:15:11.611930 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:11.611549    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:15:12.612382 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:12.612352    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:15:12.612786 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:12.612454    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:15:12.612786 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:12.612704    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:15:12.613380 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:12.613359    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:15:12.613482 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:12.613418    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:15:12.613482 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:12.613463    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:15:12.617715 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:12.617700    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:15:12.673984 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:12.673962    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:15:17.906053 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:17.906009    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Sep 15 08:15:17.906552 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:17.906150    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:15:18.307194 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:18.307089    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Sep 15 08:15:18.307344 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:18.307230    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:15:20.705497 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:20.705463    2586 generic.go:356] "Generic (PLEG): container finished" podID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerID="248869a118e0dc1c90e78196a098a23ad1b7e618f89b828d1da72d852509bcb8" exitCode=137
Sep 15 08:15:20.705497 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:20.705488    2586 generic.go:356] "Generic (PLEG): container finished" podID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerID="38b766ccee66f09cd96c2de4639b54be17878525a93aa0fb804c484cf3c41581" exitCode=137
Sep 15 08:15:20.705928 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:20.705531    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" event={"ID":"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b","Type":"ContainerDied","Data":"248869a118e0dc1c90e78196a098a23ad1b7e618f89b828d1da72d852509bcb8"}
Sep 15 08:15:20.705928 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:20.705572    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" event={"ID":"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b","Type":"ContainerDied","Data":"38b766ccee66f09cd96c2de4639b54be17878525a93aa0fb804c484cf3c41581"}
Sep 15 08:15:20.940528 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:20.940504    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:15:20.951055 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:20.951028    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-ui-tls\") pod \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") "
Sep 15 08:15:20.951194 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:20.951074    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-online-tls\") pod \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") "
Sep 15 08:15:20.951194 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:20.951102    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-registry-tls\") pod \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") "
Sep 15 08:15:20.951194 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:20.951153    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9xqr\" (UniqueName: \"kubernetes.io/projected/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-kube-api-access-s9xqr\") pod \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") "
Sep 15 08:15:20.951194 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:20.951178    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-offline-tls\") pod \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") "
Sep 15 08:15:20.951392 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:20.951202    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-feast-data\") pod \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\" (UID: \"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b\") "
Sep 15 08:15:20.951992 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:20.951959    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-feast-data" (OuterVolumeSpecName: "feast-data") pod "0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" (UID: "0ffd7dab-f2dc-4af2-94a6-4a271ba2894b"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 08:15:20.953494 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:20.953469    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" (UID: "0ffd7dab-f2dc-4af2-94a6-4a271ba2894b"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:15:20.953620 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:20.953521    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" (UID: "0ffd7dab-f2dc-4af2-94a6-4a271ba2894b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:15:20.953699 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:20.953669    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-kube-api-access-s9xqr" (OuterVolumeSpecName: "kube-api-access-s9xqr") pod "0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" (UID: "0ffd7dab-f2dc-4af2-94a6-4a271ba2894b"). InnerVolumeSpecName "kube-api-access-s9xqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 08:15:20.953699 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:20.953671    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" (UID: "0ffd7dab-f2dc-4af2-94a6-4a271ba2894b"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:15:20.953699 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:20.953690    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-online-tls" (OuterVolumeSpecName: "online-tls") pod "0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" (UID: "0ffd7dab-f2dc-4af2-94a6-4a271ba2894b"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:15:21.052071 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:21.052034    2586 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-online-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:15:21.052071 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:21.052063    2586 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-registry-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:15:21.052071 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:21.052075    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9xqr\" (UniqueName: \"kubernetes.io/projected/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-kube-api-access-s9xqr\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:15:21.052313 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:21.052089    2586 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-offline-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:15:21.052313 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:21.052100    2586 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-feast-data\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:15:21.052313 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:21.052111    2586 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b-ui-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:15:21.712167 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:21.712134    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675" event={"ID":"0ffd7dab-f2dc-4af2-94a6-4a271ba2894b","Type":"ContainerDied","Data":"fec0df459f75c044d1ce27c58723c801a08195c153cd42b81e84dcdd42ee738e"}
Sep 15 08:15:21.712167 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:21.712150    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"
Sep 15 08:15:21.712739 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:21.712185    2586 scope.go:117] "RemoveContainer" containerID="9cb33e64f4841d51e490f15b6431b5d6c08d8e04c0ef5446156b32f2a9a12e1c"
Sep 15 08:15:21.722592 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:21.722455    2586 scope.go:117] "RemoveContainer" containerID="248869a118e0dc1c90e78196a098a23ad1b7e618f89b828d1da72d852509bcb8"
Sep 15 08:15:21.731038 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:21.731021    2586 scope.go:117] "RemoveContainer" containerID="af1232530f1cc8bdc9499497b18c3984f3dde0cc67753acd7a9ce30022f2355c"
Sep 15 08:15:21.737223 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:21.737197    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"]
Sep 15 08:15:21.739386 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:21.739367    2586 scope.go:117] "RemoveContainer" containerID="38b766ccee66f09cd96c2de4639b54be17878525a93aa0fb804c484cf3c41581"
Sep 15 08:15:21.740809 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:21.740790    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-pg675"]
Sep 15 08:15:21.746882 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:21.746865    2586 scope.go:117] "RemoveContainer" containerID="dc7420309156f5372b4d8e8bd8dc5cc9f194f20d82426b6fa48389020bc4e225"
Sep 15 08:15:21.753598 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:21.753582    2586 scope.go:117] "RemoveContainer" containerID="d8674bce9e338789510136efc6b1b28ee14afd5af250ab0e1aa0f0df5d2e5026"
Sep 15 08:15:23.724998 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:23.724948    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" path="/var/lib/kubelet/pods/0ffd7dab-f2dc-4af2-94a6-4a271ba2894b/volumes"
Sep 15 08:15:32.827739 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:32.827702    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:15:35.271486 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:35.271451    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:15:47.736194 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:47.736165    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cp9wl_a5527013-2ce3-48e3-b472-a593cbfbb55f/console-operator/1.log"
Sep 15 08:15:47.742449 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:15:47.742425    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cp9wl_a5527013-2ce3-48e3-b472-a593cbfbb55f/console-operator/1.log"
Sep 15 08:16:15.416475 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:15.416380    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:16:15.518090 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:15.518055    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:16:15.864266 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:15.864229    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:16:15.964768 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:15.964726    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:16:16.054820 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.054791    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"]
Sep 15 08:16:16.055093 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.055081    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="feast-init"
Sep 15 08:16:16.055141 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.055094    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="feast-init"
Sep 15 08:16:16.055141 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.055110    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="online"
Sep 15 08:16:16.055141 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.055115    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="online"
Sep 15 08:16:16.055141 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.055122    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="feast-apply"
Sep 15 08:16:16.055141 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.055127    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="feast-apply"
Sep 15 08:16:16.055141 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.055138    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="registry"
Sep 15 08:16:16.055141 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.055143    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="registry"
Sep 15 08:16:16.055378 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.055150    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="offline"
Sep 15 08:16:16.055378 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.055155    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="offline"
Sep 15 08:16:16.055378 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.055164    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="ui"
Sep 15 08:16:16.055378 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.055169    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="ui"
Sep 15 08:16:16.055378 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.055221    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="registry"
Sep 15 08:16:16.055378 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.055231    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="offline"
Sep 15 08:16:16.055378 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.055237    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="ui"
Sep 15 08:16:16.055378 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.055244    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ffd7dab-f2dc-4af2-94a6-4a271ba2894b" containerName="online"
Sep 15 08:16:16.058591 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.058573    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:16.061290 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.061264    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 15 08:16:16.061430 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.061332    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 15 08:16:16.061430 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.061332    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-5c7sj\""
Sep 15 08:16:16.061700 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.061677    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 15 08:16:16.061817 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.061718    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 15 08:16:16.062179 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.062160    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 15 08:16:16.062256 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.062235    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 15 08:16:16.071797 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.071779    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"]
Sep 15 08:16:16.084319 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.084298    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:16:16.143894 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.143816    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1e12682f-f003-4646-9559-dbd914697792-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-qq9zj\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:16.143894 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.143854    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1e12682f-f003-4646-9559-dbd914697792-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-qq9zj\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:16.143894 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.143884    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1e12682f-f003-4646-9559-dbd914697792-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-qq9zj\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:16.144105 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.143944    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1e12682f-f003-4646-9559-dbd914697792-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-qq9zj\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:16.144105 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.143973    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-786nz\" (UniqueName: \"kubernetes.io/projected/1e12682f-f003-4646-9559-dbd914697792-kube-api-access-786nz\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-qq9zj\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:16.144105 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.144002    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1e12682f-f003-4646-9559-dbd914697792-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-qq9zj\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:16.170287 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.170260    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:16:16.237933 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.237903    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:16:16.244749 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.244731    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1e12682f-f003-4646-9559-dbd914697792-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-qq9zj\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:16.244835 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.244770    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1e12682f-f003-4646-9559-dbd914697792-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-qq9zj\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:16.244835 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.244797    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1e12682f-f003-4646-9559-dbd914697792-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-qq9zj\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:16.245004 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.244982    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1e12682f-f003-4646-9559-dbd914697792-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-qq9zj\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:16.245096 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.245082    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1e12682f-f003-4646-9559-dbd914697792-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-qq9zj\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:16.245158 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.245119    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-786nz\" (UniqueName: \"kubernetes.io/projected/1e12682f-f003-4646-9559-dbd914697792-kube-api-access-786nz\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-qq9zj\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:16.245376 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.245353    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1e12682f-f003-4646-9559-dbd914697792-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-qq9zj\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:16.245872 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.245845    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1e12682f-f003-4646-9559-dbd914697792-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-qq9zj\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:16.247352 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.247330    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1e12682f-f003-4646-9559-dbd914697792-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-qq9zj\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:16.247439 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.247337    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1e12682f-f003-4646-9559-dbd914697792-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-qq9zj\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:16.247439 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.247366    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1e12682f-f003-4646-9559-dbd914697792-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-qq9zj\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:16.252941 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.252918    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-786nz\" (UniqueName: \"kubernetes.io/projected/1e12682f-f003-4646-9559-dbd914697792-kube-api-access-786nz\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-qq9zj\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:16.368097 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.368059    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:16.643018 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.642985    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"]
Sep 15 08:16:16.646338 ip-10-0-134-189 kubenswrapper[2586]: W0915 08:16:16.646312    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e12682f_f003_4646_9559_dbd914697792.slice/crio-d1edd1f5cac2f030e2766433c78ece2eeabcddd799d9e245180d3791ce76a6f5 WatchSource:0}: Error finding container d1edd1f5cac2f030e2766433c78ece2eeabcddd799d9e245180d3791ce76a6f5: Status 404 returned error can't find the container with id d1edd1f5cac2f030e2766433c78ece2eeabcddd799d9e245180d3791ce76a6f5
Sep 15 08:16:16.923672 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.923610    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" event={"ID":"1e12682f-f003-4646-9559-dbd914697792","Type":"ContainerStarted","Data":"fdd2ea3879f1fa77753383b228de43eeba916b487d840847f1cd27a371f83e3b"}
Sep 15 08:16:16.923869 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:16.923691    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" event={"ID":"1e12682f-f003-4646-9559-dbd914697792","Type":"ContainerStarted","Data":"d1edd1f5cac2f030e2766433c78ece2eeabcddd799d9e245180d3791ce76a6f5"}
Sep 15 08:16:21.945124 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:21.945089    2586 generic.go:356] "Generic (PLEG): container finished" podID="1e12682f-f003-4646-9559-dbd914697792" containerID="fdd2ea3879f1fa77753383b228de43eeba916b487d840847f1cd27a371f83e3b" exitCode=0
Sep 15 08:16:21.945124 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:21.945128    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" event={"ID":"1e12682f-f003-4646-9559-dbd914697792","Type":"ContainerDied","Data":"fdd2ea3879f1fa77753383b228de43eeba916b487d840847f1cd27a371f83e3b"}
Sep 15 08:16:22.951853 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:22.951815    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" event={"ID":"1e12682f-f003-4646-9559-dbd914697792","Type":"ContainerStarted","Data":"a56afa6dc5bbb5515d5acdebf5122cb4d9977f13a5f9a35775fa2f4acc95fd40"}
Sep 15 08:16:42.029262 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:42.029227    2586 generic.go:356] "Generic (PLEG): container finished" podID="1e12682f-f003-4646-9559-dbd914697792" containerID="a56afa6dc5bbb5515d5acdebf5122cb4d9977f13a5f9a35775fa2f4acc95fd40" exitCode=0
Sep 15 08:16:42.029689 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:42.029283    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" event={"ID":"1e12682f-f003-4646-9559-dbd914697792","Type":"ContainerDied","Data":"a56afa6dc5bbb5515d5acdebf5122cb4d9977f13a5f9a35775fa2f4acc95fd40"}
Sep 15 08:16:43.037890 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:43.037850    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" event={"ID":"1e12682f-f003-4646-9559-dbd914697792","Type":"ContainerStarted","Data":"f5b0784885bc16cf81dce30a439ecc9cba4a7ef2b9c37c83786604d19efe84a3"}
Sep 15 08:16:43.038382 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:43.037902    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" event={"ID":"1e12682f-f003-4646-9559-dbd914697792","Type":"ContainerStarted","Data":"2a49419c5e12a053a23c169efa27e84b4a5abb4ad34fed45d9ec143cc30f2841"}
Sep 15 08:16:43.038382 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:43.037917    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" event={"ID":"1e12682f-f003-4646-9559-dbd914697792","Type":"ContainerStarted","Data":"7210592fd94c671de9ab64c71a5acc90cc402b9c030508e81ab3e2faae14362e"}
Sep 15 08:16:43.060159 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:43.060096    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" podStartSLOduration=27.06007669 podStartE2EDuration="27.06007669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 08:16:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 08:16:43.058798878 +0000 UTC m=+1555.850261602" watchObservedRunningTime="2026-09-15 08:16:43.06007669 +0000 UTC m=+1555.851539446"
Sep 15 08:16:43.368410 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:43.368375    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:43.368596 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:43.368446    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:43.368596 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:43.368464    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:43.369800 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:43.369763    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.34:8443: connect: connection refused"
Sep 15 08:16:43.370036 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:43.369807    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.34:8816: connect: connection refused"
Sep 15 08:16:43.370160 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:43.369808    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Sep 15 08:16:46.368185 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:46.368149    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:46.368658 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:46.368282    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:46.368658 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:46.368467    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.34:8443: connect: connection refused"
Sep 15 08:16:46.368658 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:46.368489    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.34:8816: connect: connection refused"
Sep 15 08:16:46.368658 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:46.368543    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Sep 15 08:16:46.368946 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:46.368925    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:49.368941 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:49.368901    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.34:8816: connect: connection refused"
Sep 15 08:16:49.369436 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:49.368903    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.34:8443: connect: connection refused"
Sep 15 08:16:49.369436 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:49.368980    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Sep 15 08:16:52.370274 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:52.370232    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:52.371094 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:52.371072    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:52.375287 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:52.372895    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:52.375287 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:52.373000    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:53.022093 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:53.022055    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:16:53.741859 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:16:53.741828    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:17:56.699521 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:17:56.699437    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"]
Sep 15 08:17:56.700124 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:17:56.699740    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="online" containerID="cri-o://7210592fd94c671de9ab64c71a5acc90cc402b9c030508e81ab3e2faae14362e" gracePeriod=30
Sep 15 08:17:56.700124 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:17:56.699768    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="ui" containerID="cri-o://f5b0784885bc16cf81dce30a439ecc9cba4a7ef2b9c37c83786604d19efe84a3" gracePeriod=30
Sep 15 08:17:56.700124 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:17:56.699761    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="offline" containerID="cri-o://2a49419c5e12a053a23c169efa27e84b4a5abb4ad34fed45d9ec143cc30f2841" gracePeriod=30
Sep 15 08:17:56.731129 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:17:56.731099    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:17:56.822387 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:17:56.822355    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:17:56.852468 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:17:56.852431    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"]
Sep 15 08:17:56.852989 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:17:56.852956    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="registry" containerID="cri-o://ee9c8dc5b3d9e89af3dfdcd942ac0d483d44a2a956e86e44f4d313d04320c35a" gracePeriod=30
Sep 15 08:17:56.853200 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:17:56.853008    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="offline" containerID="cri-o://19dda0c0c6588394bea7ed4c9002ba1585e9a97d39c193b41571fea0279a63f0" gracePeriod=30
Sep 15 08:17:56.853305 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:17:56.853016    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="ui" containerID="cri-o://d475861a12c8a9ca97ffb6cee35fbdd20bdc8d5313f48d198a0bc28bfd15b5a9" gracePeriod=30
Sep 15 08:17:56.853305 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:17:56.853023    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="online" containerID="cri-o://dad5be8de8558f3f3dc9481c4bcc6a41c811f87dcb20c70e502b924a18000122" gracePeriod=30
Sep 15 08:17:56.919541 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:17:56.919509    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:17:56.978022 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:17:56.977939    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:17:57.373783 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:17:57.373742    2586 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 15 08:17:58.343726 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:17:58.343695    2586 generic.go:356] "Generic (PLEG): container finished" podID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerID="d475861a12c8a9ca97ffb6cee35fbdd20bdc8d5313f48d198a0bc28bfd15b5a9" exitCode=0
Sep 15 08:17:58.343726 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:17:58.343719    2586 generic.go:356] "Generic (PLEG): container finished" podID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerID="dad5be8de8558f3f3dc9481c4bcc6a41c811f87dcb20c70e502b924a18000122" exitCode=0
Sep 15 08:17:58.344202 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:17:58.343770    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" event={"ID":"534489ba-579b-4133-bb4c-d4ce8b546a66","Type":"ContainerDied","Data":"d475861a12c8a9ca97ffb6cee35fbdd20bdc8d5313f48d198a0bc28bfd15b5a9"}
Sep 15 08:17:58.344202 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:17:58.343828    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" event={"ID":"534489ba-579b-4133-bb4c-d4ce8b546a66","Type":"ContainerDied","Data":"dad5be8de8558f3f3dc9481c4bcc6a41c811f87dcb20c70e502b924a18000122"}
Sep 15 08:17:58.346221 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:17:58.346198    2586 generic.go:356] "Generic (PLEG): container finished" podID="1e12682f-f003-4646-9559-dbd914697792" containerID="f5b0784885bc16cf81dce30a439ecc9cba4a7ef2b9c37c83786604d19efe84a3" exitCode=0
Sep 15 08:17:58.346343 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:17:58.346236    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" event={"ID":"1e12682f-f003-4646-9559-dbd914697792","Type":"ContainerDied","Data":"f5b0784885bc16cf81dce30a439ecc9cba4a7ef2b9c37c83786604d19efe84a3"}
Sep 15 08:18:02.010907 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:02.010877    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:18:02.373409 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:02.373372    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.34:8443: connect: connection refused"
Sep 15 08:18:02.613979 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:02.613933    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused"
Sep 15 08:18:02.671132 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:02.671047    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 15 08:18:04.085433 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:04.085380    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 15 08:18:12.373102 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:12.373064    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.34:8443: connect: connection refused"
Sep 15 08:18:12.613756 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:12.613705    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused"
Sep 15 08:18:12.672231 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:12.672128    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 15 08:18:14.085432 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:14.085388    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 15 08:18:22.373582 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:22.373525    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.34:8443: connect: connection refused"
Sep 15 08:18:22.374049 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:22.373717    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:18:22.613319 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:22.613267    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused"
Sep 15 08:18:22.613503 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:22.613408    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:18:22.671963 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:22.671877    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 15 08:18:22.672102 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:22.671980    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:18:24.084687 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:24.084627    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 15 08:18:24.085088 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:24.084781    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:18:27.341360 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.341334    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:18:27.464107 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.464077    2586 generic.go:356] "Generic (PLEG): container finished" podID="1e12682f-f003-4646-9559-dbd914697792" containerID="2a49419c5e12a053a23c169efa27e84b4a5abb4ad34fed45d9ec143cc30f2841" exitCode=137
Sep 15 08:18:27.464107 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.464101    2586 generic.go:356] "Generic (PLEG): container finished" podID="1e12682f-f003-4646-9559-dbd914697792" containerID="7210592fd94c671de9ab64c71a5acc90cc402b9c030508e81ab3e2faae14362e" exitCode=137
Sep 15 08:18:27.464329 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.464142    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"
Sep 15 08:18:27.464329 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.464156    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" event={"ID":"1e12682f-f003-4646-9559-dbd914697792","Type":"ContainerDied","Data":"2a49419c5e12a053a23c169efa27e84b4a5abb4ad34fed45d9ec143cc30f2841"}
Sep 15 08:18:27.464329 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.464204    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" event={"ID":"1e12682f-f003-4646-9559-dbd914697792","Type":"ContainerDied","Data":"7210592fd94c671de9ab64c71a5acc90cc402b9c030508e81ab3e2faae14362e"}
Sep 15 08:18:27.464329 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.464225    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj" event={"ID":"1e12682f-f003-4646-9559-dbd914697792","Type":"ContainerDied","Data":"d1edd1f5cac2f030e2766433c78ece2eeabcddd799d9e245180d3791ce76a6f5"}
Sep 15 08:18:27.464329 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.464250    2586 scope.go:117] "RemoveContainer" containerID="f5b0784885bc16cf81dce30a439ecc9cba4a7ef2b9c37c83786604d19efe84a3"
Sep 15 08:18:27.467806 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.467780    2586 generic.go:356] "Generic (PLEG): container finished" podID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerID="19dda0c0c6588394bea7ed4c9002ba1585e9a97d39c193b41571fea0279a63f0" exitCode=137
Sep 15 08:18:27.467806 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.467804    2586 generic.go:356] "Generic (PLEG): container finished" podID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerID="ee9c8dc5b3d9e89af3dfdcd942ac0d483d44a2a956e86e44f4d313d04320c35a" exitCode=137
Sep 15 08:18:27.467947 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.467831    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" event={"ID":"534489ba-579b-4133-bb4c-d4ce8b546a66","Type":"ContainerDied","Data":"19dda0c0c6588394bea7ed4c9002ba1585e9a97d39c193b41571fea0279a63f0"}
Sep 15 08:18:27.467947 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.467866    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" event={"ID":"534489ba-579b-4133-bb4c-d4ce8b546a66","Type":"ContainerDied","Data":"ee9c8dc5b3d9e89af3dfdcd942ac0d483d44a2a956e86e44f4d313d04320c35a"}
Sep 15 08:18:27.474127 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.474110    2586 scope.go:117] "RemoveContainer" containerID="2a49419c5e12a053a23c169efa27e84b4a5abb4ad34fed45d9ec143cc30f2841"
Sep 15 08:18:27.482126 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.482109    2586 scope.go:117] "RemoveContainer" containerID="7210592fd94c671de9ab64c71a5acc90cc402b9c030508e81ab3e2faae14362e"
Sep 15 08:18:27.489316 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.489299    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:18:27.489668 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.489654    2586 scope.go:117] "RemoveContainer" containerID="a56afa6dc5bbb5515d5acdebf5122cb4d9977f13a5f9a35775fa2f4acc95fd40"
Sep 15 08:18:27.496392 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.496375    2586 scope.go:117] "RemoveContainer" containerID="fdd2ea3879f1fa77753383b228de43eeba916b487d840847f1cd27a371f83e3b"
Sep 15 08:18:27.503319 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.503300    2586 scope.go:117] "RemoveContainer" containerID="f5b0784885bc16cf81dce30a439ecc9cba4a7ef2b9c37c83786604d19efe84a3"
Sep 15 08:18:27.503582 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:18:27.503564    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5b0784885bc16cf81dce30a439ecc9cba4a7ef2b9c37c83786604d19efe84a3\": container with ID starting with f5b0784885bc16cf81dce30a439ecc9cba4a7ef2b9c37c83786604d19efe84a3 not found: ID does not exist" containerID="f5b0784885bc16cf81dce30a439ecc9cba4a7ef2b9c37c83786604d19efe84a3"
Sep 15 08:18:27.503741 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.503591    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5b0784885bc16cf81dce30a439ecc9cba4a7ef2b9c37c83786604d19efe84a3"} err="failed to get container status \"f5b0784885bc16cf81dce30a439ecc9cba4a7ef2b9c37c83786604d19efe84a3\": rpc error: code = NotFound desc = could not find container \"f5b0784885bc16cf81dce30a439ecc9cba4a7ef2b9c37c83786604d19efe84a3\": container with ID starting with f5b0784885bc16cf81dce30a439ecc9cba4a7ef2b9c37c83786604d19efe84a3 not found: ID does not exist"
Sep 15 08:18:27.503741 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.503610    2586 scope.go:117] "RemoveContainer" containerID="2a49419c5e12a053a23c169efa27e84b4a5abb4ad34fed45d9ec143cc30f2841"
Sep 15 08:18:27.503879 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:18:27.503865    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a49419c5e12a053a23c169efa27e84b4a5abb4ad34fed45d9ec143cc30f2841\": container with ID starting with 2a49419c5e12a053a23c169efa27e84b4a5abb4ad34fed45d9ec143cc30f2841 not found: ID does not exist" containerID="2a49419c5e12a053a23c169efa27e84b4a5abb4ad34fed45d9ec143cc30f2841"
Sep 15 08:18:27.503919 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.503884    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a49419c5e12a053a23c169efa27e84b4a5abb4ad34fed45d9ec143cc30f2841"} err="failed to get container status \"2a49419c5e12a053a23c169efa27e84b4a5abb4ad34fed45d9ec143cc30f2841\": rpc error: code = NotFound desc = could not find container \"2a49419c5e12a053a23c169efa27e84b4a5abb4ad34fed45d9ec143cc30f2841\": container with ID starting with 2a49419c5e12a053a23c169efa27e84b4a5abb4ad34fed45d9ec143cc30f2841 not found: ID does not exist"
Sep 15 08:18:27.503919 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.503896    2586 scope.go:117] "RemoveContainer" containerID="7210592fd94c671de9ab64c71a5acc90cc402b9c030508e81ab3e2faae14362e"
Sep 15 08:18:27.504107 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:18:27.504093    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7210592fd94c671de9ab64c71a5acc90cc402b9c030508e81ab3e2faae14362e\": container with ID starting with 7210592fd94c671de9ab64c71a5acc90cc402b9c030508e81ab3e2faae14362e not found: ID does not exist" containerID="7210592fd94c671de9ab64c71a5acc90cc402b9c030508e81ab3e2faae14362e"
Sep 15 08:18:27.504144 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.504111    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7210592fd94c671de9ab64c71a5acc90cc402b9c030508e81ab3e2faae14362e"} err="failed to get container status \"7210592fd94c671de9ab64c71a5acc90cc402b9c030508e81ab3e2faae14362e\": rpc error: code = NotFound desc = could not find container \"7210592fd94c671de9ab64c71a5acc90cc402b9c030508e81ab3e2faae14362e\": container with ID starting with 7210592fd94c671de9ab64c71a5acc90cc402b9c030508e81ab3e2faae14362e not found: ID does not exist"
Sep 15 08:18:27.504144 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.504124    2586 scope.go:117] "RemoveContainer" containerID="a56afa6dc5bbb5515d5acdebf5122cb4d9977f13a5f9a35775fa2f4acc95fd40"
Sep 15 08:18:27.504366 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:18:27.504346    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a56afa6dc5bbb5515d5acdebf5122cb4d9977f13a5f9a35775fa2f4acc95fd40\": container with ID starting with a56afa6dc5bbb5515d5acdebf5122cb4d9977f13a5f9a35775fa2f4acc95fd40 not found: ID does not exist" containerID="a56afa6dc5bbb5515d5acdebf5122cb4d9977f13a5f9a35775fa2f4acc95fd40"
Sep 15 08:18:27.504432 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.504374    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a56afa6dc5bbb5515d5acdebf5122cb4d9977f13a5f9a35775fa2f4acc95fd40"} err="failed to get container status \"a56afa6dc5bbb5515d5acdebf5122cb4d9977f13a5f9a35775fa2f4acc95fd40\": rpc error: code = NotFound desc = could not find container \"a56afa6dc5bbb5515d5acdebf5122cb4d9977f13a5f9a35775fa2f4acc95fd40\": container with ID starting with a56afa6dc5bbb5515d5acdebf5122cb4d9977f13a5f9a35775fa2f4acc95fd40 not found: ID does not exist"
Sep 15 08:18:27.504432 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.504395    2586 scope.go:117] "RemoveContainer" containerID="fdd2ea3879f1fa77753383b228de43eeba916b487d840847f1cd27a371f83e3b"
Sep 15 08:18:27.504619 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:18:27.504600    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdd2ea3879f1fa77753383b228de43eeba916b487d840847f1cd27a371f83e3b\": container with ID starting with fdd2ea3879f1fa77753383b228de43eeba916b487d840847f1cd27a371f83e3b not found: ID does not exist" containerID="fdd2ea3879f1fa77753383b228de43eeba916b487d840847f1cd27a371f83e3b"
Sep 15 08:18:27.504690 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.504624    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdd2ea3879f1fa77753383b228de43eeba916b487d840847f1cd27a371f83e3b"} err="failed to get container status \"fdd2ea3879f1fa77753383b228de43eeba916b487d840847f1cd27a371f83e3b\": rpc error: code = NotFound desc = could not find container \"fdd2ea3879f1fa77753383b228de43eeba916b487d840847f1cd27a371f83e3b\": container with ID starting with fdd2ea3879f1fa77753383b228de43eeba916b487d840847f1cd27a371f83e3b not found: ID does not exist"
Sep 15 08:18:27.504690 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.504654    2586 scope.go:117] "RemoveContainer" containerID="f5b0784885bc16cf81dce30a439ecc9cba4a7ef2b9c37c83786604d19efe84a3"
Sep 15 08:18:27.504873 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.504858    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1e12682f-f003-4646-9559-dbd914697792-offline-tls\") pod \"1e12682f-f003-4646-9559-dbd914697792\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") "
Sep 15 08:18:27.504917 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.504877    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5b0784885bc16cf81dce30a439ecc9cba4a7ef2b9c37c83786604d19efe84a3"} err="failed to get container status \"f5b0784885bc16cf81dce30a439ecc9cba4a7ef2b9c37c83786604d19efe84a3\": rpc error: code = NotFound desc = could not find container \"f5b0784885bc16cf81dce30a439ecc9cba4a7ef2b9c37c83786604d19efe84a3\": container with ID starting with f5b0784885bc16cf81dce30a439ecc9cba4a7ef2b9c37c83786604d19efe84a3 not found: ID does not exist"
Sep 15 08:18:27.504917 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.504887    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1e12682f-f003-4646-9559-dbd914697792-online-tls\") pod \"1e12682f-f003-4646-9559-dbd914697792\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") "
Sep 15 08:18:27.504917 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.504895    2586 scope.go:117] "RemoveContainer" containerID="2a49419c5e12a053a23c169efa27e84b4a5abb4ad34fed45d9ec143cc30f2841"
Sep 15 08:18:27.505064 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.504953    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1e12682f-f003-4646-9559-dbd914697792-ui-tls\") pod \"1e12682f-f003-4646-9559-dbd914697792\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") "
Sep 15 08:18:27.505064 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.505017    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-786nz\" (UniqueName: \"kubernetes.io/projected/1e12682f-f003-4646-9559-dbd914697792-kube-api-access-786nz\") pod \"1e12682f-f003-4646-9559-dbd914697792\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") "
Sep 15 08:18:27.505064 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.505041    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1e12682f-f003-4646-9559-dbd914697792-registry-tls\") pod \"1e12682f-f003-4646-9559-dbd914697792\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") "
Sep 15 08:18:27.505212 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.505178    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a49419c5e12a053a23c169efa27e84b4a5abb4ad34fed45d9ec143cc30f2841"} err="failed to get container status \"2a49419c5e12a053a23c169efa27e84b4a5abb4ad34fed45d9ec143cc30f2841\": rpc error: code = NotFound desc = could not find container \"2a49419c5e12a053a23c169efa27e84b4a5abb4ad34fed45d9ec143cc30f2841\": container with ID starting with 2a49419c5e12a053a23c169efa27e84b4a5abb4ad34fed45d9ec143cc30f2841 not found: ID does not exist"
Sep 15 08:18:27.505212 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.505202    2586 scope.go:117] "RemoveContainer" containerID="7210592fd94c671de9ab64c71a5acc90cc402b9c030508e81ab3e2faae14362e"
Sep 15 08:18:27.505212 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.505195    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1e12682f-f003-4646-9559-dbd914697792-feast-data\") pod \"1e12682f-f003-4646-9559-dbd914697792\" (UID: \"1e12682f-f003-4646-9559-dbd914697792\") "
Sep 15 08:18:27.505412 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.505366    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e12682f-f003-4646-9559-dbd914697792-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1e12682f-f003-4646-9559-dbd914697792" (UID: "1e12682f-f003-4646-9559-dbd914697792"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 08:18:27.505613 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.505558    2586 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1e12682f-f003-4646-9559-dbd914697792-registry-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:18:27.505613 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.505589    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7210592fd94c671de9ab64c71a5acc90cc402b9c030508e81ab3e2faae14362e"} err="failed to get container status \"7210592fd94c671de9ab64c71a5acc90cc402b9c030508e81ab3e2faae14362e\": rpc error: code = NotFound desc = could not find container \"7210592fd94c671de9ab64c71a5acc90cc402b9c030508e81ab3e2faae14362e\": container with ID starting with 7210592fd94c671de9ab64c71a5acc90cc402b9c030508e81ab3e2faae14362e not found: ID does not exist"
Sep 15 08:18:27.505773 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.505615    2586 scope.go:117] "RemoveContainer" containerID="a56afa6dc5bbb5515d5acdebf5122cb4d9977f13a5f9a35775fa2f4acc95fd40"
Sep 15 08:18:27.505833 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.505810    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e12682f-f003-4646-9559-dbd914697792-feast-data" (OuterVolumeSpecName: "feast-data") pod "1e12682f-f003-4646-9559-dbd914697792" (UID: "1e12682f-f003-4646-9559-dbd914697792"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 08:18:27.505928 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.505904    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a56afa6dc5bbb5515d5acdebf5122cb4d9977f13a5f9a35775fa2f4acc95fd40"} err="failed to get container status \"a56afa6dc5bbb5515d5acdebf5122cb4d9977f13a5f9a35775fa2f4acc95fd40\": rpc error: code = NotFound desc = could not find container \"a56afa6dc5bbb5515d5acdebf5122cb4d9977f13a5f9a35775fa2f4acc95fd40\": container with ID starting with a56afa6dc5bbb5515d5acdebf5122cb4d9977f13a5f9a35775fa2f4acc95fd40 not found: ID does not exist"
Sep 15 08:18:27.505984 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.505931    2586 scope.go:117] "RemoveContainer" containerID="fdd2ea3879f1fa77753383b228de43eeba916b487d840847f1cd27a371f83e3b"
Sep 15 08:18:27.506194 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.506174    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdd2ea3879f1fa77753383b228de43eeba916b487d840847f1cd27a371f83e3b"} err="failed to get container status \"fdd2ea3879f1fa77753383b228de43eeba916b487d840847f1cd27a371f83e3b\": rpc error: code = NotFound desc = could not find container \"fdd2ea3879f1fa77753383b228de43eeba916b487d840847f1cd27a371f83e3b\": container with ID starting with fdd2ea3879f1fa77753383b228de43eeba916b487d840847f1cd27a371f83e3b not found: ID does not exist"
Sep 15 08:18:27.507499 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.507468    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e12682f-f003-4646-9559-dbd914697792-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "1e12682f-f003-4646-9559-dbd914697792" (UID: "1e12682f-f003-4646-9559-dbd914697792"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:18:27.507576 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.507521    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e12682f-f003-4646-9559-dbd914697792-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "1e12682f-f003-4646-9559-dbd914697792" (UID: "1e12682f-f003-4646-9559-dbd914697792"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:18:27.507576 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.507530    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e12682f-f003-4646-9559-dbd914697792-kube-api-access-786nz" (OuterVolumeSpecName: "kube-api-access-786nz") pod "1e12682f-f003-4646-9559-dbd914697792" (UID: "1e12682f-f003-4646-9559-dbd914697792"). InnerVolumeSpecName "kube-api-access-786nz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 08:18:27.507576 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.507533    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e12682f-f003-4646-9559-dbd914697792-online-tls" (OuterVolumeSpecName: "online-tls") pod "1e12682f-f003-4646-9559-dbd914697792" (UID: "1e12682f-f003-4646-9559-dbd914697792"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:18:27.606536 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.606494    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-registry-tls\") pod \"534489ba-579b-4133-bb4c-d4ce8b546a66\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") "
Sep 15 08:18:27.606536 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.606539    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-online-tls\") pod \"534489ba-579b-4133-bb4c-d4ce8b546a66\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") "
Sep 15 08:18:27.606829 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.606583    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-ui-tls\") pod \"534489ba-579b-4133-bb4c-d4ce8b546a66\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") "
Sep 15 08:18:27.606829 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.606613    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-offline-tls\") pod \"534489ba-579b-4133-bb4c-d4ce8b546a66\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") "
Sep 15 08:18:27.606829 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.606809    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqxl4\" (UniqueName: \"kubernetes.io/projected/534489ba-579b-4133-bb4c-d4ce8b546a66-kube-api-access-zqxl4\") pod \"534489ba-579b-4133-bb4c-d4ce8b546a66\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") "
Sep 15 08:18:27.606999 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.606872    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/534489ba-579b-4133-bb4c-d4ce8b546a66-feast-data\") pod \"534489ba-579b-4133-bb4c-d4ce8b546a66\" (UID: \"534489ba-579b-4133-bb4c-d4ce8b546a66\") "
Sep 15 08:18:27.607171 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.607104    2586 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1e12682f-f003-4646-9559-dbd914697792-feast-data\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:18:27.607171 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.607126    2586 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1e12682f-f003-4646-9559-dbd914697792-offline-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:18:27.607171 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.607139    2586 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1e12682f-f003-4646-9559-dbd914697792-online-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:18:27.607171 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.607151    2586 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1e12682f-f003-4646-9559-dbd914697792-ui-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:18:27.607171 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.607164    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-786nz\" (UniqueName: \"kubernetes.io/projected/1e12682f-f003-4646-9559-dbd914697792-kube-api-access-786nz\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:18:27.607513 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.607432    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/534489ba-579b-4133-bb4c-d4ce8b546a66-feast-data" (OuterVolumeSpecName: "feast-data") pod "534489ba-579b-4133-bb4c-d4ce8b546a66" (UID: "534489ba-579b-4133-bb4c-d4ce8b546a66"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 08:18:27.608714 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.608685    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "534489ba-579b-4133-bb4c-d4ce8b546a66" (UID: "534489ba-579b-4133-bb4c-d4ce8b546a66"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:18:27.609222 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.609195    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-online-tls" (OuterVolumeSpecName: "online-tls") pod "534489ba-579b-4133-bb4c-d4ce8b546a66" (UID: "534489ba-579b-4133-bb4c-d4ce8b546a66"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:18:27.609222 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.609206    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/534489ba-579b-4133-bb4c-d4ce8b546a66-kube-api-access-zqxl4" (OuterVolumeSpecName: "kube-api-access-zqxl4") pod "534489ba-579b-4133-bb4c-d4ce8b546a66" (UID: "534489ba-579b-4133-bb4c-d4ce8b546a66"). InnerVolumeSpecName "kube-api-access-zqxl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 08:18:27.609338 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.609236    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "534489ba-579b-4133-bb4c-d4ce8b546a66" (UID: "534489ba-579b-4133-bb4c-d4ce8b546a66"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:18:27.609338 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.609250    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "534489ba-579b-4133-bb4c-d4ce8b546a66" (UID: "534489ba-579b-4133-bb4c-d4ce8b546a66"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:18:27.707694 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.707653    2586 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-ui-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:18:27.707694 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.707689    2586 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-offline-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:18:27.707694 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.707701    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqxl4\" (UniqueName: \"kubernetes.io/projected/534489ba-579b-4133-bb4c-d4ce8b546a66-kube-api-access-zqxl4\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:18:27.707914 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.707709    2586 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/534489ba-579b-4133-bb4c-d4ce8b546a66-feast-data\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:18:27.707914 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.707719    2586 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-registry-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:18:27.707914 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.707728    2586 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/534489ba-579b-4133-bb4c-d4ce8b546a66-online-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:18:27.779912 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.779884    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"]
Sep 15 08:18:27.783584 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:27.783557    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-qq9zj"]
Sep 15 08:18:28.475507 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:28.475469    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq" event={"ID":"534489ba-579b-4133-bb4c-d4ce8b546a66","Type":"ContainerDied","Data":"be5e91e52e6f0d61c1a6409acf0b31527cdb4623f3ac867ebe605194cb9096f5"}
Sep 15 08:18:28.476138 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:28.475520    2586 scope.go:117] "RemoveContainer" containerID="d475861a12c8a9ca97ffb6cee35fbdd20bdc8d5313f48d198a0bc28bfd15b5a9"
Sep 15 08:18:28.476138 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:28.475478    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"
Sep 15 08:18:28.486366 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:28.486337    2586 scope.go:117] "RemoveContainer" containerID="19dda0c0c6588394bea7ed4c9002ba1585e9a97d39c193b41571fea0279a63f0"
Sep 15 08:18:28.494175 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:28.494158    2586 scope.go:117] "RemoveContainer" containerID="dad5be8de8558f3f3dc9481c4bcc6a41c811f87dcb20c70e502b924a18000122"
Sep 15 08:18:28.497216 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:28.497192    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"]
Sep 15 08:18:28.502053 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:28.501986    2586 scope.go:117] "RemoveContainer" containerID="ee9c8dc5b3d9e89af3dfdcd942ac0d483d44a2a956e86e44f4d313d04320c35a"
Sep 15 08:18:28.503481 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:28.503460    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-jhkwq"]
Sep 15 08:18:28.509480 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:28.509464    2586 scope.go:117] "RemoveContainer" containerID="6c1fba9695adf753b960f8461d5187133ea3c76e0c4f73d7b489a13a9debc42a"
Sep 15 08:18:28.516253 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:28.516234    2586 scope.go:117] "RemoveContainer" containerID="d3a8ed5b4179e375f62a4eef64e5286a5665c59bead07eb89008635349cda4ea"
Sep 15 08:18:29.719783 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:29.719747    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e12682f-f003-4646-9559-dbd914697792" path="/var/lib/kubelet/pods/1e12682f-f003-4646-9559-dbd914697792/volumes"
Sep 15 08:18:29.720284 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:29.720270    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" path="/var/lib/kubelet/pods/534489ba-579b-4133-bb4c-d4ce8b546a66/volumes"
Sep 15 08:18:39.525296 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:39.525262    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:18:39.651675 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:39.651625    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:18:45.094015 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:45.093976    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:18:45.194371 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:45.194339    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:18:45.218815 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:45.218786    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-g72mw"]
Sep 15 08:18:45.219014 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:45.218987    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g72mw" podUID="0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27" containerName="manager" containerID="cri-o://ddb1285546481c0016fcd6ffe0dd094ffd758f9567edc6be9d084b9f7bf68676" gracePeriod=10
Sep 15 08:18:45.468024 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:45.468003    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g72mw"
Sep 15 08:18:45.540107 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:45.540066    2586 generic.go:356] "Generic (PLEG): container finished" podID="0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27" containerID="ddb1285546481c0016fcd6ffe0dd094ffd758f9567edc6be9d084b9f7bf68676" exitCode=0
Sep 15 08:18:45.540240 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:45.540114    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g72mw"
Sep 15 08:18:45.540240 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:45.540122    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g72mw" event={"ID":"0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27","Type":"ContainerDied","Data":"ddb1285546481c0016fcd6ffe0dd094ffd758f9567edc6be9d084b9f7bf68676"}
Sep 15 08:18:45.540240 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:45.540167    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g72mw" event={"ID":"0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27","Type":"ContainerDied","Data":"f6740489dbf70a68284509b893682d1df9ac87638d50351618caf8998ebdf292"}
Sep 15 08:18:45.540240 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:45.540188    2586 scope.go:117] "RemoveContainer" containerID="ddb1285546481c0016fcd6ffe0dd094ffd758f9567edc6be9d084b9f7bf68676"
Sep 15 08:18:45.547670 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:45.547647    2586 scope.go:117] "RemoveContainer" containerID="ddb1285546481c0016fcd6ffe0dd094ffd758f9567edc6be9d084b9f7bf68676"
Sep 15 08:18:45.547934 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:18:45.547913    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddb1285546481c0016fcd6ffe0dd094ffd758f9567edc6be9d084b9f7bf68676\": container with ID starting with ddb1285546481c0016fcd6ffe0dd094ffd758f9567edc6be9d084b9f7bf68676 not found: ID does not exist" containerID="ddb1285546481c0016fcd6ffe0dd094ffd758f9567edc6be9d084b9f7bf68676"
Sep 15 08:18:45.548000 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:45.547944    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddb1285546481c0016fcd6ffe0dd094ffd758f9567edc6be9d084b9f7bf68676"} err="failed to get container status \"ddb1285546481c0016fcd6ffe0dd094ffd758f9567edc6be9d084b9f7bf68676\": rpc error: code = NotFound desc = could not find container \"ddb1285546481c0016fcd6ffe0dd094ffd758f9567edc6be9d084b9f7bf68676\": container with ID starting with ddb1285546481c0016fcd6ffe0dd094ffd758f9567edc6be9d084b9f7bf68676 not found: ID does not exist"
Sep 15 08:18:45.648680 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:45.648578    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69sgq\" (UniqueName: \"kubernetes.io/projected/0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27-kube-api-access-69sgq\") pod \"0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27\" (UID: \"0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27\") "
Sep 15 08:18:45.650756 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:45.650731    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27-kube-api-access-69sgq" (OuterVolumeSpecName: "kube-api-access-69sgq") pod "0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27" (UID: "0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27"). InnerVolumeSpecName "kube-api-access-69sgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 08:18:45.749549 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:45.749520    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69sgq\" (UniqueName: \"kubernetes.io/projected/0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27-kube-api-access-69sgq\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:18:45.855273 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:45.855246    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-g72mw"]
Sep 15 08:18:45.860270 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:45.860237    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-g72mw"]
Sep 15 08:18:47.721249 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:47.721218    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27" path="/var/lib/kubelet/pods/0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27/volumes"
Sep 15 08:18:49.887609 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887578    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-bjwsg"]
Sep 15 08:18:49.887976 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887860    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="offline"
Sep 15 08:18:49.887976 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887872    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="offline"
Sep 15 08:18:49.887976 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887885    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="online"
Sep 15 08:18:49.887976 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887892    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="online"
Sep 15 08:18:49.887976 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887899    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="online"
Sep 15 08:18:49.887976 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887905    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="online"
Sep 15 08:18:49.887976 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887912    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="ui"
Sep 15 08:18:49.887976 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887917    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="ui"
Sep 15 08:18:49.887976 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887923    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="feast-init"
Sep 15 08:18:49.887976 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887928    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="feast-init"
Sep 15 08:18:49.887976 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887936    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="feast-apply"
Sep 15 08:18:49.887976 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887941    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="feast-apply"
Sep 15 08:18:49.887976 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887950    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="offline"
Sep 15 08:18:49.887976 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887955    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="offline"
Sep 15 08:18:49.887976 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887962    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="feast-init"
Sep 15 08:18:49.887976 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887967    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="feast-init"
Sep 15 08:18:49.887976 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887973    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27" containerName="manager"
Sep 15 08:18:49.887976 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887978    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27" containerName="manager"
Sep 15 08:18:49.887976 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887984    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="feast-apply"
Sep 15 08:18:49.888541 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887989    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="feast-apply"
Sep 15 08:18:49.888541 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.887998    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="ui"
Sep 15 08:18:49.888541 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.888004    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="ui"
Sep 15 08:18:49.888541 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.888010    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="registry"
Sep 15 08:18:49.888541 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.888015    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="registry"
Sep 15 08:18:49.888541 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.888058    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="offline"
Sep 15 08:18:49.888541 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.888065    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="registry"
Sep 15 08:18:49.888541 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.888070    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="ui"
Sep 15 08:18:49.888541 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.888076    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="online"
Sep 15 08:18:49.888541 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.888080    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="534489ba-579b-4133-bb4c-d4ce8b546a66" containerName="online"
Sep 15 08:18:49.888541 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.888085    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="ui"
Sep 15 08:18:49.888541 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.888091    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e12682f-f003-4646-9559-dbd914697792" containerName="offline"
Sep 15 08:18:49.888541 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.888096    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b8cc0ac-88ee-41d3-918e-ab0b3f8cda27" containerName="manager"
Sep 15 08:18:49.890842 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.890824    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-bjwsg"
Sep 15 08:18:49.894317 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.894286    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Sep 15 08:18:49.895225 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.895204    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Sep 15 08:18:49.895337 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.895250    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-sjjmp\""
Sep 15 08:18:49.900369 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.900346    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-bjwsg"]
Sep 15 08:18:49.981219 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:49.981181    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42k7w\" (UniqueName: \"kubernetes.io/projected/5b4efeb0-234e-406b-ab38-fb1f84296d3d-kube-api-access-42k7w\") pod \"feast-operator-controller-manager-689b877b4b-bjwsg\" (UID: \"5b4efeb0-234e-406b-ab38-fb1f84296d3d\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-bjwsg"
Sep 15 08:18:50.081723 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:50.081685    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42k7w\" (UniqueName: \"kubernetes.io/projected/5b4efeb0-234e-406b-ab38-fb1f84296d3d-kube-api-access-42k7w\") pod \"feast-operator-controller-manager-689b877b4b-bjwsg\" (UID: \"5b4efeb0-234e-406b-ab38-fb1f84296d3d\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-bjwsg"
Sep 15 08:18:50.091628 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:50.091599    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42k7w\" (UniqueName: \"kubernetes.io/projected/5b4efeb0-234e-406b-ab38-fb1f84296d3d-kube-api-access-42k7w\") pod \"feast-operator-controller-manager-689b877b4b-bjwsg\" (UID: \"5b4efeb0-234e-406b-ab38-fb1f84296d3d\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-bjwsg"
Sep 15 08:18:50.202676 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:50.202566    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-bjwsg"
Sep 15 08:18:50.470802 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:50.470778    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-bjwsg"]
Sep 15 08:18:50.473006 ip-10-0-134-189 kubenswrapper[2586]: W0915 08:18:50.472978    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b4efeb0_234e_406b_ab38_fb1f84296d3d.slice/crio-5d307c40bf26166323898f019c72122feaa66ca879eb15136ec7731b2b380d7f WatchSource:0}: Error finding container 5d307c40bf26166323898f019c72122feaa66ca879eb15136ec7731b2b380d7f: Status 404 returned error can't find the container with id 5d307c40bf26166323898f019c72122feaa66ca879eb15136ec7731b2b380d7f
Sep 15 08:18:50.561752 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:50.561710    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-bjwsg" event={"ID":"5b4efeb0-234e-406b-ab38-fb1f84296d3d","Type":"ContainerStarted","Data":"a7d40d158dd41e230e7ccd89ded9244def452eb091780837a0ee32fed48e6414"}
Sep 15 08:18:50.561943 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:50.561766    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-bjwsg" event={"ID":"5b4efeb0-234e-406b-ab38-fb1f84296d3d","Type":"ContainerStarted","Data":"5d307c40bf26166323898f019c72122feaa66ca879eb15136ec7731b2b380d7f"}
Sep 15 08:18:50.561943 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:50.561849    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-bjwsg"
Sep 15 08:18:50.576696 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:18:50.576625    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-bjwsg" podStartSLOduration=1.576609071 podStartE2EDuration="1.576609071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 08:18:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 08:18:50.576078088 +0000 UTC m=+1683.367540816" watchObservedRunningTime="2026-09-15 08:18:50.576609071 +0000 UTC m=+1683.368071809"
Sep 15 08:19:01.568444 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:01.568406    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-bjwsg"
Sep 15 08:19:04.254320 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:04.254283    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:19:04.354923 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:04.354883    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:19:10.069841 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.069756    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:19:10.170539 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.170502    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:19:10.264553 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.264524    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:19:10.269416 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.269390    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"]
Sep 15 08:19:10.273136 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.273114    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:10.275880 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.275861    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 15 08:19:10.275880 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.275863    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 15 08:19:10.276069 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.275968    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 15 08:19:10.276370 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.276356    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 15 08:19:10.276856 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.276840    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 15 08:19:10.277098 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.277085    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-jcb9r\""
Sep 15 08:19:10.277508 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.277494    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 15 08:19:10.288564 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.288542    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"]
Sep 15 08:19:10.329117 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.329037    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:19:10.333166 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.333143    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-wp2md\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:10.333336 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.333175    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt54d\" (UniqueName: \"kubernetes.io/projected/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-kube-api-access-tt54d\") pod \"feast-simple-feast-setup-57576b8fcf-wp2md\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:10.333336 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.333222    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wp2md\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:10.333336 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.333246    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wp2md\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:10.333336 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.333261    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wp2md\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:10.333336 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.333284    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wp2md\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:10.390444 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.390407    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:19:10.433675 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.433626    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wp2md\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:10.433815 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.433697    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wp2md\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:10.433815 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.433724    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wp2md\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:10.433815 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.433747    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wp2md\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:10.433815 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.433806    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-wp2md\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:10.434011 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.433841    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt54d\" (UniqueName: \"kubernetes.io/projected/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-kube-api-access-tt54d\") pod \"feast-simple-feast-setup-57576b8fcf-wp2md\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:10.434276 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.434251    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-wp2md\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:10.436348 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.436327    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wp2md\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:10.436442 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.436347    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wp2md\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:10.436482 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.436470    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wp2md\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:10.436518 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.436490    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wp2md\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:10.441757 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.441737    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt54d\" (UniqueName: \"kubernetes.io/projected/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-kube-api-access-tt54d\") pod \"feast-simple-feast-setup-57576b8fcf-wp2md\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:10.449569 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.449547    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:19:10.589249 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.589211    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:10.867998 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:10.867970    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"]
Sep 15 08:19:10.869547 ip-10-0-134-189 kubenswrapper[2586]: W0915 08:19:10.869505    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c89e4f0_52ab_4b3d_bdec_106064e1c3dc.slice/crio-a5cec14f22dc45d8d2ab4aa43f471ff4fc48c14134cbf0ec015d27aa3df8d9d1 WatchSource:0}: Error finding container a5cec14f22dc45d8d2ab4aa43f471ff4fc48c14134cbf0ec015d27aa3df8d9d1: Status 404 returned error can't find the container with id a5cec14f22dc45d8d2ab4aa43f471ff4fc48c14134cbf0ec015d27aa3df8d9d1
Sep 15 08:19:11.643954 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:11.643905    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" event={"ID":"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc","Type":"ContainerStarted","Data":"e143ac1b9d9a19ac9788e8e379ae583810a5913eac6d07ec75bcfa5eb844e35b"}
Sep 15 08:19:11.644389 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:11.643962    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" event={"ID":"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc","Type":"ContainerStarted","Data":"a5cec14f22dc45d8d2ab4aa43f471ff4fc48c14134cbf0ec015d27aa3df8d9d1"}
Sep 15 08:19:16.669289 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:16.669258    2586 generic.go:356] "Generic (PLEG): container finished" podID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerID="e143ac1b9d9a19ac9788e8e379ae583810a5913eac6d07ec75bcfa5eb844e35b" exitCode=0
Sep 15 08:19:16.669766 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:16.669312    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" event={"ID":"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc","Type":"ContainerDied","Data":"e143ac1b9d9a19ac9788e8e379ae583810a5913eac6d07ec75bcfa5eb844e35b"}
Sep 15 08:19:17.674937 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:17.674899    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" event={"ID":"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc","Type":"ContainerStarted","Data":"18d4841c522cbc242127076f6b36ecd53f7e3bca9108a6bbe30b0456caa565e0"}
Sep 15 08:19:22.696083 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:22.696050    2586 generic.go:356] "Generic (PLEG): container finished" podID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerID="18d4841c522cbc242127076f6b36ecd53f7e3bca9108a6bbe30b0456caa565e0" exitCode=0
Sep 15 08:19:22.696457 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:22.696102    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" event={"ID":"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc","Type":"ContainerDied","Data":"18d4841c522cbc242127076f6b36ecd53f7e3bca9108a6bbe30b0456caa565e0"}
Sep 15 08:19:23.706234 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:23.706187    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" event={"ID":"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc","Type":"ContainerStarted","Data":"606b1cd24020145fffe0a065e25c95a781b3e400b9810d3a1fd149c3dc482bac"}
Sep 15 08:19:23.706736 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:23.706253    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" event={"ID":"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc","Type":"ContainerStarted","Data":"bd81816730b2260e89b5c45f299342bc45149cc687c57c3000b582927a2ea475"}
Sep 15 08:19:23.706736 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:23.706273    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" event={"ID":"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc","Type":"ContainerStarted","Data":"fbe5dab9e53d105276ae31ccb312cc9787bb74f471e7e57d21de89254c5157cc"}
Sep 15 08:19:23.706736 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:23.706292    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" event={"ID":"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc","Type":"ContainerStarted","Data":"3cf9b32e34639866ddc49974914892b4d7664f2cece400e3ab5cf8202463b4ea"}
Sep 15 08:19:23.730542 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:23.730467    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" podStartSLOduration=13.730444521999999 podStartE2EDuration="13.730444522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 08:19:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 08:19:23.728135139 +0000 UTC m=+1716.519597865" watchObservedRunningTime="2026-09-15 08:19:23.730444522 +0000 UTC m=+1716.521907247"
Sep 15 08:19:25.589818 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:25.589775    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:25.590311 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:25.590269    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:25.590311 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:25.590307    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:25.590468 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:25.590327    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:25.591725 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:25.591686    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.36:6571: connect: connection refused"
Sep 15 08:19:25.591725 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:25.591713    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Sep 15 08:19:25.591940 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:25.591782    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Sep 15 08:19:25.591940 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:25.591837    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.36:8816: connect: connection refused"
Sep 15 08:19:28.589964 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:28.589905    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.36:8816: connect: connection refused"
Sep 15 08:19:28.590468 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:28.589914    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Sep 15 08:19:28.590468 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:28.590183    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.36:6571: connect: connection refused"
Sep 15 08:19:28.590468 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:28.590393    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Sep 15 08:19:30.590289 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:30.590253    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:30.590781 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:30.590323    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:30.590781 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:30.590337    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:30.590781 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:30.590347    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:31.590420 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:31.590392    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:31.590944 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:31.590514    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:31.590944 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:31.590735    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:31.595772 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:31.595750    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:31.750617 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:31.750545    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:31.750842 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:31.750749    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:31.750842 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:31.750804    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:19:31.753446 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:19:31.753419    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:20:26.439537 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:26.439497    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:20:26.491801 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:26.491769    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:20:33.577248 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:33.577208    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:20:33.582413 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:33.582380    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"]
Sep 15 08:20:33.582713 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:33.582680    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="registry" containerID="cri-o://3cf9b32e34639866ddc49974914892b4d7664f2cece400e3ab5cf8202463b4ea" gracePeriod=30
Sep 15 08:20:33.582915 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:33.582889    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="online" containerID="cri-o://fbe5dab9e53d105276ae31ccb312cc9787bb74f471e7e57d21de89254c5157cc" gracePeriod=30
Sep 15 08:20:33.583030 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:33.582997    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="offline" containerID="cri-o://bd81816730b2260e89b5c45f299342bc45149cc687c57c3000b582927a2ea475" gracePeriod=30
Sep 15 08:20:33.583143 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:33.582867    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="ui" containerID="cri-o://606b1cd24020145fffe0a065e25c95a781b3e400b9810d3a1fd149c3dc482bac" gracePeriod=30
Sep 15 08:20:33.674968 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:33.674936    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:20:33.873252 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:33.873209    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:20:33.973156 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:33.973105    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:20:34.077262 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.077220    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"]
Sep 15 08:20:34.081866 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.081843    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:34.084203 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.084182    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-89wt2\""
Sep 15 08:20:34.091133 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.091108    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"]
Sep 15 08:20:34.172272 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.172239    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:20:34.214598 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.214560    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-bmrp9\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:34.214804 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.214604    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-bmrp9\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:34.214804 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.214648    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2f4l\" (UniqueName: \"kubernetes.io/projected/99be9755-8d98-47cf-b68c-b42b5217ec70-kube-api-access-b2f4l\") pod \"feast-simple-feast-setup-57576b8fcf-bmrp9\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:34.214804 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.214752    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-bmrp9\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:34.214804 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.214788    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-bmrp9\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:34.214978 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.214843    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/99be9755-8d98-47cf-b68c-b42b5217ec70-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-bmrp9\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:34.273864 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.273823    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:20:34.315974 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.315937    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/99be9755-8d98-47cf-b68c-b42b5217ec70-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-bmrp9\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:34.316163 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.315998    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-bmrp9\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:34.316163 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.316029    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-bmrp9\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:34.316163 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.316055    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2f4l\" (UniqueName: \"kubernetes.io/projected/99be9755-8d98-47cf-b68c-b42b5217ec70-kube-api-access-b2f4l\") pod \"feast-simple-feast-setup-57576b8fcf-bmrp9\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:34.316163 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.316105    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-bmrp9\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:34.316380 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:20:34.316276    2586 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Sep 15 08:20:34.316380 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.316301    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-bmrp9\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:34.316380 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:20:34.316357    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-registry-tls podName:99be9755-8d98-47cf-b68c-b42b5217ec70 nodeName:}" failed. No retries permitted until 2026-09-15 08:20:34.816338528 +0000 UTC m=+1787.607801231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-bmrp9" (UID: "99be9755-8d98-47cf-b68c-b42b5217ec70") : secret "feast-simple-feast-setup-registry-tls" not found
Sep 15 08:20:34.316540 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.316435    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/99be9755-8d98-47cf-b68c-b42b5217ec70-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-bmrp9\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:34.318778 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.318755    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-bmrp9\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:34.318899 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.318821    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-bmrp9\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:34.318899 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.318859    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-bmrp9\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:34.323826 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.323800    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2f4l\" (UniqueName: \"kubernetes.io/projected/99be9755-8d98-47cf-b68c-b42b5217ec70-kube-api-access-b2f4l\") pod \"feast-simple-feast-setup-57576b8fcf-bmrp9\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:34.373117 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.373093    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:20:34.646127 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.646096    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:20:34.822308 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.822228    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-bmrp9\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:34.824613 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.824590    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-bmrp9\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:34.991323 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.991293    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:34.991323 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.991316    2586 generic.go:356] "Generic (PLEG): container finished" podID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerID="606b1cd24020145fffe0a065e25c95a781b3e400b9810d3a1fd149c3dc482bac" exitCode=0
Sep 15 08:20:34.991536 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.991337    2586 generic.go:356] "Generic (PLEG): container finished" podID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerID="fbe5dab9e53d105276ae31ccb312cc9787bb74f471e7e57d21de89254c5157cc" exitCode=0
Sep 15 08:20:34.991536 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.991386    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" event={"ID":"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc","Type":"ContainerDied","Data":"606b1cd24020145fffe0a065e25c95a781b3e400b9810d3a1fd149c3dc482bac"}
Sep 15 08:20:34.991536 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:34.991417    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" event={"ID":"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc","Type":"ContainerDied","Data":"fbe5dab9e53d105276ae31ccb312cc9787bb74f471e7e57d21de89254c5157cc"}
Sep 15 08:20:35.264864 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:35.264836    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"]
Sep 15 08:20:35.265762 ip-10-0-134-189 kubenswrapper[2586]: W0915 08:20:35.265737    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99be9755_8d98_47cf_b68c_b42b5217ec70.slice/crio-2defb4364e9c406bf3d8e75b19155ef25a53a88bb885b31dc16e8c1f68c82d11 WatchSource:0}: Error finding container 2defb4364e9c406bf3d8e75b19155ef25a53a88bb885b31dc16e8c1f68c82d11: Status 404 returned error can't find the container with id 2defb4364e9c406bf3d8e75b19155ef25a53a88bb885b31dc16e8c1f68c82d11
Sep 15 08:20:35.997485 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:35.997441    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" event={"ID":"99be9755-8d98-47cf-b68c-b42b5217ec70","Type":"ContainerStarted","Data":"d51d502f39109d367810f6ac81aa7b65d0273687455cabe43bb4f028f61833d2"}
Sep 15 08:20:35.997977 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:35.997498    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" event={"ID":"99be9755-8d98-47cf-b68c-b42b5217ec70","Type":"ContainerStarted","Data":"2defb4364e9c406bf3d8e75b19155ef25a53a88bb885b31dc16e8c1f68c82d11"}
Sep 15 08:20:41.016993 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:41.016957    2586 generic.go:356] "Generic (PLEG): container finished" podID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerID="d51d502f39109d367810f6ac81aa7b65d0273687455cabe43bb4f028f61833d2" exitCode=0
Sep 15 08:20:41.017425 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:41.017029    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" event={"ID":"99be9755-8d98-47cf-b68c-b42b5217ec70","Type":"ContainerDied","Data":"d51d502f39109d367810f6ac81aa7b65d0273687455cabe43bb4f028f61833d2"}
Sep 15 08:20:41.750227 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:41.750184    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Sep 15 08:20:41.750441 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:41.750187    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Sep 15 08:20:42.023479 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:42.023389    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" event={"ID":"99be9755-8d98-47cf-b68c-b42b5217ec70","Type":"ContainerStarted","Data":"2f079678784b414fb06c4190b4d5463fd3516bb1a7204928c006f45bb9908581"}
Sep 15 08:20:47.057245 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:47.057154    2586 generic.go:356] "Generic (PLEG): container finished" podID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerID="2f079678784b414fb06c4190b4d5463fd3516bb1a7204928c006f45bb9908581" exitCode=0
Sep 15 08:20:47.057245 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:47.057219    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" event={"ID":"99be9755-8d98-47cf-b68c-b42b5217ec70","Type":"ContainerDied","Data":"2f079678784b414fb06c4190b4d5463fd3516bb1a7204928c006f45bb9908581"}
Sep 15 08:20:47.766152 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:47.766125    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cp9wl_a5527013-2ce3-48e3-b472-a593cbfbb55f/console-operator/1.log"
Sep 15 08:20:47.775894 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:47.775860    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cp9wl_a5527013-2ce3-48e3-b472-a593cbfbb55f/console-operator/1.log"
Sep 15 08:20:48.067646 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:48.067531    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" event={"ID":"99be9755-8d98-47cf-b68c-b42b5217ec70","Type":"ContainerStarted","Data":"29be9715cf98ee8ac15ef94cefbd581bd7c6674965562307934e05308052cae0"}
Sep 15 08:20:48.067646 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:48.067598    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" event={"ID":"99be9755-8d98-47cf-b68c-b42b5217ec70","Type":"ContainerStarted","Data":"32069ab5f1070387e2cac4636ce4e45b81fea7ff1fbd1807f5d20eaeda0a6bd3"}
Sep 15 08:20:48.068179 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:48.067625    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" event={"ID":"99be9755-8d98-47cf-b68c-b42b5217ec70","Type":"ContainerStarted","Data":"ac782f3c844350c8b64493d570cc5d356c223d5bcfee1f52e8e42fc7ad83eb4c"}
Sep 15 08:20:48.068179 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:48.067676    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" event={"ID":"99be9755-8d98-47cf-b68c-b42b5217ec70","Type":"ContainerStarted","Data":"6c14c6be0ef4b3ef6da663375f3e7b24d0ff26356161cdd2cdb26a8d570ba7ec"}
Sep 15 08:20:48.092527 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:48.092459    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" podStartSLOduration=14.092437324 podStartE2EDuration="14.092437324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 08:20:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 08:20:48.089607189 +0000 UTC m=+1800.881069914" watchObservedRunningTime="2026-09-15 08:20:48.092437324 +0000 UTC m=+1800.883900048"
Sep 15 08:20:49.991568 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:49.991516    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:49.992072 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:49.991698    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:49.992072 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:49.991751    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:49.992072 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:49.991771    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:49.994042 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:49.993996    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.37:6571: connect: connection refused"
Sep 15 08:20:49.994165 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:49.994057    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Sep 15 08:20:49.994287 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:49.994032    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Sep 15 08:20:49.994421 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:49.994323    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.37:8816: connect: connection refused"
Sep 15 08:20:51.750424 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:51.750381    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Sep 15 08:20:51.751058 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:51.751021    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Sep 15 08:20:52.992112 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:52.992063    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Sep 15 08:20:52.992112 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:52.992091    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Sep 15 08:20:52.992692 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:52.992063    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.37:8816: connect: connection refused"
Sep 15 08:20:52.992692 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:52.992581    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.37:6571: connect: connection refused"
Sep 15 08:20:54.992266 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:54.992213    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:54.992770 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:54.992297    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:54.992770 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:54.992313    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:54.992770 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:54.992326    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:55.992783 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:55.992754    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:55.993218 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:55.992866    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:55.993218 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:55.993091    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:55.993689 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:55.993664    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:55.993812 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:55.993777    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:55.994016 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:55.994003    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:55.998083 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:55.998067    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:20:56.114612 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:20:56.114586    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:21:01.750379 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:01.750328    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Sep 15 08:21:01.750991 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:01.750425    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Sep 15 08:21:01.750991 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:01.750621    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:21:01.750991 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:01.750745    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:21:04.145488 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.145456    2586 generic.go:356] "Generic (PLEG): container finished" podID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerID="bd81816730b2260e89b5c45f299342bc45149cc687c57c3000b582927a2ea475" exitCode=137
Sep 15 08:21:04.145488 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.145482    2586 generic.go:356] "Generic (PLEG): container finished" podID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerID="3cf9b32e34639866ddc49974914892b4d7664f2cece400e3ab5cf8202463b4ea" exitCode=137
Sep 15 08:21:04.145901 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.145529    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" event={"ID":"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc","Type":"ContainerDied","Data":"bd81816730b2260e89b5c45f299342bc45149cc687c57c3000b582927a2ea475"}
Sep 15 08:21:04.145901 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.145571    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" event={"ID":"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc","Type":"ContainerDied","Data":"3cf9b32e34639866ddc49974914892b4d7664f2cece400e3ab5cf8202463b4ea"}
Sep 15 08:21:04.229467 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.229443    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:21:04.270001 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.269971    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt54d\" (UniqueName: \"kubernetes.io/projected/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-kube-api-access-tt54d\") pod \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") "
Sep 15 08:21:04.270174 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.270039    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-registry-tls\") pod \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") "
Sep 15 08:21:04.270174 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.270086    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-offline-tls\") pod \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") "
Sep 15 08:21:04.270174 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.270111    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-ui-tls\") pod \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") "
Sep 15 08:21:04.270174 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.270129    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-online-tls\") pod \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") "
Sep 15 08:21:04.270174 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.270163    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-feast-data\") pod \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\" (UID: \"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc\") "
Sep 15 08:21:04.270910 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.270863    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-feast-data" (OuterVolumeSpecName: "feast-data") pod "8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" (UID: "8c89e4f0-52ab-4b3d-bdec-106064e1c3dc"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 08:21:04.272456 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.272419    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" (UID: "8c89e4f0-52ab-4b3d-bdec-106064e1c3dc"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:21:04.272456 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.272446    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-kube-api-access-tt54d" (OuterVolumeSpecName: "kube-api-access-tt54d") pod "8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" (UID: "8c89e4f0-52ab-4b3d-bdec-106064e1c3dc"). InnerVolumeSpecName "kube-api-access-tt54d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 08:21:04.272654 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.272582    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" (UID: "8c89e4f0-52ab-4b3d-bdec-106064e1c3dc"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:21:04.272732 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.272714    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-online-tls" (OuterVolumeSpecName: "online-tls") pod "8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" (UID: "8c89e4f0-52ab-4b3d-bdec-106064e1c3dc"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:21:04.273001 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.272982    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" (UID: "8c89e4f0-52ab-4b3d-bdec-106064e1c3dc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:21:04.371249 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.371159    2586 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-registry-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:21:04.371249 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.371191    2586 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-offline-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:21:04.371249 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.371200    2586 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-ui-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:21:04.371249 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.371208    2586 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-online-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:21:04.371249 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.371216    2586 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-feast-data\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:21:04.371249 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:04.371224    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt54d\" (UniqueName: \"kubernetes.io/projected/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc-kube-api-access-tt54d\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:21:05.152394 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:05.152364    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md" event={"ID":"8c89e4f0-52ab-4b3d-bdec-106064e1c3dc","Type":"ContainerDied","Data":"a5cec14f22dc45d8d2ab4aa43f471ff4fc48c14134cbf0ec015d27aa3df8d9d1"}
Sep 15 08:21:05.152843 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:05.152417    2586 scope.go:117] "RemoveContainer" containerID="606b1cd24020145fffe0a065e25c95a781b3e400b9810d3a1fd149c3dc482bac"
Sep 15 08:21:05.152843 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:05.152373    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"
Sep 15 08:21:05.161148 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:05.161110    2586 scope.go:117] "RemoveContainer" containerID="bd81816730b2260e89b5c45f299342bc45149cc687c57c3000b582927a2ea475"
Sep 15 08:21:05.168496 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:05.168478    2586 scope.go:117] "RemoveContainer" containerID="fbe5dab9e53d105276ae31ccb312cc9787bb74f471e7e57d21de89254c5157cc"
Sep 15 08:21:05.175785 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:05.175761    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"]
Sep 15 08:21:05.176156 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:05.176142    2586 scope.go:117] "RemoveContainer" containerID="3cf9b32e34639866ddc49974914892b4d7664f2cece400e3ab5cf8202463b4ea"
Sep 15 08:21:05.179126 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:05.179105    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-wp2md"]
Sep 15 08:21:05.183469 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:05.183454    2586 scope.go:117] "RemoveContainer" containerID="18d4841c522cbc242127076f6b36ecd53f7e3bca9108a6bbe30b0456caa565e0"
Sep 15 08:21:05.190242 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:05.190224    2586 scope.go:117] "RemoveContainer" containerID="e143ac1b9d9a19ac9788e8e379ae583810a5913eac6d07ec75bcfa5eb844e35b"
Sep 15 08:21:05.720008 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:05.719968    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" path="/var/lib/kubelet/pods/8c89e4f0-52ab-4b3d-bdec-106064e1c3dc/volumes"
Sep 15 08:21:26.098939 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:26.098899    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:21:58.206391 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.206350    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:21:58.308123 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.308090    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:21:58.584111 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.584082    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:21:58.670379 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.670346    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:21:58.674343 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.674321    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"]
Sep 15 08:21:58.674596 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.674586    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="feast-apply"
Sep 15 08:21:58.674666 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.674598    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="feast-apply"
Sep 15 08:21:58.674666 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.674614    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="ui"
Sep 15 08:21:58.674666 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.674620    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="ui"
Sep 15 08:21:58.674666 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.674628    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="online"
Sep 15 08:21:58.674666 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.674646    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="online"
Sep 15 08:21:58.674666 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.674656    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="feast-init"
Sep 15 08:21:58.674666 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.674661    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="feast-init"
Sep 15 08:21:58.674666 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.674666    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="offline"
Sep 15 08:21:58.674917 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.674672    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="offline"
Sep 15 08:21:58.674917 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.674680    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="registry"
Sep 15 08:21:58.674917 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.674685    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="registry"
Sep 15 08:21:58.674917 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.674733    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="registry"
Sep 15 08:21:58.674917 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.674740    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="offline"
Sep 15 08:21:58.674917 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.674766    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="ui"
Sep 15 08:21:58.674917 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.674773    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c89e4f0-52ab-4b3d-bdec-106064e1c3dc" containerName="online"
Sep 15 08:21:58.677805 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.677789    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:58.680437 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.680416    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 15 08:21:58.680437 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.680434    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 15 08:21:58.680625 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.680463    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 15 08:21:58.680625 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.680419    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 15 08:21:58.680625 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.680469    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 15 08:21:58.680904 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.680888    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 15 08:21:58.681414 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.681396    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-v7r5c\""
Sep 15 08:21:58.686436 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.686419    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nhmds\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:58.686525 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.686462    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nhmds\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:58.686525 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.686485    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c95daea2-0923-40c2-bebb-b6392eef35c8-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nhmds\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:58.686525 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.686502    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nhmds\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:58.686525 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.686520    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkw9v\" (UniqueName: \"kubernetes.io/projected/c95daea2-0923-40c2-bebb-b6392eef35c8-kube-api-access-pkw9v\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nhmds\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:58.686699 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.686538    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c95daea2-0923-40c2-bebb-b6392eef35c8-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nhmds\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:58.689841 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.689821    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"]
Sep 15 08:21:58.787290 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.787257    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nhmds\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:58.787290 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.787294    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c95daea2-0923-40c2-bebb-b6392eef35c8-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nhmds\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:58.787618 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.787315    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nhmds\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:58.787618 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.787338    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkw9v\" (UniqueName: \"kubernetes.io/projected/c95daea2-0923-40c2-bebb-b6392eef35c8-kube-api-access-pkw9v\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nhmds\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:58.787618 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.787356    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c95daea2-0923-40c2-bebb-b6392eef35c8-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nhmds\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:58.787618 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.787400    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nhmds\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:58.787618 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:21:58.787410    2586 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 15 08:21:58.787618 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:21:58.787434    2586 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
Sep 15 08:21:58.787618 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:21:58.787468    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-ui-tls podName:c95daea2-0923-40c2-bebb-b6392eef35c8 nodeName:}" failed. No retries permitted until 2026-09-15 08:21:59.287450773 +0000 UTC m=+1872.078913474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-ui-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-nhmds" (UID: "c95daea2-0923-40c2-bebb-b6392eef35c8") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 15 08:21:58.787618 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:21:58.787503    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-offline-tls podName:c95daea2-0923-40c2-bebb-b6392eef35c8 nodeName:}" failed. No retries permitted until 2026-09-15 08:21:59.28748557 +0000 UTC m=+1872.078948271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-offline-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-nhmds" (UID: "c95daea2-0923-40c2-bebb-b6392eef35c8") : secret "feast-simple-feast-remote-setup-offline-tls" not found
Sep 15 08:21:58.788117 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.787849    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c95daea2-0923-40c2-bebb-b6392eef35c8-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nhmds\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:58.788175 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.788143    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c95daea2-0923-40c2-bebb-b6392eef35c8-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nhmds\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:58.789821 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.789804    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nhmds\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:58.795409 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.795379    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:21:58.796830 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.796810    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkw9v\" (UniqueName: \"kubernetes.io/projected/c95daea2-0923-40c2-bebb-b6392eef35c8-kube-api-access-pkw9v\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nhmds\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:58.895669 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:58.895569    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:21:59.008834 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:59.008809    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:21:59.292086 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:59.292003    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nhmds\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:59.292485 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:59.292189    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nhmds\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:59.294464 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:59.294432    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nhmds\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:59.294464 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:59.294444    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nhmds\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:59.586754 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:59.586719    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:21:59.861939 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:21:59.861909    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"]
Sep 15 08:21:59.863574 ip-10-0-134-189 kubenswrapper[2586]: W0915 08:21:59.863548    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc95daea2_0923_40c2_bebb_b6392eef35c8.slice/crio-03377dd3c15354a5573d2e0644c1632f1f4471ba1ed01d9bf4ea58dfe4bb0318 WatchSource:0}: Error finding container 03377dd3c15354a5573d2e0644c1632f1f4471ba1ed01d9bf4ea58dfe4bb0318: Status 404 returned error can't find the container with id 03377dd3c15354a5573d2e0644c1632f1f4471ba1ed01d9bf4ea58dfe4bb0318
Sep 15 08:22:00.364668 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:00.364613    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" event={"ID":"c95daea2-0923-40c2-bebb-b6392eef35c8","Type":"ContainerStarted","Data":"b34fe48e1c53b66ff7060d518f50ce91772e2f8382b8a956cb6ec1b721de5275"}
Sep 15 08:22:00.365052 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:00.364678    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" event={"ID":"c95daea2-0923-40c2-bebb-b6392eef35c8","Type":"ContainerStarted","Data":"03377dd3c15354a5573d2e0644c1632f1f4471ba1ed01d9bf4ea58dfe4bb0318"}
Sep 15 08:22:05.386409 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:05.386376    2586 generic.go:356] "Generic (PLEG): container finished" podID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerID="b34fe48e1c53b66ff7060d518f50ce91772e2f8382b8a956cb6ec1b721de5275" exitCode=0
Sep 15 08:22:05.386814 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:05.386449    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" event={"ID":"c95daea2-0923-40c2-bebb-b6392eef35c8","Type":"ContainerDied","Data":"b34fe48e1c53b66ff7060d518f50ce91772e2f8382b8a956cb6ec1b721de5275"}
Sep 15 08:22:06.392304 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:06.392269    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" event={"ID":"c95daea2-0923-40c2-bebb-b6392eef35c8","Type":"ContainerStarted","Data":"37607d4f5df524c1928036442591c5bc8e48ddfda962e2fa1ca99e20eb04358f"}
Sep 15 08:22:25.472279 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:25.472245    2586 generic.go:356] "Generic (PLEG): container finished" podID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerID="37607d4f5df524c1928036442591c5bc8e48ddfda962e2fa1ca99e20eb04358f" exitCode=0
Sep 15 08:22:25.472617 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:25.472315    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" event={"ID":"c95daea2-0923-40c2-bebb-b6392eef35c8","Type":"ContainerDied","Data":"37607d4f5df524c1928036442591c5bc8e48ddfda962e2fa1ca99e20eb04358f"}
Sep 15 08:22:26.481422 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:26.481382    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" event={"ID":"c95daea2-0923-40c2-bebb-b6392eef35c8","Type":"ContainerStarted","Data":"83b83bde8f47d23114ee160b7ff11dd2128baf67d2b6845b3c281b46f93785a9"}
Sep 15 08:22:26.481919 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:26.481442    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" event={"ID":"c95daea2-0923-40c2-bebb-b6392eef35c8","Type":"ContainerStarted","Data":"b9e3f5d8ae2fe7fe7cd07e9d0767add3859e91fcb209d4178baed343ecf9f47d"}
Sep 15 08:22:26.481919 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:26.481462    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" event={"ID":"c95daea2-0923-40c2-bebb-b6392eef35c8","Type":"ContainerStarted","Data":"3670e9ec829884992cc101043d5c65e82a9157cc1de4af392f8a2365ea7ba565"}
Sep 15 08:22:26.505740 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:26.505678    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" podStartSLOduration=28.505656117 podStartE2EDuration="28.505656117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 08:21:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 08:22:26.502952868 +0000 UTC m=+1899.294415627" watchObservedRunningTime="2026-09-15 08:22:26.505656117 +0000 UTC m=+1899.297118843"
Sep 15 08:22:26.587727 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:26.587688    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:22:26.587924 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:26.587755    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:22:26.587924 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:26.587777    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:22:26.589408 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:26.589371    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.38:8443: connect: connection refused"
Sep 15 08:22:26.589537 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:26.589400    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.38:8816: connect: connection refused"
Sep 15 08:22:26.589537 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:26.589427    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Sep 15 08:22:29.587763 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:29.587711    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:22:29.588264 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:29.587782    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:22:29.588264 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:29.587801    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:22:29.588264 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:29.587981    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Sep 15 08:22:29.588264 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:29.588004    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.38:8443: connect: connection refused"
Sep 15 08:22:29.588264 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:29.588076    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.38:8816: connect: connection refused"
Sep 15 08:22:32.587132 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:32.587072    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.38:8816: connect: connection refused"
Sep 15 08:22:32.587613 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:32.587086    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.38:8443: connect: connection refused"
Sep 15 08:22:32.587613 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:32.587084    2586 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Sep 15 08:22:35.588273 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:35.588238    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:22:35.588748 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:35.588699    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:22:35.589206 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:35.589192    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:22:36.301982 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:36.301950    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:22:36.526238 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:36.526212    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:22:37.165784 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:37.165748    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:22:57.016981 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:22:57.016939    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:23:37.530777 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:37.530728    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 15 08:23:38.733820 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:38.733776    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"]
Sep 15 08:23:38.734429 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:38.734002    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="online" containerID="cri-o://3670e9ec829884992cc101043d5c65e82a9157cc1de4af392f8a2365ea7ba565" gracePeriod=30
Sep 15 08:23:38.734429 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:38.734066    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="ui" containerID="cri-o://83b83bde8f47d23114ee160b7ff11dd2128baf67d2b6845b3c281b46f93785a9" gracePeriod=30
Sep 15 08:23:38.734429 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:38.734109    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="offline" containerID="cri-o://b9e3f5d8ae2fe7fe7cd07e9d0767add3859e91fcb209d4178baed343ecf9f47d" gracePeriod=30
Sep 15 08:23:38.742205 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:38.742173    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:23:38.803616 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:38.803587    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:23:38.877810 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:38.877776    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"]
Sep 15 08:23:38.878076 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:38.878045    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="registry" containerID="cri-o://6c14c6be0ef4b3ef6da663375f3e7b24d0ff26356161cdd2cdb26a8d570ba7ec" gracePeriod=30
Sep 15 08:23:38.878294 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:38.878076    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="offline" containerID="cri-o://32069ab5f1070387e2cac4636ce4e45b81fea7ff1fbd1807f5d20eaeda0a6bd3" gracePeriod=30
Sep 15 08:23:38.878429 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:38.878112    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="online" containerID="cri-o://ac782f3c844350c8b64493d570cc5d356c223d5bcfee1f52e8e42fc7ad83eb4c" gracePeriod=30
Sep 15 08:23:38.878429 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:38.878104    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="ui" containerID="cri-o://29be9715cf98ee8ac15ef94cefbd581bd7c6674965562307934e05308052cae0" gracePeriod=30
Sep 15 08:23:38.887120 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:38.887096    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:23:38.978646 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:38.978591    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:23:39.769922 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:39.769891    2586 generic.go:356] "Generic (PLEG): container finished" podID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerID="29be9715cf98ee8ac15ef94cefbd581bd7c6674965562307934e05308052cae0" exitCode=0
Sep 15 08:23:39.769922 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:39.769916    2586 generic.go:356] "Generic (PLEG): container finished" podID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerID="ac782f3c844350c8b64493d570cc5d356c223d5bcfee1f52e8e42fc7ad83eb4c" exitCode=0
Sep 15 08:23:39.770372 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:39.769969    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" event={"ID":"99be9755-8d98-47cf-b68c-b42b5217ec70","Type":"ContainerDied","Data":"29be9715cf98ee8ac15ef94cefbd581bd7c6674965562307934e05308052cae0"}
Sep 15 08:23:39.770372 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:39.770017    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" event={"ID":"99be9755-8d98-47cf-b68c-b42b5217ec70","Type":"ContainerDied","Data":"ac782f3c844350c8b64493d570cc5d356c223d5bcfee1f52e8e42fc7ad83eb4c"}
Sep 15 08:23:39.772534 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:39.772517    2586 generic.go:356] "Generic (PLEG): container finished" podID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerID="83b83bde8f47d23114ee160b7ff11dd2128baf67d2b6845b3c281b46f93785a9" exitCode=0
Sep 15 08:23:39.772534 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:39.772533    2586 generic.go:356] "Generic (PLEG): container finished" podID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerID="3670e9ec829884992cc101043d5c65e82a9157cc1de4af392f8a2365ea7ba565" exitCode=0
Sep 15 08:23:39.772673 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:39.772586    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" event={"ID":"c95daea2-0923-40c2-bebb-b6392eef35c8","Type":"ContainerDied","Data":"83b83bde8f47d23114ee160b7ff11dd2128baf67d2b6845b3c281b46f93785a9"}
Sep 15 08:23:39.772673 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:39.772616    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" event={"ID":"c95daea2-0923-40c2-bebb-b6392eef35c8","Type":"ContainerDied","Data":"3670e9ec829884992cc101043d5c65e82a9157cc1de4af392f8a2365ea7ba565"}
Sep 15 08:23:44.023117 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:44.023076    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:23:45.588976 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:45.588937    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.38:8443: connect: connection refused"
Sep 15 08:23:45.993748 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:45.993621    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Sep 15 08:23:46.112350 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:46.112305    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Sep 15 08:23:46.526488 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:46.526443    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Sep 15 08:23:55.589726 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:55.589684    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.38:8443: connect: connection refused"
Sep 15 08:23:55.993679 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:55.993556    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Sep 15 08:23:56.111812 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:56.111769    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Sep 15 08:23:56.526888 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:56.526838    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Sep 15 08:23:56.527078 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:23:56.526975    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:24:05.589464 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:05.589419    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.38:8443: connect: connection refused"
Sep 15 08:24:05.589846 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:05.589533    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:24:05.994171 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:05.994073    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Sep 15 08:24:05.994337 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:05.994213    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:24:06.112440 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:06.112394    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Sep 15 08:24:06.112673 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:06.112510    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:24:06.526799 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:06.526759    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Sep 15 08:24:08.890883 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:08.890818    2586 generic.go:356] "Generic (PLEG): container finished" podID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerID="b9e3f5d8ae2fe7fe7cd07e9d0767add3859e91fcb209d4178baed343ecf9f47d" exitCode=137
Sep 15 08:24:08.891168 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:08.890892    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" event={"ID":"c95daea2-0923-40c2-bebb-b6392eef35c8","Type":"ContainerDied","Data":"b9e3f5d8ae2fe7fe7cd07e9d0767add3859e91fcb209d4178baed343ecf9f47d"}
Sep 15 08:24:09.378692 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.378665    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:24:09.438853 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.438826    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-offline-tls\") pod \"c95daea2-0923-40c2-bebb-b6392eef35c8\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") "
Sep 15 08:24:09.439043 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.438882    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-online-tls\") pod \"c95daea2-0923-40c2-bebb-b6392eef35c8\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") "
Sep 15 08:24:09.439043 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.438911    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkw9v\" (UniqueName: \"kubernetes.io/projected/c95daea2-0923-40c2-bebb-b6392eef35c8-kube-api-access-pkw9v\") pod \"c95daea2-0923-40c2-bebb-b6392eef35c8\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") "
Sep 15 08:24:09.439043 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.438927    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-ui-tls\") pod \"c95daea2-0923-40c2-bebb-b6392eef35c8\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") "
Sep 15 08:24:09.439043 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.438953    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c95daea2-0923-40c2-bebb-b6392eef35c8-feast-data\") pod \"c95daea2-0923-40c2-bebb-b6392eef35c8\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") "
Sep 15 08:24:09.439043 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.438979    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c95daea2-0923-40c2-bebb-b6392eef35c8-registry-tls\") pod \"c95daea2-0923-40c2-bebb-b6392eef35c8\" (UID: \"c95daea2-0923-40c2-bebb-b6392eef35c8\") "
Sep 15 08:24:09.439525 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.439479    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c95daea2-0923-40c2-bebb-b6392eef35c8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c95daea2-0923-40c2-bebb-b6392eef35c8" (UID: "c95daea2-0923-40c2-bebb-b6392eef35c8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 08:24:09.439767 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.439738    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c95daea2-0923-40c2-bebb-b6392eef35c8-feast-data" (OuterVolumeSpecName: "feast-data") pod "c95daea2-0923-40c2-bebb-b6392eef35c8" (UID: "c95daea2-0923-40c2-bebb-b6392eef35c8"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 08:24:09.441178 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.441150    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-online-tls" (OuterVolumeSpecName: "online-tls") pod "c95daea2-0923-40c2-bebb-b6392eef35c8" (UID: "c95daea2-0923-40c2-bebb-b6392eef35c8"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:24:09.441383 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.441356    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c95daea2-0923-40c2-bebb-b6392eef35c8-kube-api-access-pkw9v" (OuterVolumeSpecName: "kube-api-access-pkw9v") pod "c95daea2-0923-40c2-bebb-b6392eef35c8" (UID: "c95daea2-0923-40c2-bebb-b6392eef35c8"). InnerVolumeSpecName "kube-api-access-pkw9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 08:24:09.441383 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.441354    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "c95daea2-0923-40c2-bebb-b6392eef35c8" (UID: "c95daea2-0923-40c2-bebb-b6392eef35c8"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:24:09.441505 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.441424    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "c95daea2-0923-40c2-bebb-b6392eef35c8" (UID: "c95daea2-0923-40c2-bebb-b6392eef35c8"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:24:09.511467 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.511442    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:24:09.539412 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.539384    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/99be9755-8d98-47cf-b68c-b42b5217ec70-feast-data\") pod \"99be9755-8d98-47cf-b68c-b42b5217ec70\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") "
Sep 15 08:24:09.539539 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.539426    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-offline-tls\") pod \"99be9755-8d98-47cf-b68c-b42b5217ec70\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") "
Sep 15 08:24:09.539539 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.539449    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-online-tls\") pod \"99be9755-8d98-47cf-b68c-b42b5217ec70\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") "
Sep 15 08:24:09.539539 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.539494    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-registry-tls\") pod \"99be9755-8d98-47cf-b68c-b42b5217ec70\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") "
Sep 15 08:24:09.539539 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.539511    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-ui-tls\") pod \"99be9755-8d98-47cf-b68c-b42b5217ec70\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") "
Sep 15 08:24:09.539539 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.539538    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2f4l\" (UniqueName: \"kubernetes.io/projected/99be9755-8d98-47cf-b68c-b42b5217ec70-kube-api-access-b2f4l\") pod \"99be9755-8d98-47cf-b68c-b42b5217ec70\" (UID: \"99be9755-8d98-47cf-b68c-b42b5217ec70\") "
Sep 15 08:24:09.539869 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.539811    2586 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-online-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:24:09.539869 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.539832    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkw9v\" (UniqueName: \"kubernetes.io/projected/c95daea2-0923-40c2-bebb-b6392eef35c8-kube-api-access-pkw9v\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:24:09.539869 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.539850    2586 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-ui-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:24:09.539869 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.539866    2586 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c95daea2-0923-40c2-bebb-b6392eef35c8-feast-data\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:24:09.540086 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.539882    2586 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c95daea2-0923-40c2-bebb-b6392eef35c8-registry-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:24:09.540086 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.539895    2586 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c95daea2-0923-40c2-bebb-b6392eef35c8-offline-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:24:09.540086 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.539974    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99be9755-8d98-47cf-b68c-b42b5217ec70-feast-data" (OuterVolumeSpecName: "feast-data") pod "99be9755-8d98-47cf-b68c-b42b5217ec70" (UID: "99be9755-8d98-47cf-b68c-b42b5217ec70"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 08:24:09.541742 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.541712    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-online-tls" (OuterVolumeSpecName: "online-tls") pod "99be9755-8d98-47cf-b68c-b42b5217ec70" (UID: "99be9755-8d98-47cf-b68c-b42b5217ec70"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:24:09.542011 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.541984    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "99be9755-8d98-47cf-b68c-b42b5217ec70" (UID: "99be9755-8d98-47cf-b68c-b42b5217ec70"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:24:09.542328 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.542288    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99be9755-8d98-47cf-b68c-b42b5217ec70-kube-api-access-b2f4l" (OuterVolumeSpecName: "kube-api-access-b2f4l") pod "99be9755-8d98-47cf-b68c-b42b5217ec70" (UID: "99be9755-8d98-47cf-b68c-b42b5217ec70"). InnerVolumeSpecName "kube-api-access-b2f4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 08:24:09.542412 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.542389    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "99be9755-8d98-47cf-b68c-b42b5217ec70" (UID: "99be9755-8d98-47cf-b68c-b42b5217ec70"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:24:09.542460 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.542406    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "99be9755-8d98-47cf-b68c-b42b5217ec70" (UID: "99be9755-8d98-47cf-b68c-b42b5217ec70"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 08:24:09.640389 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.640340    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2f4l\" (UniqueName: \"kubernetes.io/projected/99be9755-8d98-47cf-b68c-b42b5217ec70-kube-api-access-b2f4l\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:24:09.640389 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.640382    2586 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/99be9755-8d98-47cf-b68c-b42b5217ec70-feast-data\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:24:09.640389 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.640391    2586 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-offline-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:24:09.640389 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.640399    2586 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-online-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:24:09.640389 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.640409    2586 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-registry-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:24:09.640728 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.640416    2586 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/99be9755-8d98-47cf-b68c-b42b5217ec70-ui-tls\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:24:09.897536 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.897493    2586 generic.go:356] "Generic (PLEG): container finished" podID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerID="32069ab5f1070387e2cac4636ce4e45b81fea7ff1fbd1807f5d20eaeda0a6bd3" exitCode=137
Sep 15 08:24:09.897536 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.897526    2586 generic.go:356] "Generic (PLEG): container finished" podID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerID="6c14c6be0ef4b3ef6da663375f3e7b24d0ff26356161cdd2cdb26a8d570ba7ec" exitCode=137
Sep 15 08:24:09.898187 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.897564    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"
Sep 15 08:24:09.898187 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.897570    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" event={"ID":"99be9755-8d98-47cf-b68c-b42b5217ec70","Type":"ContainerDied","Data":"32069ab5f1070387e2cac4636ce4e45b81fea7ff1fbd1807f5d20eaeda0a6bd3"}
Sep 15 08:24:09.898187 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.897627    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" event={"ID":"99be9755-8d98-47cf-b68c-b42b5217ec70","Type":"ContainerDied","Data":"6c14c6be0ef4b3ef6da663375f3e7b24d0ff26356161cdd2cdb26a8d570ba7ec"}
Sep 15 08:24:09.898187 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.897657    2586 scope.go:117] "RemoveContainer" containerID="29be9715cf98ee8ac15ef94cefbd581bd7c6674965562307934e05308052cae0"
Sep 15 08:24:09.898187 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.897674    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9" event={"ID":"99be9755-8d98-47cf-b68c-b42b5217ec70","Type":"ContainerDied","Data":"2defb4364e9c406bf3d8e75b19155ef25a53a88bb885b31dc16e8c1f68c82d11"}
Sep 15 08:24:09.900673 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.900658    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"
Sep 15 08:24:09.900788 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.900686    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds" event={"ID":"c95daea2-0923-40c2-bebb-b6392eef35c8","Type":"ContainerDied","Data":"03377dd3c15354a5573d2e0644c1632f1f4471ba1ed01d9bf4ea58dfe4bb0318"}
Sep 15 08:24:09.906486 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.906421    2586 scope.go:117] "RemoveContainer" containerID="32069ab5f1070387e2cac4636ce4e45b81fea7ff1fbd1807f5d20eaeda0a6bd3"
Sep 15 08:24:09.913673 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.913658    2586 scope.go:117] "RemoveContainer" containerID="ac782f3c844350c8b64493d570cc5d356c223d5bcfee1f52e8e42fc7ad83eb4c"
Sep 15 08:24:09.919356 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.919335    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"]
Sep 15 08:24:09.921192 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.921154    2586 scope.go:117] "RemoveContainer" containerID="6c14c6be0ef4b3ef6da663375f3e7b24d0ff26356161cdd2cdb26a8d570ba7ec"
Sep 15 08:24:09.922814 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.922785    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-bmrp9"]
Sep 15 08:24:09.929197 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.929180    2586 scope.go:117] "RemoveContainer" containerID="2f079678784b414fb06c4190b4d5463fd3516bb1a7204928c006f45bb9908581"
Sep 15 08:24:09.933854 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.933830    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"]
Sep 15 08:24:09.936178 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.936164    2586 scope.go:117] "RemoveContainer" containerID="d51d502f39109d367810f6ac81aa7b65d0273687455cabe43bb4f028f61833d2"
Sep 15 08:24:09.939686 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.939658    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nhmds"]
Sep 15 08:24:09.943218 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.943204    2586 scope.go:117] "RemoveContainer" containerID="29be9715cf98ee8ac15ef94cefbd581bd7c6674965562307934e05308052cae0"
Sep 15 08:24:09.943470 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:24:09.943449    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29be9715cf98ee8ac15ef94cefbd581bd7c6674965562307934e05308052cae0\": container with ID starting with 29be9715cf98ee8ac15ef94cefbd581bd7c6674965562307934e05308052cae0 not found: ID does not exist" containerID="29be9715cf98ee8ac15ef94cefbd581bd7c6674965562307934e05308052cae0"
Sep 15 08:24:09.943531 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.943478    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29be9715cf98ee8ac15ef94cefbd581bd7c6674965562307934e05308052cae0"} err="failed to get container status \"29be9715cf98ee8ac15ef94cefbd581bd7c6674965562307934e05308052cae0\": rpc error: code = NotFound desc = could not find container \"29be9715cf98ee8ac15ef94cefbd581bd7c6674965562307934e05308052cae0\": container with ID starting with 29be9715cf98ee8ac15ef94cefbd581bd7c6674965562307934e05308052cae0 not found: ID does not exist"
Sep 15 08:24:09.943531 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.943495    2586 scope.go:117] "RemoveContainer" containerID="32069ab5f1070387e2cac4636ce4e45b81fea7ff1fbd1807f5d20eaeda0a6bd3"
Sep 15 08:24:09.943798 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:24:09.943782    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32069ab5f1070387e2cac4636ce4e45b81fea7ff1fbd1807f5d20eaeda0a6bd3\": container with ID starting with 32069ab5f1070387e2cac4636ce4e45b81fea7ff1fbd1807f5d20eaeda0a6bd3 not found: ID does not exist" containerID="32069ab5f1070387e2cac4636ce4e45b81fea7ff1fbd1807f5d20eaeda0a6bd3"
Sep 15 08:24:09.943847 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.943803    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32069ab5f1070387e2cac4636ce4e45b81fea7ff1fbd1807f5d20eaeda0a6bd3"} err="failed to get container status \"32069ab5f1070387e2cac4636ce4e45b81fea7ff1fbd1807f5d20eaeda0a6bd3\": rpc error: code = NotFound desc = could not find container \"32069ab5f1070387e2cac4636ce4e45b81fea7ff1fbd1807f5d20eaeda0a6bd3\": container with ID starting with 32069ab5f1070387e2cac4636ce4e45b81fea7ff1fbd1807f5d20eaeda0a6bd3 not found: ID does not exist"
Sep 15 08:24:09.943847 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.943816    2586 scope.go:117] "RemoveContainer" containerID="ac782f3c844350c8b64493d570cc5d356c223d5bcfee1f52e8e42fc7ad83eb4c"
Sep 15 08:24:09.944073 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:24:09.944054    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac782f3c844350c8b64493d570cc5d356c223d5bcfee1f52e8e42fc7ad83eb4c\": container with ID starting with ac782f3c844350c8b64493d570cc5d356c223d5bcfee1f52e8e42fc7ad83eb4c not found: ID does not exist" containerID="ac782f3c844350c8b64493d570cc5d356c223d5bcfee1f52e8e42fc7ad83eb4c"
Sep 15 08:24:09.944128 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.944080    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac782f3c844350c8b64493d570cc5d356c223d5bcfee1f52e8e42fc7ad83eb4c"} err="failed to get container status \"ac782f3c844350c8b64493d570cc5d356c223d5bcfee1f52e8e42fc7ad83eb4c\": rpc error: code = NotFound desc = could not find container \"ac782f3c844350c8b64493d570cc5d356c223d5bcfee1f52e8e42fc7ad83eb4c\": container with ID starting with ac782f3c844350c8b64493d570cc5d356c223d5bcfee1f52e8e42fc7ad83eb4c not found: ID does not exist"
Sep 15 08:24:09.944128 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.944095    2586 scope.go:117] "RemoveContainer" containerID="6c14c6be0ef4b3ef6da663375f3e7b24d0ff26356161cdd2cdb26a8d570ba7ec"
Sep 15 08:24:09.944352 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:24:09.944337    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c14c6be0ef4b3ef6da663375f3e7b24d0ff26356161cdd2cdb26a8d570ba7ec\": container with ID starting with 6c14c6be0ef4b3ef6da663375f3e7b24d0ff26356161cdd2cdb26a8d570ba7ec not found: ID does not exist" containerID="6c14c6be0ef4b3ef6da663375f3e7b24d0ff26356161cdd2cdb26a8d570ba7ec"
Sep 15 08:24:09.944391 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.944355    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c14c6be0ef4b3ef6da663375f3e7b24d0ff26356161cdd2cdb26a8d570ba7ec"} err="failed to get container status \"6c14c6be0ef4b3ef6da663375f3e7b24d0ff26356161cdd2cdb26a8d570ba7ec\": rpc error: code = NotFound desc = could not find container \"6c14c6be0ef4b3ef6da663375f3e7b24d0ff26356161cdd2cdb26a8d570ba7ec\": container with ID starting with 6c14c6be0ef4b3ef6da663375f3e7b24d0ff26356161cdd2cdb26a8d570ba7ec not found: ID does not exist"
Sep 15 08:24:09.944391 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.944368    2586 scope.go:117] "RemoveContainer" containerID="2f079678784b414fb06c4190b4d5463fd3516bb1a7204928c006f45bb9908581"
Sep 15 08:24:09.944597 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:24:09.944579    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f079678784b414fb06c4190b4d5463fd3516bb1a7204928c006f45bb9908581\": container with ID starting with 2f079678784b414fb06c4190b4d5463fd3516bb1a7204928c006f45bb9908581 not found: ID does not exist" containerID="2f079678784b414fb06c4190b4d5463fd3516bb1a7204928c006f45bb9908581"
Sep 15 08:24:09.944658 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.944602    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f079678784b414fb06c4190b4d5463fd3516bb1a7204928c006f45bb9908581"} err="failed to get container status \"2f079678784b414fb06c4190b4d5463fd3516bb1a7204928c006f45bb9908581\": rpc error: code = NotFound desc = could not find container \"2f079678784b414fb06c4190b4d5463fd3516bb1a7204928c006f45bb9908581\": container with ID starting with 2f079678784b414fb06c4190b4d5463fd3516bb1a7204928c006f45bb9908581 not found: ID does not exist"
Sep 15 08:24:09.944658 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.944618    2586 scope.go:117] "RemoveContainer" containerID="d51d502f39109d367810f6ac81aa7b65d0273687455cabe43bb4f028f61833d2"
Sep 15 08:24:09.944872 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:24:09.944857    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d51d502f39109d367810f6ac81aa7b65d0273687455cabe43bb4f028f61833d2\": container with ID starting with d51d502f39109d367810f6ac81aa7b65d0273687455cabe43bb4f028f61833d2 not found: ID does not exist" containerID="d51d502f39109d367810f6ac81aa7b65d0273687455cabe43bb4f028f61833d2"
Sep 15 08:24:09.944913 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.944875    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d51d502f39109d367810f6ac81aa7b65d0273687455cabe43bb4f028f61833d2"} err="failed to get container status \"d51d502f39109d367810f6ac81aa7b65d0273687455cabe43bb4f028f61833d2\": rpc error: code = NotFound desc = could not find container \"d51d502f39109d367810f6ac81aa7b65d0273687455cabe43bb4f028f61833d2\": container with ID starting with d51d502f39109d367810f6ac81aa7b65d0273687455cabe43bb4f028f61833d2 not found: ID does not exist"
Sep 15 08:24:09.944913 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.944898    2586 scope.go:117] "RemoveContainer" containerID="29be9715cf98ee8ac15ef94cefbd581bd7c6674965562307934e05308052cae0"
Sep 15 08:24:09.945128 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.945113    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29be9715cf98ee8ac15ef94cefbd581bd7c6674965562307934e05308052cae0"} err="failed to get container status \"29be9715cf98ee8ac15ef94cefbd581bd7c6674965562307934e05308052cae0\": rpc error: code = NotFound desc = could not find container \"29be9715cf98ee8ac15ef94cefbd581bd7c6674965562307934e05308052cae0\": container with ID starting with 29be9715cf98ee8ac15ef94cefbd581bd7c6674965562307934e05308052cae0 not found: ID does not exist"
Sep 15 08:24:09.945128 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.945127    2586 scope.go:117] "RemoveContainer" containerID="32069ab5f1070387e2cac4636ce4e45b81fea7ff1fbd1807f5d20eaeda0a6bd3"
Sep 15 08:24:09.945336 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.945319    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32069ab5f1070387e2cac4636ce4e45b81fea7ff1fbd1807f5d20eaeda0a6bd3"} err="failed to get container status \"32069ab5f1070387e2cac4636ce4e45b81fea7ff1fbd1807f5d20eaeda0a6bd3\": rpc error: code = NotFound desc = could not find container \"32069ab5f1070387e2cac4636ce4e45b81fea7ff1fbd1807f5d20eaeda0a6bd3\": container with ID starting with 32069ab5f1070387e2cac4636ce4e45b81fea7ff1fbd1807f5d20eaeda0a6bd3 not found: ID does not exist"
Sep 15 08:24:09.945384 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.945335    2586 scope.go:117] "RemoveContainer" containerID="ac782f3c844350c8b64493d570cc5d356c223d5bcfee1f52e8e42fc7ad83eb4c"
Sep 15 08:24:09.945556 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.945539    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac782f3c844350c8b64493d570cc5d356c223d5bcfee1f52e8e42fc7ad83eb4c"} err="failed to get container status \"ac782f3c844350c8b64493d570cc5d356c223d5bcfee1f52e8e42fc7ad83eb4c\": rpc error: code = NotFound desc = could not find container \"ac782f3c844350c8b64493d570cc5d356c223d5bcfee1f52e8e42fc7ad83eb4c\": container with ID starting with ac782f3c844350c8b64493d570cc5d356c223d5bcfee1f52e8e42fc7ad83eb4c not found: ID does not exist"
Sep 15 08:24:09.945613 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.945555    2586 scope.go:117] "RemoveContainer" containerID="6c14c6be0ef4b3ef6da663375f3e7b24d0ff26356161cdd2cdb26a8d570ba7ec"
Sep 15 08:24:09.945758 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.945742    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c14c6be0ef4b3ef6da663375f3e7b24d0ff26356161cdd2cdb26a8d570ba7ec"} err="failed to get container status \"6c14c6be0ef4b3ef6da663375f3e7b24d0ff26356161cdd2cdb26a8d570ba7ec\": rpc error: code = NotFound desc = could not find container \"6c14c6be0ef4b3ef6da663375f3e7b24d0ff26356161cdd2cdb26a8d570ba7ec\": container with ID starting with 6c14c6be0ef4b3ef6da663375f3e7b24d0ff26356161cdd2cdb26a8d570ba7ec not found: ID does not exist"
Sep 15 08:24:09.945808 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.945758    2586 scope.go:117] "RemoveContainer" containerID="2f079678784b414fb06c4190b4d5463fd3516bb1a7204928c006f45bb9908581"
Sep 15 08:24:09.945970 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.945955    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f079678784b414fb06c4190b4d5463fd3516bb1a7204928c006f45bb9908581"} err="failed to get container status \"2f079678784b414fb06c4190b4d5463fd3516bb1a7204928c006f45bb9908581\": rpc error: code = NotFound desc = could not find container \"2f079678784b414fb06c4190b4d5463fd3516bb1a7204928c006f45bb9908581\": container with ID starting with 2f079678784b414fb06c4190b4d5463fd3516bb1a7204928c006f45bb9908581 not found: ID does not exist"
Sep 15 08:24:09.945970 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.945969    2586 scope.go:117] "RemoveContainer" containerID="d51d502f39109d367810f6ac81aa7b65d0273687455cabe43bb4f028f61833d2"
Sep 15 08:24:09.946153 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.946138    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d51d502f39109d367810f6ac81aa7b65d0273687455cabe43bb4f028f61833d2"} err="failed to get container status \"d51d502f39109d367810f6ac81aa7b65d0273687455cabe43bb4f028f61833d2\": rpc error: code = NotFound desc = could not find container \"d51d502f39109d367810f6ac81aa7b65d0273687455cabe43bb4f028f61833d2\": container with ID starting with d51d502f39109d367810f6ac81aa7b65d0273687455cabe43bb4f028f61833d2 not found: ID does not exist"
Sep 15 08:24:09.946199 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.946152    2586 scope.go:117] "RemoveContainer" containerID="83b83bde8f47d23114ee160b7ff11dd2128baf67d2b6845b3c281b46f93785a9"
Sep 15 08:24:09.952781 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.952765    2586 scope.go:117] "RemoveContainer" containerID="b9e3f5d8ae2fe7fe7cd07e9d0767add3859e91fcb209d4178baed343ecf9f47d"
Sep 15 08:24:09.959529 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.959514    2586 scope.go:117] "RemoveContainer" containerID="3670e9ec829884992cc101043d5c65e82a9157cc1de4af392f8a2365ea7ba565"
Sep 15 08:24:09.966365 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.966349    2586 scope.go:117] "RemoveContainer" containerID="37607d4f5df524c1928036442591c5bc8e48ddfda962e2fa1ca99e20eb04358f"
Sep 15 08:24:09.972904 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:09.972877    2586 scope.go:117] "RemoveContainer" containerID="b34fe48e1c53b66ff7060d518f50ce91772e2f8382b8a956cb6ec1b721de5275"
Sep 15 08:24:11.720722 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:11.720683    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" path="/var/lib/kubelet/pods/99be9755-8d98-47cf-b68c-b42b5217ec70/volumes"
Sep 15 08:24:11.721510 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:11.721485    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" path="/var/lib/kubelet/pods/c95daea2-0923-40c2-bebb-b6392eef35c8/volumes"
Sep 15 08:24:21.737771 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:21.737716    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:24:21.866354 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:21.866322    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:24:28.088835 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.088801    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-np7mc/must-gather-kjwfw"]
Sep 15 08:24:28.089198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089084    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="offline"
Sep 15 08:24:28.089198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089097    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="offline"
Sep 15 08:24:28.089198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089112    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="online"
Sep 15 08:24:28.089198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089118    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="online"
Sep 15 08:24:28.089198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089125    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="feast-apply"
Sep 15 08:24:28.089198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089130    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="feast-apply"
Sep 15 08:24:28.089198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089137    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="ui"
Sep 15 08:24:28.089198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089142    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="ui"
Sep 15 08:24:28.089198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089148    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="feast-init"
Sep 15 08:24:28.089198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089153    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="feast-init"
Sep 15 08:24:28.089198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089159    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="feast-apply"
Sep 15 08:24:28.089198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089164    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="feast-apply"
Sep 15 08:24:28.089198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089171    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="online"
Sep 15 08:24:28.089198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089176    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="online"
Sep 15 08:24:28.089198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089181    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="feast-init"
Sep 15 08:24:28.089198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089186    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="feast-init"
Sep 15 08:24:28.089198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089193    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="ui"
Sep 15 08:24:28.089198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089198    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="ui"
Sep 15 08:24:28.089198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089203    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="offline"
Sep 15 08:24:28.089198 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089209    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="offline"
Sep 15 08:24:28.089835 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089216    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="registry"
Sep 15 08:24:28.089835 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089222    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="registry"
Sep 15 08:24:28.089835 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089263    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="ui"
Sep 15 08:24:28.089835 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089272    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="offline"
Sep 15 08:24:28.089835 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089277    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="ui"
Sep 15 08:24:28.089835 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089283    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="c95daea2-0923-40c2-bebb-b6392eef35c8" containerName="online"
Sep 15 08:24:28.089835 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089288    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="registry"
Sep 15 08:24:28.089835 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089293    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="online"
Sep 15 08:24:28.089835 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.089299    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="99be9755-8d98-47cf-b68c-b42b5217ec70" containerName="offline"
Sep 15 08:24:28.092111 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.092095    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-np7mc/must-gather-kjwfw"
Sep 15 08:24:28.094354 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.094323    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-np7mc\"/\"default-dockercfg-x6m8n\""
Sep 15 08:24:28.094469 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.094356    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-np7mc\"/\"openshift-service-ca.crt\""
Sep 15 08:24:28.094469 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.094356    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-np7mc\"/\"kube-root-ca.crt\""
Sep 15 08:24:28.098936 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.098910    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-np7mc/must-gather-kjwfw"]
Sep 15 08:24:28.184937 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.184902    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/935fce5e-4076-4a0a-b700-e1b439623916-must-gather-output\") pod \"must-gather-kjwfw\" (UID: \"935fce5e-4076-4a0a-b700-e1b439623916\") " pod="openshift-must-gather-np7mc/must-gather-kjwfw"
Sep 15 08:24:28.184937 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.184938    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzsz8\" (UniqueName: \"kubernetes.io/projected/935fce5e-4076-4a0a-b700-e1b439623916-kube-api-access-xzsz8\") pod \"must-gather-kjwfw\" (UID: \"935fce5e-4076-4a0a-b700-e1b439623916\") " pod="openshift-must-gather-np7mc/must-gather-kjwfw"
Sep 15 08:24:28.285874 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.285838    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/935fce5e-4076-4a0a-b700-e1b439623916-must-gather-output\") pod \"must-gather-kjwfw\" (UID: \"935fce5e-4076-4a0a-b700-e1b439623916\") " pod="openshift-must-gather-np7mc/must-gather-kjwfw"
Sep 15 08:24:28.285874 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.285875    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzsz8\" (UniqueName: \"kubernetes.io/projected/935fce5e-4076-4a0a-b700-e1b439623916-kube-api-access-xzsz8\") pod \"must-gather-kjwfw\" (UID: \"935fce5e-4076-4a0a-b700-e1b439623916\") " pod="openshift-must-gather-np7mc/must-gather-kjwfw"
Sep 15 08:24:28.286239 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.286219    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/935fce5e-4076-4a0a-b700-e1b439623916-must-gather-output\") pod \"must-gather-kjwfw\" (UID: \"935fce5e-4076-4a0a-b700-e1b439623916\") " pod="openshift-must-gather-np7mc/must-gather-kjwfw"
Sep 15 08:24:28.294958 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.294929    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzsz8\" (UniqueName: \"kubernetes.io/projected/935fce5e-4076-4a0a-b700-e1b439623916-kube-api-access-xzsz8\") pod \"must-gather-kjwfw\" (UID: \"935fce5e-4076-4a0a-b700-e1b439623916\") " pod="openshift-must-gather-np7mc/must-gather-kjwfw"
Sep 15 08:24:28.409124 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.409032    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-np7mc/must-gather-kjwfw"
Sep 15 08:24:28.454827 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.454790    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:24:28.556782 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.556747    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:24:28.676151 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.676082    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-np7mc/must-gather-kjwfw"]
Sep 15 08:24:28.679065 ip-10-0-134-189 kubenswrapper[2586]: W0915 08:24:28.679036    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod935fce5e_4076_4a0a_b700_e1b439623916.slice/crio-f8a969d45f8ef5d7276b2b74248ae12b37bf7bd6867e2b0ed0179f5d1a3aa35f WatchSource:0}: Error finding container f8a969d45f8ef5d7276b2b74248ae12b37bf7bd6867e2b0ed0179f5d1a3aa35f: Status 404 returned error can't find the container with id f8a969d45f8ef5d7276b2b74248ae12b37bf7bd6867e2b0ed0179f5d1a3aa35f
Sep 15 08:24:28.680852 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.680834    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 08:24:28.977199 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:28.977106    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-np7mc/must-gather-kjwfw" event={"ID":"935fce5e-4076-4a0a-b700-e1b439623916","Type":"ContainerStarted","Data":"f8a969d45f8ef5d7276b2b74248ae12b37bf7bd6867e2b0ed0179f5d1a3aa35f"}
Sep 15 08:24:35.005249 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:35.005151    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-np7mc/must-gather-kjwfw" event={"ID":"935fce5e-4076-4a0a-b700-e1b439623916","Type":"ContainerStarted","Data":"d771b13d0f65bd6c226b3ee26674b19549e7a3515f8d1003afba2c02d4f2cb9e"}
Sep 15 08:24:35.005249 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:35.005211    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-np7mc/must-gather-kjwfw" event={"ID":"935fce5e-4076-4a0a-b700-e1b439623916","Type":"ContainerStarted","Data":"1cf8246d825c70f0fda8c636cf04c5b084b6dc320add20b5f1bf12714a31db1c"}
Sep 15 08:24:35.021659 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:35.021582    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-np7mc/must-gather-kjwfw" podStartSLOduration=0.958134546 podStartE2EDuration="7.021567524s" totalImagesPullingTime="6.063432978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 08:24:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 08:24:35.020419607 +0000 UTC m=+2027.811882330" watchObservedRunningTime="2026-09-15 08:24:35.021567524 +0000 UTC m=+2027.813030284"
Sep 15 08:24:45.044951 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:45.044915    2586 generic.go:356] "Generic (PLEG): container finished" podID="935fce5e-4076-4a0a-b700-e1b439623916" containerID="1cf8246d825c70f0fda8c636cf04c5b084b6dc320add20b5f1bf12714a31db1c" exitCode=0
Sep 15 08:24:45.045376 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:45.044960    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-np7mc/must-gather-kjwfw" event={"ID":"935fce5e-4076-4a0a-b700-e1b439623916","Type":"ContainerDied","Data":"1cf8246d825c70f0fda8c636cf04c5b084b6dc320add20b5f1bf12714a31db1c"}
Sep 15 08:24:45.045376 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:45.045217    2586 scope.go:117] "RemoveContainer" containerID="1cf8246d825c70f0fda8c636cf04c5b084b6dc320add20b5f1bf12714a31db1c"
Sep 15 08:24:45.255148 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:45.255120    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-np7mc_must-gather-kjwfw_935fce5e-4076-4a0a-b700-e1b439623916/gather/0.log"
Sep 15 08:24:45.638401 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:45.638372    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:24:45.784957 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:45.784868    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:24:45.885070 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:45.885039    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:24:48.372172 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:48.372143    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-frqd6_d36ed006-6ecd-49cd-b7b1-965233accc84/global-pull-secret-syncer/0.log"
Sep 15 08:24:48.523644 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:48.523602    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log"
Sep 15 08:24:48.628253 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:48.628174    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-189.ec2.internal_4bf36dcd150da66bbf96efc4d354ac7b/haproxy/0.log"
Sep 15 08:24:50.617395 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:50.617363    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-np7mc/must-gather-kjwfw"]
Sep 15 08:24:50.617822 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:50.617559    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-np7mc/must-gather-kjwfw" podUID="935fce5e-4076-4a0a-b700-e1b439623916" containerName="copy" containerID="cri-o://d771b13d0f65bd6c226b3ee26674b19549e7a3515f8d1003afba2c02d4f2cb9e" gracePeriod=2
Sep 15 08:24:50.620774 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:50.620749    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-np7mc/must-gather-kjwfw"]
Sep 15 08:24:50.862872 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:50.862852    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-np7mc_must-gather-kjwfw_935fce5e-4076-4a0a-b700-e1b439623916/copy/0.log"
Sep 15 08:24:50.864472 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:50.864453    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-np7mc/must-gather-kjwfw"
Sep 15 08:24:50.866312 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:24:50.866289    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-kjwfw\" is forbidden: User \"system:node:ip-10-0-134-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-np7mc\": no relationship found between node 'ip-10-0-134-189.ec2.internal' and this object" podUID="935fce5e-4076-4a0a-b700-e1b439623916" pod="openshift-must-gather-np7mc/must-gather-kjwfw"
Sep 15 08:24:50.970602 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:50.970516    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzsz8\" (UniqueName: \"kubernetes.io/projected/935fce5e-4076-4a0a-b700-e1b439623916-kube-api-access-xzsz8\") pod \"935fce5e-4076-4a0a-b700-e1b439623916\" (UID: \"935fce5e-4076-4a0a-b700-e1b439623916\") "
Sep 15 08:24:50.970602 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:50.970579    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/935fce5e-4076-4a0a-b700-e1b439623916-must-gather-output\") pod \"935fce5e-4076-4a0a-b700-e1b439623916\" (UID: \"935fce5e-4076-4a0a-b700-e1b439623916\") "
Sep 15 08:24:50.970949 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:50.970927    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/935fce5e-4076-4a0a-b700-e1b439623916-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "935fce5e-4076-4a0a-b700-e1b439623916" (UID: "935fce5e-4076-4a0a-b700-e1b439623916"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 08:24:50.972890 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:50.972860    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/935fce5e-4076-4a0a-b700-e1b439623916-kube-api-access-xzsz8" (OuterVolumeSpecName: "kube-api-access-xzsz8") pod "935fce5e-4076-4a0a-b700-e1b439623916" (UID: "935fce5e-4076-4a0a-b700-e1b439623916"). InnerVolumeSpecName "kube-api-access-xzsz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 08:24:51.067822 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:51.067791    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-np7mc_must-gather-kjwfw_935fce5e-4076-4a0a-b700-e1b439623916/copy/0.log"
Sep 15 08:24:51.068163 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:51.068137    2586 generic.go:356] "Generic (PLEG): container finished" podID="935fce5e-4076-4a0a-b700-e1b439623916" containerID="d771b13d0f65bd6c226b3ee26674b19549e7a3515f8d1003afba2c02d4f2cb9e" exitCode=143
Sep 15 08:24:51.068206 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:51.068184    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-np7mc/must-gather-kjwfw"
Sep 15 08:24:51.068250 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:51.068236    2586 scope.go:117] "RemoveContainer" containerID="d771b13d0f65bd6c226b3ee26674b19549e7a3515f8d1003afba2c02d4f2cb9e"
Sep 15 08:24:51.070235 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:24:51.070200    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-kjwfw\" is forbidden: User \"system:node:ip-10-0-134-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-np7mc\": no relationship found between node 'ip-10-0-134-189.ec2.internal' and this object" podUID="935fce5e-4076-4a0a-b700-e1b439623916" pod="openshift-must-gather-np7mc/must-gather-kjwfw"
Sep 15 08:24:51.071364 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:51.071344    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzsz8\" (UniqueName: \"kubernetes.io/projected/935fce5e-4076-4a0a-b700-e1b439623916-kube-api-access-xzsz8\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:24:51.071418 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:51.071371    2586 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/935fce5e-4076-4a0a-b700-e1b439623916-must-gather-output\") on node \"ip-10-0-134-189.ec2.internal\" DevicePath \"\""
Sep 15 08:24:51.076365 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:51.076351    2586 scope.go:117] "RemoveContainer" containerID="1cf8246d825c70f0fda8c636cf04c5b084b6dc320add20b5f1bf12714a31db1c"
Sep 15 08:24:51.078461 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:24:51.078435    2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-kjwfw\" is forbidden: User \"system:node:ip-10-0-134-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-np7mc\": no relationship found between node 'ip-10-0-134-189.ec2.internal' and this object" podUID="935fce5e-4076-4a0a-b700-e1b439623916" pod="openshift-must-gather-np7mc/must-gather-kjwfw"
Sep 15 08:24:51.081569 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:51.081550    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:24:51.086568 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:51.086553    2586 scope.go:117] "RemoveContainer" containerID="d771b13d0f65bd6c226b3ee26674b19549e7a3515f8d1003afba2c02d4f2cb9e"
Sep 15 08:24:51.086821 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:24:51.086807    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d771b13d0f65bd6c226b3ee26674b19549e7a3515f8d1003afba2c02d4f2cb9e\": container with ID starting with d771b13d0f65bd6c226b3ee26674b19549e7a3515f8d1003afba2c02d4f2cb9e not found: ID does not exist" containerID="d771b13d0f65bd6c226b3ee26674b19549e7a3515f8d1003afba2c02d4f2cb9e"
Sep 15 08:24:51.086872 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:51.086829    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d771b13d0f65bd6c226b3ee26674b19549e7a3515f8d1003afba2c02d4f2cb9e"} err="failed to get container status \"d771b13d0f65bd6c226b3ee26674b19549e7a3515f8d1003afba2c02d4f2cb9e\": rpc error: code = NotFound desc = could not find container \"d771b13d0f65bd6c226b3ee26674b19549e7a3515f8d1003afba2c02d4f2cb9e\": container with ID starting with d771b13d0f65bd6c226b3ee26674b19549e7a3515f8d1003afba2c02d4f2cb9e not found: ID does not exist"
Sep 15 08:24:51.086872 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:51.086845    2586 scope.go:117] "RemoveContainer" containerID="1cf8246d825c70f0fda8c636cf04c5b084b6dc320add20b5f1bf12714a31db1c"
Sep 15 08:24:51.087105 ip-10-0-134-189 kubenswrapper[2586]: E0915 08:24:51.087087    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cf8246d825c70f0fda8c636cf04c5b084b6dc320add20b5f1bf12714a31db1c\": container with ID starting with 1cf8246d825c70f0fda8c636cf04c5b084b6dc320add20b5f1bf12714a31db1c not found: ID does not exist" containerID="1cf8246d825c70f0fda8c636cf04c5b084b6dc320add20b5f1bf12714a31db1c"
Sep 15 08:24:51.087148 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:51.087111    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cf8246d825c70f0fda8c636cf04c5b084b6dc320add20b5f1bf12714a31db1c"} err="failed to get container status \"1cf8246d825c70f0fda8c636cf04c5b084b6dc320add20b5f1bf12714a31db1c\": rpc error: code = NotFound desc = could not find container \"1cf8246d825c70f0fda8c636cf04c5b084b6dc320add20b5f1bf12714a31db1c\": container with ID starting with 1cf8246d825c70f0fda8c636cf04c5b084b6dc320add20b5f1bf12714a31db1c not found: ID does not exist"
Sep 15 08:24:51.139266 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:51.139238    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5wmdc_85304fe9-34fa-4309-be0b-d0403e10229a/konnectivity-agent/0.log" limit=1024
Sep 15 08:24:51.721358 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:51.721322    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="935fce5e-4076-4a0a-b700-e1b439623916" path="/var/lib/kubelet/pods/935fce5e-4076-4a0a-b700-e1b439623916/volumes"
Sep 15 08:24:52.889530 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:52.889504    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-p5672_4bd79376-f224-48c6-8c02-89f1be3e0a14/cluster-monitoring-operator/0.log"
Sep 15 08:24:53.208254 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:53.208187    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t6kbq_3c4c6ac9-8e57-41ea-b5f4-e23db633b07a/node-exporter/0.log"
Sep 15 08:24:53.245332 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:53.245302    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t6kbq_3c4c6ac9-8e57-41ea-b5f4-e23db633b07a/kube-rbac-proxy/0.log"
Sep 15 08:24:53.275403 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:53.275376    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t6kbq_3c4c6ac9-8e57-41ea-b5f4-e23db633b07a/init-textfile/0.log"
Sep 15 08:24:53.747724 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:53.747698    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b59d99f99-qkzth_427d69f1-ea72-4c48-9185-fa142e6f0d6e/telemeter-client/0.log"
Sep 15 08:24:53.770821 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:53.770795    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b59d99f99-qkzth_427d69f1-ea72-4c48-9185-fa142e6f0d6e/reload/0.log"
Sep 15 08:24:53.796699 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:53.796678    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b59d99f99-qkzth_427d69f1-ea72-4c48-9185-fa142e6f0d6e/kube-rbac-proxy/0.log"
Sep 15 08:24:54.974294 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:54.974269    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-rrtj4_793a3fee-4d06-4a69-97a5-b3a27db1d916/networking-console-plugin/0.log"
Sep 15 08:24:55.378194 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:55.378164    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cp9wl_a5527013-2ce3-48e3-b472-a593cbfbb55f/console-operator/1.log"
Sep 15 08:24:55.382769 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:55.382739    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cp9wl_a5527013-2ce3-48e3-b472-a593cbfbb55f/console-operator/2.log"
Sep 15 08:24:56.238484 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:56.238455    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-srb27_d829a2e5-593c-46f1-b4e9-55ac54ff459e/volume-data-source-validator/0.log"
Sep 15 08:24:56.842181 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:56.842149    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"]
Sep 15 08:24:56.842436 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:56.842423    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="935fce5e-4076-4a0a-b700-e1b439623916" containerName="gather"
Sep 15 08:24:56.842493 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:56.842436    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="935fce5e-4076-4a0a-b700-e1b439623916" containerName="gather"
Sep 15 08:24:56.842493 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:56.842456    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="935fce5e-4076-4a0a-b700-e1b439623916" containerName="copy"
Sep 15 08:24:56.842493 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:56.842461    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="935fce5e-4076-4a0a-b700-e1b439623916" containerName="copy"
Sep 15 08:24:56.842611 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:56.842536    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="935fce5e-4076-4a0a-b700-e1b439623916" containerName="copy"
Sep 15 08:24:56.842611 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:56.842545    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="935fce5e-4076-4a0a-b700-e1b439623916" containerName="gather"
Sep 15 08:24:56.844412 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:56.844394    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"
Sep 15 08:24:56.846890 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:56.846867    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g5skr\"/\"kube-root-ca.crt\""
Sep 15 08:24:56.846890 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:56.846884    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g5skr\"/\"openshift-service-ca.crt\""
Sep 15 08:24:56.848043 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:56.848028    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g5skr\"/\"default-dockercfg-lf626\""
Sep 15 08:24:56.851951 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:56.851932    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"]
Sep 15 08:24:57.018076 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:57.018041    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0283da9-307e-444e-a513-94f02c1013fd-lib-modules\") pod \"perf-node-gather-daemonset-w68jc\" (UID: \"b0283da9-307e-444e-a513-94f02c1013fd\") " pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"
Sep 15 08:24:57.018076 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:57.018075    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0283da9-307e-444e-a513-94f02c1013fd-sys\") pod \"perf-node-gather-daemonset-w68jc\" (UID: \"b0283da9-307e-444e-a513-94f02c1013fd\") " pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"
Sep 15 08:24:57.018330 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:57.018104    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b0283da9-307e-444e-a513-94f02c1013fd-proc\") pod \"perf-node-gather-daemonset-w68jc\" (UID: \"b0283da9-307e-444e-a513-94f02c1013fd\") " pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"
Sep 15 08:24:57.018330 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:57.018183    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56sv6\" (UniqueName: \"kubernetes.io/projected/b0283da9-307e-444e-a513-94f02c1013fd-kube-api-access-56sv6\") pod \"perf-node-gather-daemonset-w68jc\" (UID: \"b0283da9-307e-444e-a513-94f02c1013fd\") " pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"
Sep 15 08:24:57.018330 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:57.018224    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b0283da9-307e-444e-a513-94f02c1013fd-podres\") pod \"perf-node-gather-daemonset-w68jc\" (UID: \"b0283da9-307e-444e-a513-94f02c1013fd\") " pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"
Sep 15 08:24:57.053870 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:57.053843    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hnrrg_cab80741-1ae4-4014-b5dc-7d1e4751f3c9/dns/0.log"
Sep 15 08:24:57.074964 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:57.074941    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hnrrg_cab80741-1ae4-4014-b5dc-7d1e4751f3c9/kube-rbac-proxy/0.log"
Sep 15 08:24:57.119483 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:57.119401    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b0283da9-307e-444e-a513-94f02c1013fd-podres\") pod \"perf-node-gather-daemonset-w68jc\" (UID: \"b0283da9-307e-444e-a513-94f02c1013fd\") " pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"
Sep 15 08:24:57.119483 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:57.119474    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0283da9-307e-444e-a513-94f02c1013fd-lib-modules\") pod \"perf-node-gather-daemonset-w68jc\" (UID: \"b0283da9-307e-444e-a513-94f02c1013fd\") " pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"
Sep 15 08:24:57.119718 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:57.119500    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0283da9-307e-444e-a513-94f02c1013fd-sys\") pod \"perf-node-gather-daemonset-w68jc\" (UID: \"b0283da9-307e-444e-a513-94f02c1013fd\") " pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"
Sep 15 08:24:57.119718 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:57.119547    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b0283da9-307e-444e-a513-94f02c1013fd-proc\") pod \"perf-node-gather-daemonset-w68jc\" (UID: \"b0283da9-307e-444e-a513-94f02c1013fd\") " pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"
Sep 15 08:24:57.119718 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:57.119575    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56sv6\" (UniqueName: \"kubernetes.io/projected/b0283da9-307e-444e-a513-94f02c1013fd-kube-api-access-56sv6\") pod \"perf-node-gather-daemonset-w68jc\" (UID: \"b0283da9-307e-444e-a513-94f02c1013fd\") " pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"
Sep 15 08:24:57.119718 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:57.119579    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b0283da9-307e-444e-a513-94f02c1013fd-podres\") pod \"perf-node-gather-daemonset-w68jc\" (UID: \"b0283da9-307e-444e-a513-94f02c1013fd\") " pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"
Sep 15 08:24:57.119718 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:57.119603    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0283da9-307e-444e-a513-94f02c1013fd-sys\") pod \"perf-node-gather-daemonset-w68jc\" (UID: \"b0283da9-307e-444e-a513-94f02c1013fd\") " pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"
Sep 15 08:24:57.119718 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:57.119623    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0283da9-307e-444e-a513-94f02c1013fd-lib-modules\") pod \"perf-node-gather-daemonset-w68jc\" (UID: \"b0283da9-307e-444e-a513-94f02c1013fd\") " pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"
Sep 15 08:24:57.119718 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:57.119672    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b0283da9-307e-444e-a513-94f02c1013fd-proc\") pod \"perf-node-gather-daemonset-w68jc\" (UID: \"b0283da9-307e-444e-a513-94f02c1013fd\") " pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"
Sep 15 08:24:57.127284 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:57.127266    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56sv6\" (UniqueName: \"kubernetes.io/projected/b0283da9-307e-444e-a513-94f02c1013fd-kube-api-access-56sv6\") pod \"perf-node-gather-daemonset-w68jc\" (UID: \"b0283da9-307e-444e-a513-94f02c1013fd\") " pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"
Sep 15 08:24:57.154918 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:57.154898    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"
Sep 15 08:24:57.221862 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:57.221833    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sxwp6_270820a5-0bb6-46db-affd-a9ec2c639a9c/dns-node-resolver/0.log"
Sep 15 08:24:57.420290 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:57.420206    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"]
Sep 15 08:24:57.424146 ip-10-0-134-189 kubenswrapper[2586]: W0915 08:24:57.424116    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb0283da9_307e_444e_a513_94f02c1013fd.slice/crio-aba62b05bb09a79d286b4c9dc90f637b819c617b2632e6cc27009d8c11f31708 WatchSource:0}: Error finding container aba62b05bb09a79d286b4c9dc90f637b819c617b2632e6cc27009d8c11f31708: Status 404 returned error can't find the container with id aba62b05bb09a79d286b4c9dc90f637b819c617b2632e6cc27009d8c11f31708
Sep 15 08:24:57.722460 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:57.722376    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tm9mm_fd0cf790-5285-4db4-a40a-d40575ca5514/node-ca/0.log"
Sep 15 08:24:58.096283 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:58.096250    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc" event={"ID":"b0283da9-307e-444e-a513-94f02c1013fd","Type":"ContainerStarted","Data":"3cd1192b0e62c7cbd889fb81b9b9221ea02e8e4c567e10096705528e5832e8b9"}
Sep 15 08:24:58.096496 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:58.096308    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc" event={"ID":"b0283da9-307e-444e-a513-94f02c1013fd","Type":"ContainerStarted","Data":"aba62b05bb09a79d286b4c9dc90f637b819c617b2632e6cc27009d8c11f31708"}
Sep 15 08:24:58.096496 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:58.096345    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"
Sep 15 08:24:58.112015 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:58.111958    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc" podStartSLOduration=2.111937265 podStartE2EDuration="2.111937265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 08:24:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 08:24:58.111831541 +0000 UTC m=+2050.903294264" watchObservedRunningTime="2026-09-15 08:24:58.111937265 +0000 UTC m=+2050.903399991"
Sep 15 08:24:58.401173 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:58.401103    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-669c6d8db4-rp2c5_774b0ac9-0340-4bf4-b619-3d222d5ff31f/router/0.log"
Sep 15 08:24:58.740915 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:58.740835    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kdpdg_5c3e0fb9-88d9-4643-ac6a-f3ade63ff6f8/serve-healthcheck-canary/0.log"
Sep 15 08:24:59.102908 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:59.102876    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-fth5n_f07222e9-cd97-4468-81e2-b609ade2d29c/insights-operator/0.log"
Sep 15 08:24:59.103114 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:59.103097    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-fth5n_f07222e9-cd97-4468-81e2-b609ade2d29c/insights-operator/1.log"
Sep 15 08:24:59.190987 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:59.190962    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jdrkz_0e07b1b3-32ed-442d-854f-9f9cd71e81e5/kube-rbac-proxy/0.log"
Sep 15 08:24:59.212085 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:59.212057    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jdrkz_0e07b1b3-32ed-442d-854f-9f9cd71e81e5/exporter/0.log"
Sep 15 08:24:59.234304 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:24:59.234280    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jdrkz_0e07b1b3-32ed-442d-854f-9f9cd71e81e5/extractor/0.log"
Sep 15 08:25:03.565135 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:03.565096    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-n97wk_6b8214e2-c0ae-4ea5-992d-8a1b54e78196/kube-storage-version-migrator-operator/1.log"
Sep 15 08:25:03.565804 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:03.565784    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-n97wk_6b8214e2-c0ae-4ea5-992d-8a1b54e78196/kube-storage-version-migrator-operator/0.log"
Sep 15 08:25:04.109159 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:04.109131    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g5skr/perf-node-gather-daemonset-w68jc"
Sep 15 08:25:04.483771 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:04.483691    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg6gg_6c580ab2-446f-44b2-931e-444d49271760/kube-multus-additional-cni-plugins/0.log"
Sep 15 08:25:04.504951 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:04.504921    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg6gg_6c580ab2-446f-44b2-931e-444d49271760/egress-router-binary-copy/0.log"
Sep 15 08:25:04.524515 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:04.524484    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg6gg_6c580ab2-446f-44b2-931e-444d49271760/cni-plugins/0.log"
Sep 15 08:25:04.544704 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:04.544679    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg6gg_6c580ab2-446f-44b2-931e-444d49271760/bond-cni-plugin/0.log"
Sep 15 08:25:04.565598 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:04.565577    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg6gg_6c580ab2-446f-44b2-931e-444d49271760/routeoverride-cni/0.log"
Sep 15 08:25:04.585082 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:04.585060    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg6gg_6c580ab2-446f-44b2-931e-444d49271760/whereabouts-cni-bincopy/0.log"
Sep 15 08:25:04.604389 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:04.604364    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg6gg_6c580ab2-446f-44b2-931e-444d49271760/whereabouts-cni/0.log"
Sep 15 08:25:04.989923 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:04.989898    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vzrd7_54e3cf09-d6a2-4c32-8301-524f7a81716f/kube-multus/0.log"
Sep 15 08:25:05.067963 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:05.067936    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dhdbz_1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0/network-metrics-daemon/0.log"
Sep 15 08:25:05.093123 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:05.093101    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dhdbz_1a9a6da2-485c-4f6b-ab2e-ce2faf5602b0/kube-rbac-proxy/0.log"
Sep 15 08:25:06.396865 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:06.396835    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zlqdd_ddfadb96-d9a7-4e5a-b004-6e456cbd8b53/ovn-controller/0.log"
Sep 15 08:25:06.418208 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:06.418182    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zlqdd_ddfadb96-d9a7-4e5a-b004-6e456cbd8b53/ovn-acl-logging/0.log"
Sep 15 08:25:06.445144 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:06.445117    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zlqdd_ddfadb96-d9a7-4e5a-b004-6e456cbd8b53/kube-rbac-proxy-node/0.log"
Sep 15 08:25:06.468979 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:06.468916    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zlqdd_ddfadb96-d9a7-4e5a-b004-6e456cbd8b53/kube-rbac-proxy-ovn-metrics/0.log"
Sep 15 08:25:06.487334 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:06.487310    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zlqdd_ddfadb96-d9a7-4e5a-b004-6e456cbd8b53/northd/0.log"
Sep 15 08:25:06.508318 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:06.508296    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zlqdd_ddfadb96-d9a7-4e5a-b004-6e456cbd8b53/nbdb/0.log"
Sep 15 08:25:06.528596 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:06.528571    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zlqdd_ddfadb96-d9a7-4e5a-b004-6e456cbd8b53/sbdb/0.log"
Sep 15 08:25:06.566932 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:06.566908    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zlqdd_ddfadb96-d9a7-4e5a-b004-6e456cbd8b53/ovnkube-controller/0.log"
Sep 15 08:25:07.572102 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:07.572075    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-6f8b768455-wwv7l_f0f5c03f-9cf0-42bf-abae-0ede056b7586/check-endpoints/0.log"
Sep 15 08:25:07.643801 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:07.643766    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-q6bn9_6d3e2b9a-08af-462b-b07c-7f082791973c/network-check-target-container/0.log"
Sep 15 08:25:08.550766 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:08.550736    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-vz2jd_6f932980-e655-449a-8497-e65577afede4/iptables-alerter/0.log"
Sep 15 08:25:09.208710 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:09.208679    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-hvlpq_93bb56c0-c79e-4d0c-bd40-9d2f205fcb66/tuned/0.log"
Sep 15 08:25:10.943816 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:10.943741    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-th7m6_fb4abd1b-bf9e-4015-99e8-851a2a3e9a83/cluster-samples-operator/0.log"
Sep 15 08:25:10.961265 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:10.961238    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-th7m6_fb4abd1b-bf9e-4015-99e8-851a2a3e9a83/cluster-samples-operator-watch/0.log"
Sep 15 08:25:11.877961 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:11.877931    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-cf7c776b7-xr5xn_2ac26be4-56a7-4bbc-abcb-de5b68959883/service-ca-operator/1.log"
Sep 15 08:25:11.878791 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:11.878762    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-cf7c776b7-xr5xn_2ac26be4-56a7-4bbc-abcb-de5b68959883/service-ca-operator/0.log"
Sep 15 08:25:12.703784 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:12.703741    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-hv49k_00471982-2782-4f5b-ba82-817b30032b0d/csi-driver/0.log"
Sep 15 08:25:12.724453 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:12.724427    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-hv49k_00471982-2782-4f5b-ba82-817b30032b0d/csi-node-driver-registrar/0.log"
Sep 15 08:25:12.748706 ip-10-0-134-189 kubenswrapper[2586]: I0915 08:25:12.748688    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-hv49k_00471982-2782-4f5b-ba82-817b30032b0d/csi-liveness-probe/0.log"